[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200577490656-27451-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:49:37 dist-test-slave-6k22 krb5kdc[27460](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:49:37 dist-test-slave-6k22 krb5kdc[27460](info): set up 2 sockets
Aug 08 14:49:37 dist-test-slave-6k22 krb5kdc[27460](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260808 14:49:38.746903 27451 mini_kdc.cc:121] Time spent starting KDC: real 1.124s user 0.007s sys 0.014s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200577490656-27451-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200577490656-27451-0/krb5kdc/test-user.keytab.
Aug 08 14:49:38 dist-test-slave-6k22 krb5kdc[27460](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200578, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:49:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:49:38Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.206.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.206.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.206.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.254.keytab.
Entry for principal kudu/127.26.206.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.254.keytab.
I20260808 14:49:38.937618 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200577490656-27451-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200577490656-27451-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200577490656-27451-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.206.254:40599
--webserver_interface=127.26.206.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.254.keytab
--principal=kudu/127.26.206.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.206.212:33147
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.206.254:40599
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:49:39.311762 27474 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:49:39.312170 27474 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:49:39.312357 27474 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:49:39.319789 27474 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:49:39.319923 27474 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:49:39.320026 27474 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:49:39.320145 27474 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:49:39.320238 27474 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:49:39.330483 27474 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:33147
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200577490656-27451-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200577490656-27451-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.206.254:40599
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.254.keytab
--principal=kudu/127.26.206.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.206.254:40599
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.206.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200577490656-27451-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:49:39.332378 27474 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:49:39.334250 27474 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:49:39.351238 27479 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:49:39.351106 27480 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:49:39.351133 27482 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:49:39.352027 27474 server_base.cc:1034] running on GCE node
I20260808 14:49:39.353259 27474 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:49:39.355438 27474 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:49:39.356699 27474 hybrid_clock.cc:648] HybridClock initialized: now 1786200579356597 us; error 80 us; skew 500 ppm
I20260808 14:49:39.357252 27474 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:49:39 dist-test-slave-6k22 krb5kdc[27460](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200579, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:49:39.361159 27474 init.cc:377] Logged in from keytab as kudu/127.26.206.254@KRBTEST.COM (short username kudu)
I20260808 14:49:39.363727 27474 webserver.cc:460] Webserver started at http://127.26.206.254:35581/ using document root <none> and password file <none>
I20260808 14:49:39.364866 27474 fs_manager.cc:359] Metadata directory not provided
I20260808 14:49:39.365033 27474 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:49:39.365525 27474 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:49:39.369837 27474 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200577490656-27451-0/minicluster-data/master-0/data/instance:
uuid: "e61b625599d1457b9994a614645e8293"
format_stamp: "Formatted at 2026-08-08 14:49:39 on dist-test-slave-6k22"
server_key: "ffbab963aad559a01ab623ac4635bac4"
server_key_iv: "4279260e050f81c0f6a028a6608d508b"
server_key_version: "encryptionkey@0"
I20260808 14:49:39.370641 27474 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200577490656-27451-0/minicluster-data/master-0/wal/instance:
uuid: "e61b625599d1457b9994a614645e8293"
format_stamp: "Formatted at 2026-08-08 14:49:39 on dist-test-slave-6k22"
server_key: "ffbab963aad559a01ab623ac4635bac4"
server_key_iv: "4279260e050f81c0f6a028a6608d508b"
server_key_version: "encryptionkey@0"
I20260808 14:49:39.378798 27474 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.009s sys 0.000s
I20260808 14:49:39.384719 27489 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:49:39.386904 27474 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.004s sys 0.000s
I20260808 14:49:39.387205 27474 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200577490656-27451-0/minicluster-data/master-0/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200577490656-27451-0/minicluster-data/master-0/wal
uuid: "e61b625599d1457b9994a614645e8293"
format_stamp: "Formatted at 2026-08-08 14:49:39 on dist-test-slave-6k22"
server_key: "ffbab963aad559a01ab623ac4635bac4"
server_key_iv: "4279260e050f81c0f6a028a6608d508b"
server_key_version: "encryptionkey@0"
I20260808 14:49:39.387437 27474 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200577490656-27451-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200577490656-27451-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200577490656-27451-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:49:39.413636 27474 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:49:39.418879 27474 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:49:39.419258 27474 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:49:39.441396 27474 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.254:40599
I20260808 14:49:39.441421 27549 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.254:40599 every 8 connection(s)
I20260808 14:49:39.443490 27474 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
I20260808 14:49:39.445609 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 27474
I20260808 14:49:39.446043 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200577490656-27451-0/minicluster-data/master-0/wal/instance
I20260808 14:49:39.449600 27451 external_mini_cluster.cc:1428] Setting key d590934980ff738a309c09866c1f90ee
I20260808 14:49:39.452174 27550 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:49:39.468869 27550 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e61b625599d1457b9994a614645e8293: Bootstrap starting.
I20260808 14:49:39.475929 27550 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e61b625599d1457b9994a614645e8293: Neither blocks nor log segments found. Creating new log.
I20260808 14:49:39.477509 27550 log.cc:824] T 00000000000000000000000000000000 P e61b625599d1457b9994a614645e8293: Log is configured to *not* fsync() on all Append() calls
I20260808 14:49:39.481789 27550 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e61b625599d1457b9994a614645e8293: No bootstrap required, opened a new log
Aug 08 14:49:39 dist-test-slave-6k22 krb5kdc[27460](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200578, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.206.254@KRBTEST.COM
I20260808 14:49:39.492667 27550 raft_consensus.cc:348] T 00000000000000000000000000000000 P e61b625599d1457b9994a614645e8293 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e61b625599d1457b9994a614645e8293" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 40599 } }
I20260808 14:49:39.493321 27550 raft_consensus.cc:374] T 00000000000000000000000000000000 P e61b625599d1457b9994a614645e8293 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:49:39.493614 27550 raft_consensus.cc:729] T 00000000000000000000000000000000 P e61b625599d1457b9994a614645e8293 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e61b625599d1457b9994a614645e8293, State: Initialized, Role: FOLLOWER
I20260808 14:49:39.494963 27550 consensus_queue.cc:260] T 00000000000000000000000000000000 P e61b625599d1457b9994a614645e8293 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e61b625599d1457b9994a614645e8293" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 40599 } }
I20260808 14:49:39.495389 27550 raft_consensus.cc:388] T 00000000000000000000000000000000 P e61b625599d1457b9994a614645e8293 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:49:39.495774 27550 raft_consensus.cc:482] T 00000000000000000000000000000000 P e61b625599d1457b9994a614645e8293 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:49:39.496026 27550 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e61b625599d1457b9994a614645e8293 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:49:39.499502 27550 raft_consensus.cc:504] T 00000000000000000000000000000000 P e61b625599d1457b9994a614645e8293 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e61b625599d1457b9994a614645e8293" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 40599 } }
I20260808 14:49:39.500134 27552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:39.457245 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57562 (local address 127.26.206.254:40599)
0808 14:49:39.458297 (+ 1052us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:39.458313 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:39.462224 (+ 3911us) server_negotiation.cc:407] Connection header received
0808 14:49:39.472860 (+ 10636us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:39.472916 (+ 56us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:39.473888 (+ 972us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:39.474463 (+ 575us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:39.477497 (+ 3034us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:39.479451 (+ 1954us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:39.481170 (+ 1719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:39.482355 (+ 1185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:39.482656 (+ 301us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:39.488229 (+ 5573us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:49:39.488297 (+ 68us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:49:39.488341 (+ 44us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:49:39.488384 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:49:39.493039 (+ 4655us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:39.494102 (+ 1063us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:39.494109 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:39.494117 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:39.494532 (+ 415us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:39.495158 (+ 626us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:39.495163 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:39.495167 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:39.496202 (+ 1035us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:49:39.496686 (+ 484us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:39.497677 (+ 991us) server_negotiation.cc:299] Negotiation successful
0808 14:49:39.498088 (+ 411us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":698,"thread_start_us":385,"threads_started":1}
I20260808 14:49:39.500819 27550 leader_election.cc:302] T 00000000000000000000000000000000 P e61b625599d1457b9994a614645e8293 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e61b625599d1457b9994a614645e8293; no voters:
I20260808 14:49:39.501606 27550 leader_election.cc:288] T 00000000000000000000000000000000 P e61b625599d1457b9994a614645e8293 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:49:39.502012 27557 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e61b625599d1457b9994a614645e8293 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:49:39.504470 27550 sys_catalog.cc:564] T 00000000000000000000000000000000 P e61b625599d1457b9994a614645e8293 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:49:39.507977 27557 raft_consensus.cc:686] T 00000000000000000000000000000000 P e61b625599d1457b9994a614645e8293 [term 1 LEADER]: Becoming Leader. State: Replica: e61b625599d1457b9994a614645e8293, State: Running, Role: LEADER
I20260808 14:49:39.508988 27557 consensus_queue.cc:237] T 00000000000000000000000000000000 P e61b625599d1457b9994a614645e8293 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e61b625599d1457b9994a614645e8293" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 40599 } }
I20260808 14:49:39.514734 27558 sys_catalog.cc:455] T 00000000000000000000000000000000 P e61b625599d1457b9994a614645e8293 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e61b625599d1457b9994a614645e8293" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e61b625599d1457b9994a614645e8293" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 40599 } } }
I20260808 14:49:39.515244 27558 sys_catalog.cc:458] T 00000000000000000000000000000000 P e61b625599d1457b9994a614645e8293 [sys.catalog]: This master's current role is: LEADER
I20260808 14:49:39.519381 27559 sys_catalog.cc:455] T 00000000000000000000000000000000 P e61b625599d1457b9994a614645e8293 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e61b625599d1457b9994a614645e8293. Latest consensus state: current_term: 1 leader_uuid: "e61b625599d1457b9994a614645e8293" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e61b625599d1457b9994a614645e8293" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 40599 } } }
I20260808 14:49:39.519909 27559 sys_catalog.cc:458] T 00000000000000000000000000000000 P e61b625599d1457b9994a614645e8293 [sys.catalog]: This master's current role is: LEADER
I20260808 14:49:39.520707 27571 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:49:39.528232 27571 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:49:39.542814 27571 catalog_manager.cc:1347] Generated new cluster ID: 89a8b6fb8d604b149867504dab62b179
I20260808 14:49:39.542977 27571 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:49:39.562500 27571 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:49:39.564201 27571 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:49:39.577680 27571 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e61b625599d1457b9994a614645e8293: Generated new TSK 0
I20260808 14:49:39.578728 27571 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.206.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.206.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.206.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.193.keytab.
Entry for principal kudu/127.26.206.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.193.keytab.
I20260808 14:49:39.636723 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200577490656-27451-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200577490656-27451-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200577490656-27451-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200577490656-27451-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.206.193:0
--local_ip_for_outbound_sockets=127.26.206.193
--webserver_interface=127.26.206.193
--webserver_port=0
--tserver_master_addrs=127.26.206.254:40599
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.193.keytab
--principal=kudu/127.26.206.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.206.212:33147
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:49:39.989132 27579 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:49:39.989436 27579 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:49:39.989606 27579 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:49:39.996934 27579 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:49:39.997074 27579 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:49:39.997243 27579 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.206.193
I20260808 14:49:40.007468 27579 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:33147
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200577490656-27451-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200577490656-27451-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.193.keytab
--principal=kudu/127.26.206.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.206.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200577490656-27451-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.206.193
--webserver_port=0
--tserver_master_addrs=127.26.206.254:40599
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.206.193
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200577490656-27451-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:49:40.008826 27579 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:49:40.010293 27579 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:49:40.024538 27584 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:49:40.024736 27585 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:49:40.025024 27587 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:49:40.025533 27579 server_base.cc:1034] running on GCE node
I20260808 14:49:40.026111 27579 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:49:40.027029 27579 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:49:40.028280 27579 hybrid_clock.cc:648] HybridClock initialized: now 1786200580028220 us; error 54 us; skew 500 ppm
I20260808 14:49:40.028609 27579 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:49:40 dist-test-slave-6k22 krb5kdc[27460](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200580, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:49:40.031881 27579 init.cc:377] Logged in from keytab as kudu/127.26.206.193@KRBTEST.COM (short username kudu)
I20260808 14:49:40.033391 27579 webserver.cc:460] Webserver started at http://127.26.206.193:42691/ using document root <none> and password file <none>
I20260808 14:49:40.034104 27579 fs_manager.cc:359] Metadata directory not provided
I20260808 14:49:40.034282 27579 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:49:40.034616 27579 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:49:40.037662 27579 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200577490656-27451-0/minicluster-data/ts-0/data/instance:
uuid: "52accedecd7b42df9dd4b57475bdebf7"
format_stamp: "Formatted at 2026-08-08 14:49:40 on dist-test-slave-6k22"
server_key: "1260044f68891fe5c124d86a7a7914cc"
server_key_iv: "d755e63e243884b0f18210df2b6cdfb5"
server_key_version: "encryptionkey@0"
I20260808 14:49:40.038450 27579 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200577490656-27451-0/minicluster-data/ts-0/wal/instance:
uuid: "52accedecd7b42df9dd4b57475bdebf7"
format_stamp: "Formatted at 2026-08-08 14:49:40 on dist-test-slave-6k22"
server_key: "1260044f68891fe5c124d86a7a7914cc"
server_key_iv: "d755e63e243884b0f18210df2b6cdfb5"
server_key_version: "encryptionkey@0"
I20260808 14:49:40.043521 27579 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260808 14:49:40.046957 27595 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:49:40.048286 27579 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 14:49:40.048460 27579 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200577490656-27451-0/minicluster-data/ts-0/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200577490656-27451-0/minicluster-data/ts-0/wal
uuid: "52accedecd7b42df9dd4b57475bdebf7"
format_stamp: "Formatted at 2026-08-08 14:49:40 on dist-test-slave-6k22"
server_key: "1260044f68891fe5c124d86a7a7914cc"
server_key_iv: "d755e63e243884b0f18210df2b6cdfb5"
server_key_version: "encryptionkey@0"
I20260808 14:49:40.048664 27579 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200577490656-27451-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200577490656-27451-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200577490656-27451-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:49:40.060987 27579 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:49:40.064755 27579 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:49:40.065054 27579 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:49:40.066128 27579 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:49:40.067847 27579 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:49:40.067950 27579 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:49:40.068159 27579 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:49:40.068238 27579 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:49:40.103634 27579 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.193:36895
I20260808 14:49:40.103685 27724 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.193:36895 every 8 connection(s)
I20260808 14:49:40.105104 27579 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200577490656-27451-0/minicluster-data/ts-0/data/info.pb
I20260808 14:49:40.106371 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 27579
I20260808 14:49:40.106603 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200577490656-27451-0/minicluster-data/ts-0/wal/instance
I20260808 14:49:40.107239 27451 external_mini_cluster.cc:1428] Setting key 384a2e6542a335cfeb0ef24050533ee6
Aug 08 14:49:40 dist-test-slave-6k22 krb5kdc[27460](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200580, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.193@KRBTEST.COM for kudu/127.26.206.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.26.206.194@KRBTEST.COM; defaulting to no policy
I20260808 14:49:40.126374 27728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:40.108546 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.193:60579 (local address 127.26.206.254:40599)
0808 14:49:40.109015 (+ 469us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:40.109021 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:40.110238 (+ 1217us) server_negotiation.cc:407] Connection header received
0808 14:49:40.112275 (+ 2037us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:40.112280 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:40.112363 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:40.112484 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:40.114017 (+ 1533us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:40.114727 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:40.116354 (+ 1627us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:40.116749 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:40.116887 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:40.120470 (+ 3583us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:49:40.120475 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:49:40.120478 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:49:40.120509 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:49:40.123207 (+ 2698us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:40.123975 (+ 768us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:40.123980 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:40.123982 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:40.124096 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:40.124510 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:40.124515 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:40.124518 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:40.124770 (+ 252us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:49:40.124943 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:40.125731 (+ 788us) server_negotiation.cc:299] Negotiation successful
0808 14:49:40.125975 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":338,"thread_start_us":230,"threads_started":1}
I20260808 14:49:40.127408 27729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:40.109161 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:40599 (local address 127.26.206.193:60579)
0808 14:49:40.110093 (+ 932us) negotiation.cc:107] Waiting for socket to connect
0808 14:49:40.110137 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 14:49:40.112025 (+ 1888us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:49:40.112750 (+ 725us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:49:40.112759 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:49:40.113269 (+ 510us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:49:40.113851 (+ 582us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:40.113869 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:40.114892 (+ 1023us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:40.114904 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:40.116189 (+ 1285us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:40.116201 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:40.116977 (+ 776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:40.116985 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:40.117204 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:40.117871 (+ 667us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:49:40.117892 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:49:40.120250 (+ 2358us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:49:40.123351 (+ 3101us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:49:40.123359 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:49:40.123374 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:49:40.123847 (+ 473us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:49:40.124203 (+ 356us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:49:40.124208 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:49:40.124212 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:49:40.124390 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:49:40.124915 (+ 525us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:49:40.124922 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:49:40.125296 (+ 374us) client_negotiation.cc:769] Sending connection context
0808 14:49:40.125615 (+ 319us) client_negotiation.cc:240] Negotiation successful
0808 14:49:40.126220 (+ 605us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":646,"thread_start_us":366,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.206.194@KRBTEST.COM" created.
I20260808 14:49:40.129153 27726 heartbeater.cc:347] Connected to a master server at 127.26.206.254:40599
I20260808 14:49:40.129597 27726 heartbeater.cc:464] Registering TS with master...
I20260808 14:49:40.130398 27726 heartbeater.cc:511] Master 127.26.206.254:40599 requested a full tablet report, sending...
I20260808 14:49:40.134296 27508 ts_manager.cc:194] Registered new tserver with Master: 52accedecd7b42df9dd4b57475bdebf7 (127.26.206.193:36895)
I20260808 14:49:40.137318 27508 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.206.193@KRBTEST.COM'} at 127.26.206.193:60579
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.206.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.194.keytab.
Entry for principal kudu/127.26.206.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.194.keytab.
I20260808 14:49:40.154798 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200577490656-27451-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200577490656-27451-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200577490656-27451-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200577490656-27451-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.206.194:0
--local_ip_for_outbound_sockets=127.26.206.194
--webserver_interface=127.26.206.194
--webserver_port=0
--tserver_master_addrs=127.26.206.254:40599
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.194.keytab
--principal=kudu/127.26.206.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.206.212:33147
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:49:40.485533 27733 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:49:40.485805 27733 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:49:40.485981 27733 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:49:40.493311 27733 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:49:40.493438 27733 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:49:40.493655 27733 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.206.194
I20260808 14:49:40.503161 27733 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:33147
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200577490656-27451-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200577490656-27451-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.194.keytab
--principal=kudu/127.26.206.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.206.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200577490656-27451-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.206.194
--webserver_port=0
--tserver_master_addrs=127.26.206.254:40599
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.206.194
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200577490656-27451-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:49:40.504426 27733 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:49:40.505805 27733 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:49:40.519232 27741 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:49:40.519289 27745 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:49:40.519302 27742 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:49:40.520130 27733 server_base.cc:1034] running on GCE node
I20260808 14:49:40.520732 27733 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:49:40.521621 27733 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:49:40.522868 27733 hybrid_clock.cc:648] HybridClock initialized: now 1786200580522805 us; error 49 us; skew 500 ppm
I20260808 14:49:40.523146 27733 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:49:40 dist-test-slave-6k22 krb5kdc[27460](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200580, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:49:40.526460 27733 init.cc:377] Logged in from keytab as kudu/127.26.206.194@KRBTEST.COM (short username kudu)
I20260808 14:49:40.527989 27733 webserver.cc:460] Webserver started at http://127.26.206.194:36989/ using document root <none> and password file <none>
I20260808 14:49:40.528625 27733 fs_manager.cc:359] Metadata directory not provided
I20260808 14:49:40.528780 27733 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:49:40.529131 27733 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:49:40.532021 27733 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200577490656-27451-0/minicluster-data/ts-1/data/instance:
uuid: "7f292ad52f24459e8a4212b0e55a272b"
format_stamp: "Formatted at 2026-08-08 14:49:40 on dist-test-slave-6k22"
server_key: "3d357fa12fb48648490e76813ae90944"
server_key_iv: "17e4127e8ac732b28ac008f6c0fd8d37"
server_key_version: "encryptionkey@0"
I20260808 14:49:40.532807 27733 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200577490656-27451-0/minicluster-data/ts-1/wal/instance:
uuid: "7f292ad52f24459e8a4212b0e55a272b"
format_stamp: "Formatted at 2026-08-08 14:49:40 on dist-test-slave-6k22"
server_key: "3d357fa12fb48648490e76813ae90944"
server_key_iv: "17e4127e8ac732b28ac008f6c0fd8d37"
server_key_version: "encryptionkey@0"
I20260808 14:49:40.537850 27733 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.004s
I20260808 14:49:40.541323 27754 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:49:40.542588 27733 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 14:49:40.542778 27733 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200577490656-27451-0/minicluster-data/ts-1/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200577490656-27451-0/minicluster-data/ts-1/wal
uuid: "7f292ad52f24459e8a4212b0e55a272b"
format_stamp: "Formatted at 2026-08-08 14:49:40 on dist-test-slave-6k22"
server_key: "3d357fa12fb48648490e76813ae90944"
server_key_iv: "17e4127e8ac732b28ac008f6c0fd8d37"
server_key_version: "encryptionkey@0"
I20260808 14:49:40.542971 27733 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200577490656-27451-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200577490656-27451-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200577490656-27451-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:49:40.557370 27733 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:49:40.561720 27733 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:49:40.562005 27733 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:49:40.562959 27733 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:49:40.564316 27733 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:49:40.564417 27733 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:49:40.564599 27733 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:49:40.564673 27733 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:49:40.599166 27733 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.194:35699
I20260808 14:49:40.599203 27885 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.194:35699 every 8 connection(s)
I20260808 14:49:40.600548 27733 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200577490656-27451-0/minicluster-data/ts-1/data/info.pb
I20260808 14:49:40.602177 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 27733
I20260808 14:49:40.602412 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200577490656-27451-0/minicluster-data/ts-1/wal/instance
I20260808 14:49:40.603029 27451 external_mini_cluster.cc:1428] Setting key 171f558b059eac6263245cab10c3236e
Aug 08 14:49:40 dist-test-slave-6k22 krb5kdc[27460](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200580, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.194@KRBTEST.COM for kudu/127.26.206.254@KRBTEST.COM
I20260808 14:49:40.620729 27728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:40.603227 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.194:44055 (local address 127.26.206.254:40599)
0808 14:49:40.603421 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:40.603426 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:40.604840 (+ 1414us) server_negotiation.cc:407] Connection header received
0808 14:49:40.606846 (+ 2006us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:40.606852 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:40.606939 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:40.607070 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:40.608566 (+ 1496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:40.609270 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:40.610981 (+ 1711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:40.611463 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:40.611607 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:40.614949 (+ 3342us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:49:40.614953 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:49:40.614956 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:49:40.614986 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:49:40.617544 (+ 2558us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:40.618222 (+ 678us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:40.618231 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:40.618233 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:40.618367 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:40.618899 (+ 532us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:40.618908 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:40.618910 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:40.619251 (+ 341us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:49:40.619413 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:40.620122 (+ 709us) server_negotiation.cc:299] Negotiation successful
0808 14:49:40.620387 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260808 14:49:40.621618 27889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:40.603868 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:40599 (local address 127.26.206.194:44055)
0808 14:49:40.604674 (+ 806us) negotiation.cc:107] Waiting for socket to connect
0808 14:49:40.604717 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 14:49:40.606596 (+ 1879us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:49:40.607285 (+ 689us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:49:40.607293 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:49:40.607862 (+ 569us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:49:40.608411 (+ 549us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:40.608428 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:40.609465 (+ 1037us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:40.609472 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:40.610838 (+ 1366us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:40.610857 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:40.611701 (+ 844us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:40.611709 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:40.611929 (+ 220us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:40.612609 (+ 680us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:49:40.612653 (+ 44us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:49:40.614702 (+ 2049us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:49:40.617679 (+ 2977us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:49:40.617687 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:49:40.617700 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:49:40.618097 (+ 397us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:49:40.618536 (+ 439us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:49:40.618541 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:49:40.618545 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:49:40.618737 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:49:40.619386 (+ 649us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:49:40.619393 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:49:40.619771 (+ 378us) client_negotiation.cc:769] Sending connection context
0808 14:49:40.620024 (+ 253us) client_negotiation.cc:240] Negotiation successful
0808 14:49:40.620519 (+ 495us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":575,"thread_start_us":403,"threads_started":1}
I20260808 14:49:40.623162 27886 heartbeater.cc:347] Connected to a master server at 127.26.206.254:40599
WARNING: no policy specified for kudu/127.26.206.195@KRBTEST.COM; defaulting to no policy
I20260808 14:49:40.623449 27886 heartbeater.cc:464] Registering TS with master...
I20260808 14:49:40.624176 27886 heartbeater.cc:511] Master 127.26.206.254:40599 requested a full tablet report, sending...
I20260808 14:49:40.625607 27508 ts_manager.cc:194] Registered new tserver with Master: 7f292ad52f24459e8a4212b0e55a272b (127.26.206.194:35699)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.206.195@KRBTEST.COM" created.
I20260808 14:49:40.626631 27508 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.206.194@KRBTEST.COM'} at 127.26.206.194:44055
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.206.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.195.keytab.
Entry for principal kudu/127.26.206.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.195.keytab.
I20260808 14:49:40.650964 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200577490656-27451-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200577490656-27451-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200577490656-27451-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200577490656-27451-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.206.195:0
--local_ip_for_outbound_sockets=127.26.206.195
--webserver_interface=127.26.206.195
--webserver_port=0
--tserver_master_addrs=127.26.206.254:40599
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.195.keytab
--principal=kudu/127.26.206.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.206.212:33147
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:49:40.979943 27892 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:49:40.980207 27892 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:49:40.980386 27892 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:49:40.987746 27892 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:49:40.987872 27892 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:49:40.988052 27892 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.206.195
I20260808 14:49:40.997937 27892 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:33147
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200577490656-27451-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200577490656-27451-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.195.keytab
--principal=kudu/127.26.206.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.206.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200577490656-27451-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.206.195
--webserver_port=0
--tserver_master_addrs=127.26.206.254:40599
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.206.195
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200577490656-27451-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:49:40.999194 27892 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:49:41.000505 27892 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:49:41.013469 27899 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:49:41.013485 27900 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:49:41.013455 27902 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:49:41.014498 27892 server_base.cc:1034] running on GCE node
I20260808 14:49:41.015013 27892 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:49:41.015897 27892 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:49:41.017083 27892 hybrid_clock.cc:648] HybridClock initialized: now 1786200581017053 us; error 29 us; skew 500 ppm
I20260808 14:49:41.017341 27892 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:49:41 dist-test-slave-6k22 krb5kdc[27460](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200581, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:49:41.020953 27892 init.cc:377] Logged in from keytab as kudu/127.26.206.195@KRBTEST.COM (short username kudu)
I20260808 14:49:41.022269 27892 webserver.cc:460] Webserver started at http://127.26.206.195:43683/ using document root <none> and password file <none>
I20260808 14:49:41.022895 27892 fs_manager.cc:359] Metadata directory not provided
I20260808 14:49:41.023038 27892 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:49:41.023352 27892 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:49:41.026172 27892 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200577490656-27451-0/minicluster-data/ts-2/data/instance:
uuid: "f678ca6a8c7f4b1787fdfeda8f9f4071"
format_stamp: "Formatted at 2026-08-08 14:49:41 on dist-test-slave-6k22"
server_key: "0ffc1ff82d71d58484fe89ad4d5ef88e"
server_key_iv: "ed6ba9ced196c4e4c28dcb0b08d206e9"
server_key_version: "encryptionkey@0"
I20260808 14:49:41.026947 27892 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200577490656-27451-0/minicluster-data/ts-2/wal/instance:
uuid: "f678ca6a8c7f4b1787fdfeda8f9f4071"
format_stamp: "Formatted at 2026-08-08 14:49:41 on dist-test-slave-6k22"
server_key: "0ffc1ff82d71d58484fe89ad4d5ef88e"
server_key_iv: "ed6ba9ced196c4e4c28dcb0b08d206e9"
server_key_version: "encryptionkey@0"
I20260808 14:49:41.032094 27892 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260808 14:49:41.035720 27910 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:49:41.036890 27892 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.004s
I20260808 14:49:41.037099 27892 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200577490656-27451-0/minicluster-data/ts-2/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200577490656-27451-0/minicluster-data/ts-2/wal
uuid: "f678ca6a8c7f4b1787fdfeda8f9f4071"
format_stamp: "Formatted at 2026-08-08 14:49:41 on dist-test-slave-6k22"
server_key: "0ffc1ff82d71d58484fe89ad4d5ef88e"
server_key_iv: "ed6ba9ced196c4e4c28dcb0b08d206e9"
server_key_version: "encryptionkey@0"
I20260808 14:49:41.037329 27892 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200577490656-27451-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200577490656-27451-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200577490656-27451-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:49:41.055275 27892 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:49:41.059140 27892 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:49:41.059442 27892 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:49:41.060386 27892 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:49:41.061664 27892 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:49:41.061775 27892 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:49:41.061926 27892 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:49:41.061996 27892 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:49:41.097657 27892 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.195:46569
I20260808 14:49:41.097694 28045 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.195:46569 every 8 connection(s)
I20260808 14:49:41.099002 27892 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200577490656-27451-0/minicluster-data/ts-2/data/info.pb
I20260808 14:49:41.108642 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 27892
I20260808 14:49:41.108866 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200577490656-27451-0/minicluster-data/ts-2/wal/instance
I20260808 14:49:41.109449 27451 external_mini_cluster.cc:1428] Setting key 25d635d2075bffaeaed4a3876774d2a4
Aug 08 14:49:41 dist-test-slave-6k22 krb5kdc[27460](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200581, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.195@KRBTEST.COM for kudu/127.26.206.254@KRBTEST.COM
I20260808 14:49:41.120581 27728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:41.101633 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.195:50965 (local address 127.26.206.254:40599)
0808 14:49:41.101839 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:41.101846 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:41.103278 (+ 1432us) server_negotiation.cc:407] Connection header received
0808 14:49:41.105842 (+ 2564us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:41.105846 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:41.105914 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:41.106004 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:41.108108 (+ 2104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:41.108921 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:41.110743 (+ 1822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:41.111406 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:41.111507 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:41.115439 (+ 3932us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:49:41.115444 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:49:41.115447 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:49:41.115478 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:49:41.117968 (+ 2490us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:41.118637 (+ 669us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:41.118641 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:41.118643 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:41.118789 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:41.119162 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:41.119165 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:41.119167 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:41.119440 (+ 273us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:49:41.119550 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:41.120181 (+ 631us) server_negotiation.cc:299] Negotiation successful
0808 14:49:41.120345 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260808 14:49:41.121475 28048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:41.102188 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:40599 (local address 127.26.206.195:50965)
0808 14:49:41.103064 (+ 876us) negotiation.cc:107] Waiting for socket to connect
0808 14:49:41.103148 (+ 84us) client_negotiation.cc:174] Beginning negotiation
0808 14:49:41.105555 (+ 2407us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:49:41.106278 (+ 723us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:49:41.106293 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:49:41.107174 (+ 881us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:49:41.107953 (+ 779us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:41.107974 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:41.109110 (+ 1136us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:41.109126 (+ 16us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:41.110588 (+ 1462us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:41.110606 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:41.111673 (+ 1067us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:41.111682 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:41.112020 (+ 338us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:41.112841 (+ 821us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:49:41.112862 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:49:41.115266 (+ 2404us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:49:41.118093 (+ 2827us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:49:41.118099 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:49:41.118109 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:49:41.118533 (+ 424us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:49:41.118880 (+ 347us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:49:41.118883 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:49:41.118885 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:49:41.119049 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:49:41.119542 (+ 493us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:49:41.119547 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:49:41.119877 (+ 330us) client_negotiation.cc:769] Sending connection context
0808 14:49:41.120082 (+ 205us) client_negotiation.cc:240] Negotiation successful
0808 14:49:41.120412 (+ 330us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":590,"thread_start_us":367,"threads_started":1}
I20260808 14:49:41.122869 28046 heartbeater.cc:347] Connected to a master server at 127.26.206.254:40599
I20260808 14:49:41.123111 28046 heartbeater.cc:464] Registering TS with master...
I20260808 14:49:41.123788 28046 heartbeater.cc:511] Master 127.26.206.254:40599 requested a full tablet report, sending...
I20260808 14:49:41.125190 27508 ts_manager.cc:194] Registered new tserver with Master: f678ca6a8c7f4b1787fdfeda8f9f4071 (127.26.206.195:46569)
I20260808 14:49:41.126153 27508 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.206.195@KRBTEST.COM'} at 127.26.206.195:50965
I20260808 14:49:41.126402 27451 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 14:49:41.141839 27726 heartbeater.cc:503] Master 127.26.206.254:40599 was elected leader, sending a full tablet report...
Aug 08 14:49:41 dist-test-slave-6k22 krb5kdc[27460](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200581, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 14:49:41 dist-test-slave-6k22 krb5kdc[27460](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200581, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.26.206.193@KRBTEST.COM
I20260808 14:49:41.179991 28053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:41.165197 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59350 (local address 127.26.206.193:36895)
0808 14:49:41.165860 (+ 663us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:41.165866 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:41.165973 (+ 107us) server_negotiation.cc:407] Connection header received
0808 14:49:41.166126 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:41.166133 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:41.166339 (+ 206us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:41.166476 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:41.167968 (+ 1492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:41.169052 (+ 1084us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:41.170265 (+ 1213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:41.170801 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:41.170892 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:41.174740 (+ 3848us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:49:41.174750 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:49:41.174776 (+ 26us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:49:41.174806 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:49:41.177613 (+ 2807us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:41.178219 (+ 606us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:41.178226 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:41.178228 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:41.178348 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:41.178666 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:41.178669 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:41.178671 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:41.178995 (+ 324us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:49:41.179215 (+ 220us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:41.179446 (+ 231us) server_negotiation.cc:299] Negotiation successful
0808 14:49:41.179687 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":490,"thread_start_us":335,"threads_started":1}
W20260808 14:49:41.181260 27628 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:59350
Aug 08 14:49:41 dist-test-slave-6k22 krb5kdc[27460](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200581, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 14:49:41 dist-test-slave-6k22 krb5kdc[27460](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200581, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.206.193@KRBTEST.COM
I20260808 14:49:41.229332 28053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:41.216361 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59362 (local address 127.26.206.193:36895)
0808 14:49:41.216600 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:41.216605 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:41.216726 (+ 121us) server_negotiation.cc:407] Connection header received
0808 14:49:41.216878 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:41.216882 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:41.216946 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:41.217030 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:41.218358 (+ 1328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:41.219031 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:41.220337 (+ 1306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:41.220767 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:41.220858 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:41.224642 (+ 3784us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:49:41.224647 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:49:41.224650 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:49:41.224681 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:49:41.227063 (+ 2382us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:41.227689 (+ 626us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:41.227693 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:41.227695 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:41.227820 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:41.228134 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:41.228136 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:41.228138 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:41.228371 (+ 233us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:49:41.228546 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:41.228776 (+ 230us) server_negotiation.cc:299] Negotiation successful
0808 14:49:41.228980 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260808 14:49:41.231318 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 27579
I20260808 14:49:41.243288 28053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:41.232350 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59374 (local address 127.26.206.193:36895)
0808 14:49:41.232499 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:41.232503 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:41.232891 (+ 388us) server_negotiation.cc:407] Connection header received
0808 14:49:41.232996 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:41.233000 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:41.233049 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:41.233125 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:41.234197 (+ 1072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:41.234857 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:41.236099 (+ 1242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:41.236516 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:41.236607 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:41.238613 (+ 2006us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:49:41.238617 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:49:41.238620 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:49:41.238646 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:49:41.241160 (+ 2514us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:41.241723 (+ 563us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:41.241727 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:41.241729 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:41.241896 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:41.242188 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:41.242190 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:41.242192 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:41.242445 (+ 253us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:49:41.242609 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:41.242862 (+ 253us) server_negotiation.cc:299] Negotiation successful
0808 14:49:41.243002 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260808 14:49:41.244114 27717 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:49:41.331312 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 27579
I20260808 14:49:41.351080 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 27733
Aug 08 14:49:41 dist-test-slave-6k22 krb5kdc[27460](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200581, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.206.194@KRBTEST.COM
I20260808 14:49:41.366089 28061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:41.351979 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58406 (local address 127.26.206.194:35699)
0808 14:49:41.352548 (+ 569us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:41.352555 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:41.352579 (+ 24us) server_negotiation.cc:407] Connection header received
0808 14:49:41.352636 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:41.352642 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:41.352850 (+ 208us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:41.352981 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:41.354063 (+ 1082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:41.355065 (+ 1002us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:41.356377 (+ 1312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:41.356888 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:41.356980 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:41.360949 (+ 3969us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:49:41.360959 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:49:41.360973 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:49:41.361004 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:49:41.363692 (+ 2688us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:41.364314 (+ 622us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:41.364320 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:41.364322 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:41.364433 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:41.364733 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:41.364736 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:41.364738 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:41.365079 (+ 341us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:49:41.365296 (+ 217us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:41.365532 (+ 236us) server_negotiation.cc:299] Negotiation successful
0808 14:49:41.365716 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":422,"thread_start_us":314,"threads_started":1}
I20260808 14:49:41.367312 27879 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:49:41.450567 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 27733
I20260808 14:49:41.469916 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 27892
Aug 08 14:49:41 dist-test-slave-6k22 krb5kdc[27460](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200581, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.206.195@KRBTEST.COM
I20260808 14:49:41.490592 28065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:41.470943 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58938 (local address 127.26.206.195:46569)
0808 14:49:41.471702 (+ 759us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:41.471709 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:41.471737 (+ 28us) server_negotiation.cc:407] Connection header received
0808 14:49:41.471812 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:41.471819 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:41.472027 (+ 208us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:41.472157 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:41.473368 (+ 1211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:41.474414 (+ 1046us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:41.475725 (+ 1311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:41.476269 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:41.476367 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:41.484854 (+ 8487us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:49:41.484870 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:49:41.484885 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:49:41.484938 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:49:41.488034 (+ 3096us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:41.488628 (+ 594us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:41.488635 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:41.488637 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:41.488827 (+ 190us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:41.489171 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:41.489174 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:41.489176 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:41.489507 (+ 331us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:49:41.489728 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:41.489992 (+ 264us) server_negotiation.cc:299] Negotiation successful
0808 14:49:41.490201 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":525,"thread_start_us":353,"threads_started":1}
I20260808 14:49:41.492038 28039 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:49:41.593838 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 27892
I20260808 14:49:41.613240 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 27474
I20260808 14:49:41.614425 27544 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:49:41.717031 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 27474
2026-08-08T14:49:41Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (4153 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200577490656-27451-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:49:41 dist-test-slave-6k22 krb5kdc[28070](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:49:41 dist-test-slave-6k22 krb5kdc[28070](info): set up 2 sockets
Aug 08 14:49:41 dist-test-slave-6k22 krb5kdc[28070](info): commencing operation
krb5kdc: starting...
W20260808 14:49:42.985116 27451 mini_kdc.cc:121] Time spent starting KDC: real 1.222s user 0.003s sys 0.015s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
W20260808 14:49:43.129739 27451 mini_kdc.cc:253] Time spent creating user principal test-admin: real 0.144s user 0.001s sys 0.005s
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
W20260808 14:49:43.330600 27451 mini_kdc.cc:253] Time spent creating user principal test-user: real 0.201s user 0.001s sys 0.005s
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
W20260808 14:49:43.539906 27451 mini_kdc.cc:253] Time spent creating user principal joe-interloper: real 0.209s user 0.000s sys 0.007s
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200577490656-27451-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200577490656-27451-0/krb5kdc/test-user.keytab.
W20260808 14:49:44.056594 27451 mini_kdc.cc:302] Time spent creating keytab for test-user: real 0.516s user 0.001s sys 0.006s
Aug 08 14:49:44 dist-test-slave-6k22 krb5kdc[28070](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200584, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:49:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:49:44Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.206.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.206.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.206.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.254.keytab.
Entry for principal kudu/127.26.206.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.254.keytab.
W20260808 14:49:44.306852 27451 mini_kdc.cc:262] Time spent creating service keytab for kudu/127.26.206.254: real 0.197s user 0.001s sys 0.009s
I20260808 14:49:44.307976 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200577490656-27451-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200577490656-27451-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200577490656-27451-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.206.254:39125
--webserver_interface=127.26.206.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.254.keytab
--principal=kudu/127.26.206.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.206.212:45029
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.206.254:39125
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:49:44.630942 28084 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:49:44.631244 28084 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:49:44.631338 28084 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:49:44.638613 28084 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:49:44.638731 28084 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:49:44.638787 28084 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:49:44.638846 28084 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:49:44.638891 28084 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:49:44.648691 28084 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:45029
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200577490656-27451-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200577490656-27451-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.206.254:39125
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.254.keytab
--principal=kudu/127.26.206.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.206.254:39125
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.206.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200577490656-27451-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:49:44.649947 28084 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:49:44.651189 28084 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:49:44.663200 28093 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:49:44.663160 28091 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:49:44.663246 28090 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:49:44.669342 28084 server_base.cc:1034] running on GCE node
I20260808 14:49:44.670111 28084 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:49:44.671361 28084 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:49:44.672585 28084 hybrid_clock.cc:648] HybridClock initialized: now 1786200584672545 us; error 56 us; skew 500 ppm
I20260808 14:49:44.672930 28084 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:49:44 dist-test-slave-6k22 krb5kdc[28070](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200584, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:49:44.680838 28084 init.cc:377] Logged in from keytab as kudu/127.26.206.254@KRBTEST.COM (short username kudu)
I20260808 14:49:44.682317 28084 webserver.cc:460] Webserver started at http://127.26.206.254:38237/ using document root <none> and password file <none>
I20260808 14:49:44.682948 28084 fs_manager.cc:359] Metadata directory not provided
I20260808 14:49:44.683045 28084 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:49:44.683290 28084 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:49:44.686233 28084 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200577490656-27451-0/minicluster-data/master-0/data/instance:
uuid: "1c4d69bebf7b4e098c929ddd69b836da"
format_stamp: "Formatted at 2026-08-08 14:49:44 on dist-test-slave-6k22"
server_key: "4438654c9dd250a76ecfc97854acec91"
server_key_iv: "a47051be1be9c233faf3d09899ce3b9d"
server_key_version: "encryptionkey@0"
I20260808 14:49:44.686957 28084 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200577490656-27451-0/minicluster-data/master-0/wal/instance:
uuid: "1c4d69bebf7b4e098c929ddd69b836da"
format_stamp: "Formatted at 2026-08-08 14:49:44 on dist-test-slave-6k22"
server_key: "4438654c9dd250a76ecfc97854acec91"
server_key_iv: "a47051be1be9c233faf3d09899ce3b9d"
server_key_version: "encryptionkey@0"
I20260808 14:49:44.691962 28084 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260808 14:49:44.695487 28100 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:49:44.696826 28084 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 14:49:44.696961 28084 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200577490656-27451-0/minicluster-data/master-0/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200577490656-27451-0/minicluster-data/master-0/wal
uuid: "1c4d69bebf7b4e098c929ddd69b836da"
format_stamp: "Formatted at 2026-08-08 14:49:44 on dist-test-slave-6k22"
server_key: "4438654c9dd250a76ecfc97854acec91"
server_key_iv: "a47051be1be9c233faf3d09899ce3b9d"
server_key_version: "encryptionkey@0"
I20260808 14:49:44.697113 28084 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200577490656-27451-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200577490656-27451-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200577490656-27451-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:49:44.717458 28084 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:49:44.721312 28084 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:49:44.721546 28084 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:49:44.740065 28084 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.254:39125
I20260808 14:49:44.740103 28155 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.254:39125 every 8 connection(s)
I20260808 14:49:44.741395 28084 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
I20260808 14:49:44.745009 28156 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:49:44.746868 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 28084
I20260808 14:49:44.747073 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200577490656-27451-0/minicluster-data/master-0/wal/instance
I20260808 14:49:44.747869 27451 external_mini_cluster.cc:1428] Setting key 6e124f66b7f87a8d44e5e3527e86c6bb
I20260808 14:49:44.756767 28156 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1c4d69bebf7b4e098c929ddd69b836da: Bootstrap starting.
I20260808 14:49:44.760615 28156 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1c4d69bebf7b4e098c929ddd69b836da: Neither blocks nor log segments found. Creating new log.
I20260808 14:49:44.761907 28156 log.cc:824] T 00000000000000000000000000000000 P 1c4d69bebf7b4e098c929ddd69b836da: Log is configured to *not* fsync() on all Append() calls
Aug 08 14:49:44 dist-test-slave-6k22 krb5kdc[28070](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200584, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.206.254@KRBTEST.COM
I20260808 14:49:44.764816 28156 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1c4d69bebf7b4e098c929ddd69b836da: No bootstrap required, opened a new log
I20260808 14:49:44.771401 28160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:44.749970 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47606 (local address 127.26.206.254:39125)
0808 14:49:44.750833 (+ 863us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:44.750844 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:44.750883 (+ 39us) server_negotiation.cc:407] Connection header received
0808 14:49:44.752590 (+ 1707us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:44.752612 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:44.752991 (+ 379us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:44.753335 (+ 344us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:44.755211 (+ 1876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:44.756871 (+ 1660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:44.758653 (+ 1782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:44.759349 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:44.759480 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:44.764404 (+ 4924us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:49:44.764413 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:49:44.764426 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:49:44.764464 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:49:44.767492 (+ 3028us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:44.768185 (+ 693us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:44.768193 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:44.768200 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:44.768358 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:44.768719 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:44.768730 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:44.768734 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:44.769207 (+ 473us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:49:44.769532 (+ 325us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:44.770030 (+ 498us) server_negotiation.cc:299] Negotiation successful
0808 14:49:44.770418 (+ 388us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":652,"thread_start_us":402,"threads_started":1}
I20260808 14:49:44.772106 28156 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1c4d69bebf7b4e098c929ddd69b836da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c4d69bebf7b4e098c929ddd69b836da" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 39125 } }
I20260808 14:49:44.772485 28156 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1c4d69bebf7b4e098c929ddd69b836da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:49:44.772691 28156 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1c4d69bebf7b4e098c929ddd69b836da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c4d69bebf7b4e098c929ddd69b836da, State: Initialized, Role: FOLLOWER
I20260808 14:49:44.773304 28156 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1c4d69bebf7b4e098c929ddd69b836da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c4d69bebf7b4e098c929ddd69b836da" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 39125 } }
I20260808 14:49:44.773553 28156 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1c4d69bebf7b4e098c929ddd69b836da [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:49:44.773699 28156 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1c4d69bebf7b4e098c929ddd69b836da [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:49:44.773914 28156 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1c4d69bebf7b4e098c929ddd69b836da [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:49:44.776044 28156 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1c4d69bebf7b4e098c929ddd69b836da [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c4d69bebf7b4e098c929ddd69b836da" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 39125 } }
I20260808 14:49:44.776516 28156 leader_election.cc:302] T 00000000000000000000000000000000 P 1c4d69bebf7b4e098c929ddd69b836da [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1c4d69bebf7b4e098c929ddd69b836da; no voters:
I20260808 14:49:44.777179 28156 leader_election.cc:288] T 00000000000000000000000000000000 P 1c4d69bebf7b4e098c929ddd69b836da [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:49:44.777307 28163 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1c4d69bebf7b4e098c929ddd69b836da [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:49:44.778324 28163 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1c4d69bebf7b4e098c929ddd69b836da [term 1 LEADER]: Becoming Leader. State: Replica: 1c4d69bebf7b4e098c929ddd69b836da, State: Running, Role: LEADER
I20260808 14:49:44.779001 28163 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1c4d69bebf7b4e098c929ddd69b836da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c4d69bebf7b4e098c929ddd69b836da" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 39125 } }
I20260808 14:49:44.779551 28156 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1c4d69bebf7b4e098c929ddd69b836da [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:49:44.782335 28164 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1c4d69bebf7b4e098c929ddd69b836da [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1c4d69bebf7b4e098c929ddd69b836da" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c4d69bebf7b4e098c929ddd69b836da" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 39125 } } }
I20260808 14:49:44.782985 28165 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1c4d69bebf7b4e098c929ddd69b836da [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1c4d69bebf7b4e098c929ddd69b836da. Latest consensus state: current_term: 1 leader_uuid: "1c4d69bebf7b4e098c929ddd69b836da" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c4d69bebf7b4e098c929ddd69b836da" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 39125 } } }
I20260808 14:49:44.783459 28165 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1c4d69bebf7b4e098c929ddd69b836da [sys.catalog]: This master's current role is: LEADER
I20260808 14:49:44.783459 28164 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1c4d69bebf7b4e098c929ddd69b836da [sys.catalog]: This master's current role is: LEADER
I20260808 14:49:44.789264 28179 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260808 14:49:44.789459 28172 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:49:44.793722 28172 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:49:44.801676 28172 catalog_manager.cc:1347] Generated new cluster ID: ec8df57452864f02af7533899de8a4d8
I20260808 14:49:44.801787 28172 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:49:44.809391 28172 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:49:44.811197 28172 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:49:44.822167 28172 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1c4d69bebf7b4e098c929ddd69b836da: Generated new TSK 0
I20260808 14:49:44.823100 28172 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.206.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.206.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.206.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.193.keytab.
Entry for principal kudu/127.26.206.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.193.keytab.
I20260808 14:49:44.877023 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200577490656-27451-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200577490656-27451-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200577490656-27451-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200577490656-27451-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.206.193:0
--local_ip_for_outbound_sockets=127.26.206.193
--webserver_interface=127.26.206.193
--webserver_port=0
--tserver_master_addrs=127.26.206.254:39125
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.193.keytab
--principal=kudu/127.26.206.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.206.212:45029
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:49:45.208250 28185 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:49:45.208552 28185 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:49:45.208701 28185 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:49:45.215821 28185 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:49:45.215961 28185 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:49:45.216130 28185 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.206.193
I20260808 14:49:45.225847 28185 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:45029
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200577490656-27451-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200577490656-27451-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.193.keytab
--principal=kudu/127.26.206.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.206.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200577490656-27451-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.206.193
--webserver_port=0
--tserver_master_addrs=127.26.206.254:39125
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.206.193
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200577490656-27451-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:49:45.227100 28185 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:49:45.228498 28185 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:49:45.241326 28191 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:49:45.241284 28195 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:49:45.241430 28190 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:49:45.242023 28185 server_base.cc:1034] running on GCE node
I20260808 14:49:45.242549 28185 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:49:45.243412 28185 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:49:45.244630 28185 hybrid_clock.cc:648] HybridClock initialized: now 1786200585244586 us; error 61 us; skew 500 ppm
I20260808 14:49:45.244944 28185 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:49:45 dist-test-slave-6k22 krb5kdc[28070](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200585, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:49:45.248015 28185 init.cc:377] Logged in from keytab as kudu/127.26.206.193@KRBTEST.COM (short username kudu)
I20260808 14:49:45.249318 28185 webserver.cc:460] Webserver started at http://127.26.206.193:42125/ using document root <none> and password file <none>
I20260808 14:49:45.249914 28185 fs_manager.cc:359] Metadata directory not provided
I20260808 14:49:45.250022 28185 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:49:45.250288 28185 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:49:45.253079 28185 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200577490656-27451-0/minicluster-data/ts-0/data/instance:
uuid: "dba82e2c9f554dac8c5cb5e2952e1100"
format_stamp: "Formatted at 2026-08-08 14:49:45 on dist-test-slave-6k22"
server_key: "28485585fc00a6472ae413103abdea97"
server_key_iv: "d33ed2cb197b1f1668448ce44e655da6"
server_key_version: "encryptionkey@0"
I20260808 14:49:45.253813 28185 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200577490656-27451-0/minicluster-data/ts-0/wal/instance:
uuid: "dba82e2c9f554dac8c5cb5e2952e1100"
format_stamp: "Formatted at 2026-08-08 14:49:45 on dist-test-slave-6k22"
server_key: "28485585fc00a6472ae413103abdea97"
server_key_iv: "d33ed2cb197b1f1668448ce44e655da6"
server_key_version: "encryptionkey@0"
I20260808 14:49:45.258709 28185 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260808 14:49:45.261960 28202 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:49:45.263201 28185 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 14:49:45.263381 28185 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200577490656-27451-0/minicluster-data/ts-0/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200577490656-27451-0/minicluster-data/ts-0/wal
uuid: "dba82e2c9f554dac8c5cb5e2952e1100"
format_stamp: "Formatted at 2026-08-08 14:49:45 on dist-test-slave-6k22"
server_key: "28485585fc00a6472ae413103abdea97"
server_key_iv: "d33ed2cb197b1f1668448ce44e655da6"
server_key_version: "encryptionkey@0"
I20260808 14:49:45.263638 28185 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200577490656-27451-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200577490656-27451-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200577490656-27451-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:49:45.285810 28185 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:49:45.289767 28185 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:49:45.289995 28185 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:49:45.290879 28185 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:49:45.292177 28185 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:49:45.292253 28185 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:49:45.292352 28185 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:49:45.292394 28185 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:49:45.323829 28185 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.193:32969
I20260808 14:49:45.323911 28329 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.193:32969 every 8 connection(s)
I20260808 14:49:45.325073 28185 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200577490656-27451-0/minicluster-data/ts-0/data/info.pb
I20260808 14:49:45.326550 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 28185
I20260808 14:49:45.326773 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200577490656-27451-0/minicluster-data/ts-0/wal/instance
I20260808 14:49:45.327430 27451 external_mini_cluster.cc:1428] Setting key 02627fafd62a8c6d00ce393a1097c0bd
Aug 08 14:49:45 dist-test-slave-6k22 krb5kdc[28070](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200585, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.193@KRBTEST.COM for kudu/127.26.206.254@KRBTEST.COM
I20260808 14:49:45.346721 28332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:45.327783 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.193:58717 (local address 127.26.206.254:39125)
0808 14:49:45.328243 (+ 460us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:45.328250 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:45.329684 (+ 1434us) server_negotiation.cc:407] Connection header received
0808 14:49:45.331189 (+ 1505us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:45.331194 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:45.331277 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:45.331405 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:45.332923 (+ 1518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:45.333660 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:45.335180 (+ 1520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:45.335654 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:45.335792 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:45.339702 (+ 3910us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:49:45.339709 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:49:45.339715 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:49:45.339759 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:49:45.343436 (+ 3677us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:45.344190 (+ 754us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:45.344196 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:45.344199 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:45.344369 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:45.344794 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:45.344801 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:45.344807 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:45.345217 (+ 410us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:49:45.345389 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:45.346007 (+ 618us) server_negotiation.cc:299] Negotiation successful
0808 14:49:45.346275 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":337,"thread_start_us":230,"threads_started":1}
I20260808 14:49:45.347266 28333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:45.328368 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:39125 (local address 127.26.206.193:58717)
0808 14:49:45.329098 (+ 730us) negotiation.cc:107] Waiting for socket to connect
0808 14:49:45.329146 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0808 14:49:45.330926 (+ 1780us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:49:45.331673 (+ 747us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:49:45.331681 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:49:45.332182 (+ 501us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:49:45.332748 (+ 566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:45.332770 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:45.333830 (+ 1060us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:45.333840 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:45.335033 (+ 1193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:45.335045 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:45.335878 (+ 833us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:45.335887 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:45.336121 (+ 234us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:45.336815 (+ 694us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:49:45.336848 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:49:45.339445 (+ 2597us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:49:45.343644 (+ 4199us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:49:45.343649 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:49:45.343660 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:49:45.344062 (+ 402us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:49:45.344489 (+ 427us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:49:45.344492 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:49:45.344494 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:49:45.344666 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:49:45.345345 (+ 679us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:49:45.345350 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:49:45.345620 (+ 270us) client_negotiation.cc:769] Sending connection context
0808 14:49:45.345836 (+ 216us) client_negotiation.cc:240] Negotiation successful
0808 14:49:45.346189 (+ 353us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":511,"thread_start_us":329,"threads_started":1}
WARNING: no policy specified for kudu/127.26.206.194@KRBTEST.COM; defaulting to no policy
I20260808 14:49:45.348819 28330 heartbeater.cc:347] Connected to a master server at 127.26.206.254:39125
I20260808 14:49:45.349118 28330 heartbeater.cc:464] Registering TS with master...
I20260808 14:49:45.349807 28330 heartbeater.cc:511] Master 127.26.206.254:39125 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.206.194@KRBTEST.COM" created.
I20260808 14:49:45.351946 28117 ts_manager.cc:194] Registered new tserver with Master: dba82e2c9f554dac8c5cb5e2952e1100 (127.26.206.193:32969)
I20260808 14:49:45.353379 28117 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.206.193@KRBTEST.COM'} at 127.26.206.193:58717
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.206.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.194.keytab.
Entry for principal kudu/127.26.206.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.194.keytab.
I20260808 14:49:45.372674 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200577490656-27451-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200577490656-27451-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200577490656-27451-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200577490656-27451-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.206.194:0
--local_ip_for_outbound_sockets=127.26.206.194
--webserver_interface=127.26.206.194
--webserver_port=0
--tserver_master_addrs=127.26.206.254:39125
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.194.keytab
--principal=kudu/127.26.206.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.206.212:45029
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:49:45.690450 28336 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:49:45.690762 28336 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:49:45.690935 28336 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:49:45.697943 28336 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:49:45.698079 28336 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:49:45.698271 28336 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.206.194
I20260808 14:49:45.708021 28336 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:45029
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200577490656-27451-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200577490656-27451-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.194.keytab
--principal=kudu/127.26.206.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.206.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200577490656-27451-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.206.194
--webserver_port=0
--tserver_master_addrs=127.26.206.254:39125
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.206.194
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200577490656-27451-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:49:45.709255 28336 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:49:45.710541 28336 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:49:45.723222 28342 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:49:45.723368 28343 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:49:45.723362 28345 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:49:45.724443 28336 server_base.cc:1034] running on GCE node
I20260808 14:49:45.725124 28336 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:49:45.726203 28336 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:49:45.727442 28336 hybrid_clock.cc:648] HybridClock initialized: now 1786200585727395 us; error 34 us; skew 500 ppm
I20260808 14:49:45.727807 28336 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:49:45 dist-test-slave-6k22 krb5kdc[28070](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200585, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:49:45.731099 28336 init.cc:377] Logged in from keytab as kudu/127.26.206.194@KRBTEST.COM (short username kudu)
I20260808 14:49:45.732738 28336 webserver.cc:460] Webserver started at http://127.26.206.194:44617/ using document root <none> and password file <none>
I20260808 14:49:45.733402 28336 fs_manager.cc:359] Metadata directory not provided
I20260808 14:49:45.733565 28336 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:49:45.733902 28336 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:49:45.736722 28336 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200577490656-27451-0/minicluster-data/ts-1/data/instance:
uuid: "a055b8994af5484f9d43789e96f8da3b"
format_stamp: "Formatted at 2026-08-08 14:49:45 on dist-test-slave-6k22"
server_key: "ae50fb146429fdfbf828b39852d500e9"
server_key_iv: "855d6f09fb2dc076bebb10c560acecb8"
server_key_version: "encryptionkey@0"
I20260808 14:49:45.737486 28336 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200577490656-27451-0/minicluster-data/ts-1/wal/instance:
uuid: "a055b8994af5484f9d43789e96f8da3b"
format_stamp: "Formatted at 2026-08-08 14:49:45 on dist-test-slave-6k22"
server_key: "ae50fb146429fdfbf828b39852d500e9"
server_key_iv: "855d6f09fb2dc076bebb10c560acecb8"
server_key_version: "encryptionkey@0"
I20260808 14:49:45.743395 28336 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.003s
I20260808 14:49:45.747501 28352 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:49:45.749010 28336 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 14:49:45.749172 28336 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200577490656-27451-0/minicluster-data/ts-1/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200577490656-27451-0/minicluster-data/ts-1/wal
uuid: "a055b8994af5484f9d43789e96f8da3b"
format_stamp: "Formatted at 2026-08-08 14:49:45 on dist-test-slave-6k22"
server_key: "ae50fb146429fdfbf828b39852d500e9"
server_key_iv: "855d6f09fb2dc076bebb10c560acecb8"
server_key_version: "encryptionkey@0"
I20260808 14:49:45.749372 28336 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200577490656-27451-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200577490656-27451-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200577490656-27451-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:49:45.770172 28336 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:49:45.773794 28336 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:49:45.774030 28336 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:49:45.774842 28336 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:49:45.776175 28336 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:49:45.776245 28336 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:49:45.776328 28336 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:49:45.776373 28336 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:49:45.810002 28336 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.194:43263
I20260808 14:49:45.810084 28483 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.194:43263 every 8 connection(s)
I20260808 14:49:45.811205 28336 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200577490656-27451-0/minicluster-data/ts-1/data/info.pb
I20260808 14:49:45.820611 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 28336
I20260808 14:49:45.820791 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200577490656-27451-0/minicluster-data/ts-1/wal/instance
I20260808 14:49:45.821241 27451 external_mini_cluster.cc:1428] Setting key 847ad13e4e03d7d1d20299b278ff2ac3
Aug 08 14:49:45 dist-test-slave-6k22 krb5kdc[28070](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200585, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.194@KRBTEST.COM for kudu/127.26.206.254@KRBTEST.COM
I20260808 14:49:45.832612 28332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:45.813976 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.194:38193 (local address 127.26.206.254:39125)
0808 14:49:45.814160 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:45.814165 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:45.815275 (+ 1110us) server_negotiation.cc:407] Connection header received
0808 14:49:45.817182 (+ 1907us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:45.817188 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:45.817282 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:45.817402 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:45.818839 (+ 1437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:45.819625 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:45.821184 (+ 1559us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:45.821677 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:45.821814 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:45.825887 (+ 4073us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:49:45.825892 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:49:45.825895 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:49:45.825927 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:49:45.829475 (+ 3548us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:45.830168 (+ 693us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:45.830176 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:45.830182 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:45.830366 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:45.830920 (+ 554us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:45.830923 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:45.830925 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:45.831176 (+ 251us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:49:45.831299 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:45.832201 (+ 902us) server_negotiation.cc:299] Negotiation successful
0808 14:49:45.832382 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260808 14:49:45.834105 28486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:45.814429 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:39125 (local address 127.26.206.194:38193)
0808 14:49:45.815087 (+ 658us) negotiation.cc:107] Waiting for socket to connect
0808 14:49:45.815124 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0808 14:49:45.816853 (+ 1729us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:49:45.817628 (+ 775us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:49:45.817636 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:49:45.818138 (+ 502us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:49:45.818674 (+ 536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:45.818691 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:45.819788 (+ 1097us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:45.819792 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:45.821042 (+ 1250us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:45.821053 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:45.822094 (+ 1041us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:45.822099 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:45.822391 (+ 292us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:45.823205 (+ 814us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:49:45.823232 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:49:45.825659 (+ 2427us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:49:45.829630 (+ 3971us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:49:45.829636 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:49:45.829647 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:49:45.830045 (+ 398us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:49:45.830520 (+ 475us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:49:45.830527 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:49:45.830533 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:49:45.830799 (+ 266us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:49:45.831305 (+ 506us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:49:45.831315 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:49:45.831819 (+ 504us) client_negotiation.cc:769] Sending connection context
0808 14:49:45.832131 (+ 312us) client_negotiation.cc:240] Negotiation successful
0808 14:49:45.832707 (+ 576us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":451,"thread_start_us":266,"threads_started":1}
I20260808 14:49:45.835600 28484 heartbeater.cc:347] Connected to a master server at 127.26.206.254:39125
I20260808 14:49:45.835922 28484 heartbeater.cc:464] Registering TS with master...
I20260808 14:49:45.836747 28484 heartbeater.cc:511] Master 127.26.206.254:39125 requested a full tablet report, sending...
I20260808 14:49:45.838167 28117 ts_manager.cc:194] Registered new tserver with Master: a055b8994af5484f9d43789e96f8da3b (127.26.206.194:43263)
I20260808 14:49:45.838986 28117 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.206.194@KRBTEST.COM'} at 127.26.206.194:38193
WARNING: no policy specified for kudu/127.26.206.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.206.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.206.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.195.keytab.
Entry for principal kudu/127.26.206.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.195.keytab.
I20260808 14:49:45.867455 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200577490656-27451-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200577490656-27451-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200577490656-27451-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200577490656-27451-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.206.195:0
--local_ip_for_outbound_sockets=127.26.206.195
--webserver_interface=127.26.206.195
--webserver_port=0
--tserver_master_addrs=127.26.206.254:39125
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.195.keytab
--principal=kudu/127.26.206.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.206.212:45029
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:49:46.197665 28490 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:49:46.197942 28490 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:49:46.198105 28490 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:49:46.205729 28490 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:49:46.205843 28490 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:49:46.206065 28490 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.206.195
I20260808 14:49:46.216006 28490 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:45029
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200577490656-27451-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200577490656-27451-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.195.keytab
--principal=kudu/127.26.206.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.206.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200577490656-27451-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.206.195
--webserver_port=0
--tserver_master_addrs=127.26.206.254:39125
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.206.195
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200577490656-27451-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:49:46.217253 28490 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:49:46.218657 28490 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:49:46.232314 28496 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:49:46.232389 28497 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:49:46.232353 28500 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:49:46.233054 28490 server_base.cc:1034] running on GCE node
I20260808 14:49:46.233644 28490 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:49:46.234546 28490 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:49:46.235766 28490 hybrid_clock.cc:648] HybridClock initialized: now 1786200586235726 us; error 55 us; skew 500 ppm
I20260808 14:49:46.236074 28490 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:49:46 dist-test-slave-6k22 krb5kdc[28070](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200586, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:49:46.239348 28490 init.cc:377] Logged in from keytab as kudu/127.26.206.195@KRBTEST.COM (short username kudu)
I20260808 14:49:46.240764 28490 webserver.cc:460] Webserver started at http://127.26.206.195:33835/ using document root <none> and password file <none>
I20260808 14:49:46.241444 28490 fs_manager.cc:359] Metadata directory not provided
I20260808 14:49:46.241592 28490 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:49:46.241901 28490 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:49:46.244829 28490 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200577490656-27451-0/minicluster-data/ts-2/data/instance:
uuid: "b4eb19a6614546fc8a11bf21aa9440a6"
format_stamp: "Formatted at 2026-08-08 14:49:46 on dist-test-slave-6k22"
server_key: "033220bb084ba14d2c97dd188b2cbde9"
server_key_iv: "97b3178a62867ec45bad0c48667e556c"
server_key_version: "encryptionkey@0"
I20260808 14:49:46.245610 28490 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200577490656-27451-0/minicluster-data/ts-2/wal/instance:
uuid: "b4eb19a6614546fc8a11bf21aa9440a6"
format_stamp: "Formatted at 2026-08-08 14:49:46 on dist-test-slave-6k22"
server_key: "033220bb084ba14d2c97dd188b2cbde9"
server_key_iv: "97b3178a62867ec45bad0c48667e556c"
server_key_version: "encryptionkey@0"
I20260808 14:49:46.250530 28490 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.004s
I20260808 14:49:46.254271 28509 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:49:46.255780 28490 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 14:49:46.255947 28490 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200577490656-27451-0/minicluster-data/ts-2/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200577490656-27451-0/minicluster-data/ts-2/wal
uuid: "b4eb19a6614546fc8a11bf21aa9440a6"
format_stamp: "Formatted at 2026-08-08 14:49:46 on dist-test-slave-6k22"
server_key: "033220bb084ba14d2c97dd188b2cbde9"
server_key_iv: "97b3178a62867ec45bad0c48667e556c"
server_key_version: "encryptionkey@0"
I20260808 14:49:46.256139 28490 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200577490656-27451-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200577490656-27451-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200577490656-27451-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:49:46.271420 28490 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:49:46.275209 28490 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:49:46.275493 28490 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:49:46.276503 28490 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:49:46.277768 28490 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:49:46.277899 28490 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:49:46.278052 28490 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:49:46.278126 28490 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:49:46.311456 28490 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.195:36859
I20260808 14:49:46.311545 28647 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.195:36859 every 8 connection(s)
I20260808 14:49:46.312690 28490 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200577490656-27451-0/minicluster-data/ts-2/data/info.pb
I20260808 14:49:46.313876 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 28490
I20260808 14:49:46.314049 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200577490656-27451-0/minicluster-data/ts-2/wal/instance
I20260808 14:49:46.314630 27451 external_mini_cluster.cc:1428] Setting key 29180a9122618b6706bdf732a10697c3
Aug 08 14:49:46 dist-test-slave-6k22 krb5kdc[28070](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200586, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.195@KRBTEST.COM for kudu/127.26.206.254@KRBTEST.COM
I20260808 14:49:46.333808 28332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:46.315534 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.195:41861 (local address 127.26.206.254:39125)
0808 14:49:46.315739 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:46.315746 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:46.317305 (+ 1559us) server_negotiation.cc:407] Connection header received
0808 14:49:46.319352 (+ 2047us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:46.319357 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:46.319450 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:46.319558 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:46.321028 (+ 1470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:46.321768 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:46.323339 (+ 1571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:46.323900 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:46.324038 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:46.327394 (+ 3356us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:49:46.327399 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:49:46.327402 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:49:46.327432 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:49:46.330749 (+ 3317us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:46.331438 (+ 689us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:46.331443 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:46.331447 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:46.331661 (+ 214us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:46.332080 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:46.332086 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:46.332089 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:46.332362 (+ 273us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:49:46.332526 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:46.333206 (+ 680us) server_negotiation.cc:299] Negotiation successful
0808 14:49:46.333466 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260808 14:49:46.334631 28651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:46.316065 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:39125 (local address 127.26.206.195:41861)
0808 14:49:46.317060 (+ 995us) negotiation.cc:107] Waiting for socket to connect
0808 14:49:46.317122 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0808 14:49:46.319097 (+ 1975us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:49:46.319814 (+ 717us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:49:46.319822 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:49:46.320324 (+ 502us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:49:46.320863 (+ 539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:46.320880 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:46.321927 (+ 1047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:46.321932 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:46.323188 (+ 1256us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:46.323200 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:46.324148 (+ 948us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:46.324155 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:46.324395 (+ 240us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:46.325070 (+ 675us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:49:46.325091 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:49:46.327181 (+ 2090us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:49:46.330889 (+ 3708us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:49:46.330897 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:49:46.330909 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:49:46.331307 (+ 398us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:49:46.331778 (+ 471us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:49:46.331782 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:49:46.331786 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:49:46.331966 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:49:46.332517 (+ 551us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:49:46.332524 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:49:46.332834 (+ 310us) client_negotiation.cc:769] Sending connection context
0808 14:49:46.333105 (+ 271us) client_negotiation.cc:240] Negotiation successful
0808 14:49:46.333608 (+ 503us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":653,"thread_start_us":354,"threads_started":1}
I20260808 14:49:46.336002 28648 heartbeater.cc:347] Connected to a master server at 127.26.206.254:39125
I20260808 14:49:46.336299 28648 heartbeater.cc:464] Registering TS with master...
I20260808 14:49:46.336989 28648 heartbeater.cc:511] Master 127.26.206.254:39125 requested a full tablet report, sending...
I20260808 14:49:46.338336 28117 ts_manager.cc:194] Registered new tserver with Master: b4eb19a6614546fc8a11bf21aa9440a6 (127.26.206.195:36859)
I20260808 14:49:46.339150 28117 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.206.195@KRBTEST.COM'} at 127.26.206.195:41861
I20260808 14:49:46.342324 27451 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 14:49:46.356539 28330 heartbeater.cc:503] Master 127.26.206.254:39125 was elected leader, sending a full tablet report...
I20260808 14:49:46.362178 28332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:46.349350 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47620 (local address 127.26.206.254:39125)
0808 14:49:46.349508 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:46.349513 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:46.350113 (+ 600us) server_negotiation.cc:407] Connection header received
0808 14:49:46.350244 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:46.350248 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:46.350314 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:46.350392 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:46.351907 (+ 1515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:46.352586 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:46.353854 (+ 1268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:46.354301 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:46.354419 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:46.356740 (+ 2321us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:49:46.356746 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:49:46.356750 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:49:46.356784 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:49:46.359792 (+ 3008us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:46.360475 (+ 683us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:46.360479 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:46.360481 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:46.360601 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:46.360930 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:46.360933 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:46.360935 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:46.361253 (+ 318us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:49:46.361453 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:46.361803 (+ 350us) server_negotiation.cc:299] Negotiation successful
0808 14:49:46.361958 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260808 14:49:46.370704 28117 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47620:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:49:46.378422 28117 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:49:46.415515 28663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:46.393601 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35506 (local address 127.26.206.194:43263)
0808 14:49:46.407120 (+ 13519us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:46.407128 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:46.407155 (+ 27us) server_negotiation.cc:407] Connection header received
0808 14:49:46.407261 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:46.407270 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:46.407522 (+ 252us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:46.408536 (+ 1014us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:49:46.409502 (+ 966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:46.410954 (+ 1452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:46.413364 (+ 2410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:46.414306 (+ 942us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:46.414485 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:46.414676 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:46.414979 (+ 303us) server_negotiation.cc:299] Negotiation successful
0808 14:49:46.415144 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13341,"thread_start_us":13415,"threads_started":1}
I20260808 14:49:46.415688 28662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:46.393304 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.194:43263 (local address 127.0.0.1:35506)
0808 14:49:46.394064 (+ 760us) negotiation.cc:107] Waiting for socket to connect
0808 14:49:46.394106 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 14:49:46.394323 (+ 217us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:49:46.407862 (+ 13539us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:49:46.407870 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:49:46.407915 (+ 45us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:49:46.408558 (+ 643us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:46.408571 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:46.411130 (+ 2559us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:46.411136 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:46.413221 (+ 2085us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:46.413231 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:46.414515 (+ 1284us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:46.414523 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:46.414715 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:46.414762 (+ 47us) client_negotiation.cc:769] Sending connection context
0808 14:49:46.414927 (+ 165us) client_negotiation.cc:240] Negotiation successful
0808 14:49:46.415120 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":523,"mutex_wait_us":1,"thread_start_us":356,"threads_started":1}
I20260808 14:49:46.416080 28664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:46.393913 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.193:32969 (local address 127.0.0.1:36818)
0808 14:49:46.406772 (+ 12859us) negotiation.cc:107] Waiting for socket to connect
0808 14:49:46.406797 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0808 14:49:46.406942 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:49:46.407802 (+ 860us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:49:46.407811 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:49:46.407842 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:49:46.408292 (+ 450us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:46.408305 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:46.410104 (+ 1799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:46.410108 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:46.412807 (+ 2699us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:46.412822 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:46.414857 (+ 2035us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:46.414863 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:46.415032 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:46.415063 (+ 31us) client_negotiation.cc:769] Sending connection context
0808 14:49:46.415151 (+ 88us) client_negotiation.cc:240] Negotiation successful
0808 14:49:46.415309 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12710,"mutex_wait_us":85,"thread_start_us":12553,"threads_started":1}
I20260808 14:49:46.417008 28666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:46.394827 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36818 (local address 127.26.206.193:32969)
0808 14:49:46.405629 (+ 10802us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:46.405643 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:46.406891 (+ 1248us) server_negotiation.cc:407] Connection header received
0808 14:49:46.407114 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:46.407126 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:46.407440 (+ 314us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:46.407819 (+ 379us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:49:46.408464 (+ 645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:46.409936 (+ 1472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:46.412980 (+ 3044us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:46.414460 (+ 1480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:46.414647 (+ 187us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:46.414809 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:46.416484 (+ 1675us) server_negotiation.cc:299] Negotiation successful
0808 14:49:46.416648 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10561,"thread_start_us":10339,"threads_started":1}
I20260808 14:49:46.417742 28665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:46.394476 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.195:36859 (local address 127.0.0.1:34908)
0808 14:49:46.409152 (+ 14676us) negotiation.cc:107] Waiting for socket to connect
0808 14:49:46.409168 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 14:49:46.409309 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:49:46.410060 (+ 751us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:49:46.410065 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:49:46.410094 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:49:46.410566 (+ 472us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:46.410578 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:46.412167 (+ 1589us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:46.412178 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:46.414202 (+ 2024us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:46.414217 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:46.417043 (+ 2826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:46.417048 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:46.417262 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:46.417313 (+ 51us) client_negotiation.cc:769] Sending connection context
0808 14:49:46.417390 (+ 77us) client_negotiation.cc:240] Negotiation successful
0808 14:49:46.417472 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14547,"mutex_wait_us":39,"thread_start_us":14422,"threads_started":1}
I20260808 14:49:46.419147 28667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:46.395042 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34908 (local address 127.26.206.195:36859)
0808 14:49:46.407765 (+ 12723us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:46.407773 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:46.409270 (+ 1497us) server_negotiation.cc:407] Connection header received
0808 14:49:46.409499 (+ 229us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:46.409506 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:46.409754 (+ 248us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:46.410053 (+ 299us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:49:46.410773 (+ 720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:46.412008 (+ 1235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:46.414377 (+ 2369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:46.416824 (+ 2447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:46.418347 (+ 1523us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:46.418560 (+ 213us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:46.418653 (+ 93us) server_negotiation.cc:299] Negotiation successful
0808 14:49:46.418823 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12493,"thread_start_us":12330,"threads_started":1}
I20260808 14:49:46.420521 28407 tablet_service.cc:1467] Processing CreateTablet for tablet 13f77fc1f5f74a4799a29d600b92c2e5 (DEFAULT_TABLE table=test-table [id=c2c40c62d8aa425ea444e0d7cc22ac44]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:49:46.420568 28256 tablet_service.cc:1467] Processing CreateTablet for tablet 13f77fc1f5f74a4799a29d600b92c2e5 (DEFAULT_TABLE table=test-table [id=c2c40c62d8aa425ea444e0d7cc22ac44]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:49:46.422113 28256 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 13f77fc1f5f74a4799a29d600b92c2e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:49:46.422559 28407 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 13f77fc1f5f74a4799a29d600b92c2e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:49:46.422757 28570 tablet_service.cc:1467] Processing CreateTablet for tablet 13f77fc1f5f74a4799a29d600b92c2e5 (DEFAULT_TABLE table=test-table [id=c2c40c62d8aa425ea444e0d7cc22ac44]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:49:46.424130 28570 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 13f77fc1f5f74a4799a29d600b92c2e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:49:46.434510 28669 tablet_bootstrap.cc:492] T 13f77fc1f5f74a4799a29d600b92c2e5 P a055b8994af5484f9d43789e96f8da3b: Bootstrap starting.
I20260808 14:49:46.436818 28670 tablet_bootstrap.cc:492] T 13f77fc1f5f74a4799a29d600b92c2e5 P dba82e2c9f554dac8c5cb5e2952e1100: Bootstrap starting.
I20260808 14:49:46.438761 28669 tablet_bootstrap.cc:654] T 13f77fc1f5f74a4799a29d600b92c2e5 P a055b8994af5484f9d43789e96f8da3b: Neither blocks nor log segments found. Creating new log.
I20260808 14:49:46.440102 28669 log.cc:824] T 13f77fc1f5f74a4799a29d600b92c2e5 P a055b8994af5484f9d43789e96f8da3b: Log is configured to *not* fsync() on all Append() calls
I20260808 14:49:46.440622 28670 tablet_bootstrap.cc:654] T 13f77fc1f5f74a4799a29d600b92c2e5 P dba82e2c9f554dac8c5cb5e2952e1100: Neither blocks nor log segments found. Creating new log.
I20260808 14:49:46.442781 28670 log.cc:824] T 13f77fc1f5f74a4799a29d600b92c2e5 P dba82e2c9f554dac8c5cb5e2952e1100: Log is configured to *not* fsync() on all Append() calls
I20260808 14:49:46.444237 28672 tablet_bootstrap.cc:492] T 13f77fc1f5f74a4799a29d600b92c2e5 P b4eb19a6614546fc8a11bf21aa9440a6: Bootstrap starting.
I20260808 14:49:46.446255 28670 tablet_bootstrap.cc:492] T 13f77fc1f5f74a4799a29d600b92c2e5 P dba82e2c9f554dac8c5cb5e2952e1100: No bootstrap required, opened a new log
I20260808 14:49:46.446538 28670 ts_tablet_manager.cc:1397] T 13f77fc1f5f74a4799a29d600b92c2e5 P dba82e2c9f554dac8c5cb5e2952e1100: Time spent bootstrapping tablet: real 0.010s user 0.004s sys 0.004s
I20260808 14:49:46.447173 28669 tablet_bootstrap.cc:492] T 13f77fc1f5f74a4799a29d600b92c2e5 P a055b8994af5484f9d43789e96f8da3b: No bootstrap required, opened a new log
I20260808 14:49:46.447427 28669 ts_tablet_manager.cc:1397] T 13f77fc1f5f74a4799a29d600b92c2e5 P a055b8994af5484f9d43789e96f8da3b: Time spent bootstrapping tablet: real 0.013s user 0.006s sys 0.003s
I20260808 14:49:46.447446 28672 tablet_bootstrap.cc:654] T 13f77fc1f5f74a4799a29d600b92c2e5 P b4eb19a6614546fc8a11bf21aa9440a6: Neither blocks nor log segments found. Creating new log.
I20260808 14:49:46.448385 28672 log.cc:824] T 13f77fc1f5f74a4799a29d600b92c2e5 P b4eb19a6614546fc8a11bf21aa9440a6: Log is configured to *not* fsync() on all Append() calls
I20260808 14:49:46.450733 28672 tablet_bootstrap.cc:492] T 13f77fc1f5f74a4799a29d600b92c2e5 P b4eb19a6614546fc8a11bf21aa9440a6: No bootstrap required, opened a new log
I20260808 14:49:46.450975 28672 ts_tablet_manager.cc:1397] T 13f77fc1f5f74a4799a29d600b92c2e5 P b4eb19a6614546fc8a11bf21aa9440a6: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260808 14:49:46.457598 28670 raft_consensus.cc:348] T 13f77fc1f5f74a4799a29d600b92c2e5 P dba82e2c9f554dac8c5cb5e2952e1100 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a055b8994af5484f9d43789e96f8da3b" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 43263 } } peers { permanent_uuid: "b4eb19a6614546fc8a11bf21aa9440a6" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 36859 } } peers { permanent_uuid: "dba82e2c9f554dac8c5cb5e2952e1100" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 32969 } }
I20260808 14:49:46.458048 28670 raft_consensus.cc:374] T 13f77fc1f5f74a4799a29d600b92c2e5 P dba82e2c9f554dac8c5cb5e2952e1100 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:49:46.458206 28670 raft_consensus.cc:729] T 13f77fc1f5f74a4799a29d600b92c2e5 P dba82e2c9f554dac8c5cb5e2952e1100 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dba82e2c9f554dac8c5cb5e2952e1100, State: Initialized, Role: FOLLOWER
I20260808 14:49:46.457947 28669 raft_consensus.cc:348] T 13f77fc1f5f74a4799a29d600b92c2e5 P a055b8994af5484f9d43789e96f8da3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a055b8994af5484f9d43789e96f8da3b" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 43263 } } peers { permanent_uuid: "b4eb19a6614546fc8a11bf21aa9440a6" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 36859 } } peers { permanent_uuid: "dba82e2c9f554dac8c5cb5e2952e1100" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 32969 } }
I20260808 14:49:46.458377 28669 raft_consensus.cc:374] T 13f77fc1f5f74a4799a29d600b92c2e5 P a055b8994af5484f9d43789e96f8da3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:49:46.458509 28669 raft_consensus.cc:729] T 13f77fc1f5f74a4799a29d600b92c2e5 P a055b8994af5484f9d43789e96f8da3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a055b8994af5484f9d43789e96f8da3b, State: Initialized, Role: FOLLOWER
I20260808 14:49:46.459043 28669 consensus_queue.cc:260] T 13f77fc1f5f74a4799a29d600b92c2e5 P a055b8994af5484f9d43789e96f8da3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a055b8994af5484f9d43789e96f8da3b" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 43263 } } peers { permanent_uuid: "b4eb19a6614546fc8a11bf21aa9440a6" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 36859 } } peers { permanent_uuid: "dba82e2c9f554dac8c5cb5e2952e1100" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 32969 } }
I20260808 14:49:46.458973 28670 consensus_queue.cc:260] T 13f77fc1f5f74a4799a29d600b92c2e5 P dba82e2c9f554dac8c5cb5e2952e1100 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a055b8994af5484f9d43789e96f8da3b" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 43263 } } peers { permanent_uuid: "b4eb19a6614546fc8a11bf21aa9440a6" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 36859 } } peers { permanent_uuid: "dba82e2c9f554dac8c5cb5e2952e1100" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 32969 } }
I20260808 14:49:46.459275 28672 raft_consensus.cc:348] T 13f77fc1f5f74a4799a29d600b92c2e5 P b4eb19a6614546fc8a11bf21aa9440a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a055b8994af5484f9d43789e96f8da3b" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 43263 } } peers { permanent_uuid: "b4eb19a6614546fc8a11bf21aa9440a6" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 36859 } } peers { permanent_uuid: "dba82e2c9f554dac8c5cb5e2952e1100" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 32969 } }
I20260808 14:49:46.459815 28672 raft_consensus.cc:374] T 13f77fc1f5f74a4799a29d600b92c2e5 P b4eb19a6614546fc8a11bf21aa9440a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:49:46.459964 28672 raft_consensus.cc:729] T 13f77fc1f5f74a4799a29d600b92c2e5 P b4eb19a6614546fc8a11bf21aa9440a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4eb19a6614546fc8a11bf21aa9440a6, State: Initialized, Role: FOLLOWER
I20260808 14:49:46.461051 28484 heartbeater.cc:503] Master 127.26.206.254:39125 was elected leader, sending a full tablet report...
I20260808 14:49:46.461048 28669 ts_tablet_manager.cc:1428] T 13f77fc1f5f74a4799a29d600b92c2e5 P a055b8994af5484f9d43789e96f8da3b: Time spent starting tablet: real 0.013s user 0.010s sys 0.005s
I20260808 14:49:46.461612 28670 ts_tablet_manager.cc:1428] T 13f77fc1f5f74a4799a29d600b92c2e5 P dba82e2c9f554dac8c5cb5e2952e1100: Time spent starting tablet: real 0.015s user 0.010s sys 0.004s
I20260808 14:49:46.461926 28672 consensus_queue.cc:260] T 13f77fc1f5f74a4799a29d600b92c2e5 P b4eb19a6614546fc8a11bf21aa9440a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a055b8994af5484f9d43789e96f8da3b" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 43263 } } peers { permanent_uuid: "b4eb19a6614546fc8a11bf21aa9440a6" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 36859 } } peers { permanent_uuid: "dba82e2c9f554dac8c5cb5e2952e1100" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 32969 } }
I20260808 14:49:46.462929 28648 heartbeater.cc:503] Master 127.26.206.254:39125 was elected leader, sending a full tablet report...
I20260808 14:49:46.463815 28672 ts_tablet_manager.cc:1428] T 13f77fc1f5f74a4799a29d600b92c2e5 P b4eb19a6614546fc8a11bf21aa9440a6: Time spent starting tablet: real 0.013s user 0.013s sys 0.000s
I20260808 14:49:46.533538 28678 raft_consensus.cc:482] T 13f77fc1f5f74a4799a29d600b92c2e5 P dba82e2c9f554dac8c5cb5e2952e1100 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:49:46.533826 28678 raft_consensus.cc:504] T 13f77fc1f5f74a4799a29d600b92c2e5 P dba82e2c9f554dac8c5cb5e2952e1100 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a055b8994af5484f9d43789e96f8da3b" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 43263 } } peers { permanent_uuid: "b4eb19a6614546fc8a11bf21aa9440a6" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 36859 } } peers { permanent_uuid: "dba82e2c9f554dac8c5cb5e2952e1100" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 32969 } }
I20260808 14:49:46.535837 28678 leader_election.cc:288] T 13f77fc1f5f74a4799a29d600b92c2e5 P dba82e2c9f554dac8c5cb5e2952e1100 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a055b8994af5484f9d43789e96f8da3b (127.26.206.194:43263), b4eb19a6614546fc8a11bf21aa9440a6 (127.26.206.195:36859)
I20260808 14:49:46.543601 28663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:46.536296 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.193:59693 (local address 127.26.206.194:43263)
0808 14:49:46.536559 (+ 263us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:46.536568 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:46.537007 (+ 439us) server_negotiation.cc:407] Connection header received
0808 14:49:46.537273 (+ 266us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:46.537292 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:46.537388 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:46.537485 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:49:46.538201 (+ 716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:46.539192 (+ 991us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:46.541616 (+ 2424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:46.542713 (+ 1097us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:46.542868 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:46.542943 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:46.543169 (+ 226us) server_negotiation.cc:299] Negotiation successful
0808 14:49:46.543316 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260808 14:49:46.543634 28680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:46.536250 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.194:43263 (local address 127.26.206.193:59693)
0808 14:49:46.536895 (+ 645us) negotiation.cc:107] Waiting for socket to connect
0808 14:49:46.536910 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 14:49:46.537086 (+ 176us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:49:46.537547 (+ 461us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:49:46.537551 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:49:46.537580 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:49:46.538044 (+ 464us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:46.538059 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:46.539327 (+ 1268us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:46.539330 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:46.541453 (+ 2123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:46.541469 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:46.542899 (+ 1430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:46.542903 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:46.543015 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:46.543038 (+ 23us) client_negotiation.cc:769] Sending connection context
0808 14:49:46.543110 (+ 72us) client_negotiation.cc:240] Negotiation successful
0808 14:49:46.543232 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":541,"thread_start_us":365,"threads_started":1}
I20260808 14:49:46.544396 28667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:46.537198 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.193:58111 (local address 127.26.206.195:36859)
0808 14:49:46.537441 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:46.537447 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:46.537944 (+ 497us) server_negotiation.cc:407] Connection header received
0808 14:49:46.538153 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:46.538157 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:46.538231 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:46.538334 (+ 103us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:49:46.538845 (+ 511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:46.539771 (+ 926us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:46.542018 (+ 2247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:46.543203 (+ 1185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:46.543339 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:46.543403 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:46.544006 (+ 603us) server_negotiation.cc:299] Negotiation successful
0808 14:49:46.544139 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94}
I20260808 14:49:46.545208 28681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:46.537041 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.195:36859 (local address 127.26.206.193:58111)
0808 14:49:46.537695 (+ 654us) negotiation.cc:107] Waiting for socket to connect
0808 14:49:46.537714 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 14:49:46.537995 (+ 281us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:49:46.538355 (+ 360us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:49:46.538358 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:49:46.538377 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:49:46.538671 (+ 294us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:46.538678 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:46.539915 (+ 1237us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:46.539921 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:46.541872 (+ 1951us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:46.541882 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:46.543589 (+ 1707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:46.543597 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:46.543812 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:46.543840 (+ 28us) client_negotiation.cc:769] Sending connection context
0808 14:49:46.544617 (+ 777us) client_negotiation.cc:240] Negotiation successful
0808 14:49:46.544754 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":511,"mutex_wait_us":1,"thread_start_us":293,"threads_started":1}
I20260808 14:49:46.545109 28431 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "13f77fc1f5f74a4799a29d600b92c2e5" candidate_uuid: "dba82e2c9f554dac8c5cb5e2952e1100" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a055b8994af5484f9d43789e96f8da3b" is_pre_election: true
I20260808 14:49:46.545946 28431 raft_consensus.cc:2454] T 13f77fc1f5f74a4799a29d600b92c2e5 P a055b8994af5484f9d43789e96f8da3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dba82e2c9f554dac8c5cb5e2952e1100 in term 0.
I20260808 14:49:46.546278 28593 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "13f77fc1f5f74a4799a29d600b92c2e5" candidate_uuid: "dba82e2c9f554dac8c5cb5e2952e1100" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4eb19a6614546fc8a11bf21aa9440a6" is_pre_election: true
I20260808 14:49:46.546818 28593 raft_consensus.cc:2454] T 13f77fc1f5f74a4799a29d600b92c2e5 P b4eb19a6614546fc8a11bf21aa9440a6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dba82e2c9f554dac8c5cb5e2952e1100 in term 0.
I20260808 14:49:46.546857 28204 leader_election.cc:302] T 13f77fc1f5f74a4799a29d600b92c2e5 P dba82e2c9f554dac8c5cb5e2952e1100 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a055b8994af5484f9d43789e96f8da3b, dba82e2c9f554dac8c5cb5e2952e1100; no voters:
I20260808 14:49:46.547235 28678 raft_consensus.cc:2781] T 13f77fc1f5f74a4799a29d600b92c2e5 P dba82e2c9f554dac8c5cb5e2952e1100 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:49:46.547397 28678 raft_consensus.cc:482] T 13f77fc1f5f74a4799a29d600b92c2e5 P dba82e2c9f554dac8c5cb5e2952e1100 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:49:46.547518 28678 raft_consensus.cc:3037] T 13f77fc1f5f74a4799a29d600b92c2e5 P dba82e2c9f554dac8c5cb5e2952e1100 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:49:46.549753 28678 raft_consensus.cc:504] T 13f77fc1f5f74a4799a29d600b92c2e5 P dba82e2c9f554dac8c5cb5e2952e1100 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a055b8994af5484f9d43789e96f8da3b" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 43263 } } peers { permanent_uuid: "b4eb19a6614546fc8a11bf21aa9440a6" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 36859 } } peers { permanent_uuid: "dba82e2c9f554dac8c5cb5e2952e1100" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 32969 } }
I20260808 14:49:46.550311 28678 leader_election.cc:288] T 13f77fc1f5f74a4799a29d600b92c2e5 P dba82e2c9f554dac8c5cb5e2952e1100 [CANDIDATE]: Term 1 election: Requested vote from peers a055b8994af5484f9d43789e96f8da3b (127.26.206.194:43263), b4eb19a6614546fc8a11bf21aa9440a6 (127.26.206.195:36859)
I20260808 14:49:46.550758 28431 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "13f77fc1f5f74a4799a29d600b92c2e5" candidate_uuid: "dba82e2c9f554dac8c5cb5e2952e1100" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a055b8994af5484f9d43789e96f8da3b"
I20260808 14:49:46.550848 28593 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "13f77fc1f5f74a4799a29d600b92c2e5" candidate_uuid: "dba82e2c9f554dac8c5cb5e2952e1100" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4eb19a6614546fc8a11bf21aa9440a6"
I20260808 14:49:46.550968 28431 raft_consensus.cc:3037] T 13f77fc1f5f74a4799a29d600b92c2e5 P a055b8994af5484f9d43789e96f8da3b [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:49:46.551106 28593 raft_consensus.cc:3037] T 13f77fc1f5f74a4799a29d600b92c2e5 P b4eb19a6614546fc8a11bf21aa9440a6 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:49:46.553277 28431 raft_consensus.cc:2454] T 13f77fc1f5f74a4799a29d600b92c2e5 P a055b8994af5484f9d43789e96f8da3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dba82e2c9f554dac8c5cb5e2952e1100 in term 1.
I20260808 14:49:46.553515 28593 raft_consensus.cc:2454] T 13f77fc1f5f74a4799a29d600b92c2e5 P b4eb19a6614546fc8a11bf21aa9440a6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dba82e2c9f554dac8c5cb5e2952e1100 in term 1.
I20260808 14:49:46.553709 28204 leader_election.cc:302] T 13f77fc1f5f74a4799a29d600b92c2e5 P dba82e2c9f554dac8c5cb5e2952e1100 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a055b8994af5484f9d43789e96f8da3b, dba82e2c9f554dac8c5cb5e2952e1100; no voters:
I20260808 14:49:46.554119 28678 raft_consensus.cc:2781] T 13f77fc1f5f74a4799a29d600b92c2e5 P dba82e2c9f554dac8c5cb5e2952e1100 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:49:46.554612 28678 raft_consensus.cc:686] T 13f77fc1f5f74a4799a29d600b92c2e5 P dba82e2c9f554dac8c5cb5e2952e1100 [term 1 LEADER]: Becoming Leader. State: Replica: dba82e2c9f554dac8c5cb5e2952e1100, State: Running, Role: LEADER
I20260808 14:49:46.555208 28678 consensus_queue.cc:237] T 13f77fc1f5f74a4799a29d600b92c2e5 P dba82e2c9f554dac8c5cb5e2952e1100 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a055b8994af5484f9d43789e96f8da3b" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 43263 } } peers { permanent_uuid: "b4eb19a6614546fc8a11bf21aa9440a6" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 36859 } } peers { permanent_uuid: "dba82e2c9f554dac8c5cb5e2952e1100" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 32969 } }
W20260808 14:49:46.563601 28485 tablet.cc:2369] T 13f77fc1f5f74a4799a29d600b92c2e5 P a055b8994af5484f9d43789e96f8da3b: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 14:49:46.564405 28649 tablet.cc:2369] T 13f77fc1f5f74a4799a29d600b92c2e5 P b4eb19a6614546fc8a11bf21aa9440a6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:49:46.563900 28116 catalog_manager.cc:5495] T 13f77fc1f5f74a4799a29d600b92c2e5 P dba82e2c9f554dac8c5cb5e2952e1100 reported cstate change: term changed from 0 to 1, leader changed from <none> to dba82e2c9f554dac8c5cb5e2952e1100 (127.26.206.193). New cstate: current_term: 1 leader_uuid: "dba82e2c9f554dac8c5cb5e2952e1100" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a055b8994af5484f9d43789e96f8da3b" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 43263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4eb19a6614546fc8a11bf21aa9440a6" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 36859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dba82e2c9f554dac8c5cb5e2952e1100" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 32969 } health_report { overall_health: HEALTHY } } }
W20260808 14:49:46.577335 28331 tablet.cc:2369] T 13f77fc1f5f74a4799a29d600b92c2e5 P dba82e2c9f554dac8c5cb5e2952e1100: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 08 14:49:46 dist-test-slave-6k22 krb5kdc[28070](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200584, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.206.193@KRBTEST.COM
I20260808 14:49:46.597827 28666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:46.583606 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36822 (local address 127.26.206.193:32969)
0808 14:49:46.583830 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:46.583838 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:46.584425 (+ 587us) server_negotiation.cc:407] Connection header received
0808 14:49:46.584558 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:46.584561 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:46.584621 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:46.584695 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:46.586267 (+ 1572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:46.586968 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:46.588202 (+ 1234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:46.588585 (+ 383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:46.588675 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:46.592536 (+ 3861us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:49:46.592548 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:49:46.592561 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:49:46.592596 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:49:46.595250 (+ 2654us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:46.595908 (+ 658us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:46.595915 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:46.595917 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:46.596077 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:46.596406 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:46.596409 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:46.596423 (+ 14us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:46.596765 (+ 342us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:49:46.596991 (+ 226us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:46.597226 (+ 235us) server_negotiation.cc:299] Negotiation successful
0808 14:49:46.597439 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
Aug 08 14:49:46 dist-test-slave-6k22 krb5kdc[28070](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200586, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 14:49:46 dist-test-slave-6k22 krb5kdc[28070](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200586, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.26.206.193@KRBTEST.COM
I20260808 14:49:46.650076 28666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:46.636737 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36836 (local address 127.26.206.193:32969)
0808 14:49:46.637010 (+ 273us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:46.637016 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:46.637220 (+ 204us) server_negotiation.cc:407] Connection header received
0808 14:49:46.637383 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:46.637386 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:46.637454 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:46.637541 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:46.639081 (+ 1540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:46.639865 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:46.641121 (+ 1256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:46.641518 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:46.641603 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:46.645554 (+ 3951us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:49:46.645558 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:49:46.645562 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:49:46.645594 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:49:46.647993 (+ 2399us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:46.648555 (+ 562us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:46.648558 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:46.648560 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:46.648702 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:46.649035 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:46.649038 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:46.649040 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:46.649297 (+ 257us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:49:46.649505 (+ 208us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:46.649678 (+ 173us) server_negotiation.cc:299] Negotiation successful
0808 14:49:46.649839 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":113}
Aug 08 14:49:46 dist-test-slave-6k22 krb5kdc[28070](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200586, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 14:49:46 dist-test-slave-6k22 krb5kdc[28070](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200586, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.206.193@KRBTEST.COM
I20260808 14:49:46.700286 28666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:46.687252 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36840 (local address 127.26.206.193:32969)
0808 14:49:46.687490 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:46.687496 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:46.687842 (+ 346us) server_negotiation.cc:407] Connection header received
0808 14:49:46.688005 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:46.688008 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:46.688077 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:46.688163 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:46.689483 (+ 1320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:46.690193 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:46.691405 (+ 1212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:46.691867 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:46.691960 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:46.695792 (+ 3832us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:49:46.695797 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:49:46.695800 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:49:46.695829 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:49:46.698102 (+ 2273us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:46.698687 (+ 585us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:46.698690 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:46.698692 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:46.698813 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:46.699104 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:46.699107 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:46.699109 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:46.699363 (+ 254us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:49:46.699627 (+ 264us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:46.699803 (+ 176us) server_negotiation.cc:299] Negotiation successful
0808 14:49:46.699955 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
W20260808 14:49:46.702442 28233 tablet_service.cc:2908] Rejecting scan request for tablet 13f77fc1f5f74a4799a29d600b92c2e5: Uninitialized: clean time has not yet been initialized
I20260808 14:49:46.706174 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 28185
I20260808 14:49:46.717976 28666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:46.706980 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36842 (local address 127.26.206.193:32969)
0808 14:49:46.707166 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:46.707174 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:46.707458 (+ 284us) server_negotiation.cc:407] Connection header received
0808 14:49:46.707632 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:46.707635 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:46.707689 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:46.707763 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:46.708797 (+ 1034us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:46.709445 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:46.710553 (+ 1108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:46.710954 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:46.711038 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:46.713092 (+ 2054us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:49:46.713096 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:49:46.713100 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:49:46.713127 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:49:46.715822 (+ 2695us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:46.716372 (+ 550us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:46.716376 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:46.716378 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:46.716498 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:46.716798 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:46.716801 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:46.716803 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:46.717058 (+ 255us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:49:46.717223 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:46.717452 (+ 229us) server_negotiation.cc:299] Negotiation successful
0808 14:49:46.717618 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260808 14:49:46.718617 28325 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:49:46.822799 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 28185
I20260808 14:49:46.844470 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 28336
Aug 08 14:49:46 dist-test-slave-6k22 krb5kdc[28070](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200586, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.206.194@KRBTEST.COM
I20260808 14:49:46.859376 28663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:46.845337 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35514 (local address 127.26.206.194:43263)
0808 14:49:46.845531 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:46.845540 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:46.845560 (+ 20us) server_negotiation.cc:407] Connection header received
0808 14:49:46.845623 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:46.845628 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:46.845694 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:46.845817 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:46.847027 (+ 1210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:46.847855 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:46.849108 (+ 1253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:46.849504 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:46.849634 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:46.853933 (+ 4299us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:49:46.853952 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:49:46.853965 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:49:46.853994 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:49:46.856713 (+ 2719us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:46.857362 (+ 649us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:46.857376 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:46.857378 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:46.857497 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:46.857844 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:46.857851 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:46.857854 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:46.858219 (+ 365us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:49:46.858577 (+ 358us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:46.858800 (+ 223us) server_negotiation.cc:299] Negotiation successful
0808 14:49:46.859012 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260808 14:49:46.860105 28477 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:49:46.947930 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 28336
I20260808 14:49:46.968933 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 28490
Aug 08 14:49:46 dist-test-slave-6k22 krb5kdc[28070](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200586, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.206.195@KRBTEST.COM
I20260808 14:49:46.984725 28667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:46.969717 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34914 (local address 127.26.206.195:36859)
0808 14:49:46.969877 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:46.969882 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:46.969977 (+ 95us) server_negotiation.cc:407] Connection header received
0808 14:49:46.970141 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:46.970145 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:46.970206 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:46.970309 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:46.971763 (+ 1454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:46.972488 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:46.973931 (+ 1443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:46.974299 (+ 368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:46.974387 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:46.979139 (+ 4752us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:49:46.979154 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:49:46.979170 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:49:46.979208 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:49:46.982147 (+ 2939us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:46.982792 (+ 645us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:46.982799 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:46.982801 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:46.982932 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:46.983311 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:46.983314 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:46.983316 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:46.983711 (+ 395us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:49:46.983918 (+ 207us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:46.984319 (+ 401us) server_negotiation.cc:299] Negotiation successful
0808 14:49:46.984471 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260808 14:49:46.985414 28643 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:49:47.073823 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 28490
I20260808 14:49:47.094385 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 28084
I20260808 14:49:47.095634 28150 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:49:47.204469 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 28084
2026-08-08T14:49:47Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (5488 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200577490656-27451-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:49:47 dist-test-slave-6k22 krb5kdc[28704](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:49:47 dist-test-slave-6k22 krb5kdc[28704](info): set up 2 sockets
Aug 08 14:49:47 dist-test-slave-6k22 krb5kdc[28704](info): commencing operation
krb5kdc: starting...
W20260808 14:49:48.341295 27451 mini_kdc.cc:121] Time spent starting KDC: real 1.088s user 0.003s sys 0.018s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200577490656-27451-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200577490656-27451-0/krb5kdc/test-user.keytab.
Aug 08 14:49:48 dist-test-slave-6k22 krb5kdc[28704](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200588, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:49:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:49:48Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.206.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.206.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.206.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.254.keytab.
Entry for principal kudu/127.26.206.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.254.keytab.
I20260808 14:49:48.541361 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200577490656-27451-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200577490656-27451-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200577490656-27451-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.206.254:35549
--webserver_interface=127.26.206.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.254.keytab
--principal=kudu/127.26.206.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.206.212:46847
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.206.254:35549
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:49:48.862692 28719 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:49:48.862975 28719 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:49:48.863066 28719 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:49:48.869968 28719 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:49:48.870075 28719 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260808 14:49:48.870114 28719 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:49:48.870165 28719 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:49:48.870205 28719 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:49:48.870265 28719 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:49:48.879946 28719 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:46847
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200577490656-27451-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200577490656-27451-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.206.254:35549
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.254.keytab
--principal=kudu/127.26.206.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.206.254:35549
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.206.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200577490656-27451-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:49:48.881121 28719 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:49:48.882351 28719 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:49:48.893736 28725 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:49:48.893791 28727 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:49:48.893826 28724 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:49:48.894486 28719 server_base.cc:1034] running on GCE node
I20260808 14:49:48.895246 28719 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:49:48.896564 28719 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:49:48.897907 28719 hybrid_clock.cc:648] HybridClock initialized: now 1786200588897838 us; error 35 us; skew 500 ppm
I20260808 14:49:48.898186 28719 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:49:48 dist-test-slave-6k22 krb5kdc[28704](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200588, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:49:48.901391 28719 init.cc:377] Logged in from keytab as kudu/127.26.206.254@KRBTEST.COM (short username kudu)
I20260808 14:49:48.902868 28719 webserver.cc:460] Webserver started at http://127.26.206.254:39435/ using document root <none> and password file <none>
I20260808 14:49:48.903610 28719 fs_manager.cc:359] Metadata directory not provided
I20260808 14:49:48.903752 28719 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:49:48.904096 28719 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:49:48.907054 28719 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200577490656-27451-0/minicluster-data/master-0/data/instance:
uuid: "8396b7aa47d74e64ae248bd64e44ac98"
format_stamp: "Formatted at 2026-08-08 14:49:48 on dist-test-slave-6k22"
server_key: "718a8ed8b0c0ceb7f4ce0322d9df8cad"
server_key_iv: "1dcaed70da4239359a51cbf4964fca6c"
server_key_version: "encryptionkey@0"
I20260808 14:49:48.907945 28719 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200577490656-27451-0/minicluster-data/master-0/wal/instance:
uuid: "8396b7aa47d74e64ae248bd64e44ac98"
format_stamp: "Formatted at 2026-08-08 14:49:48 on dist-test-slave-6k22"
server_key: "718a8ed8b0c0ceb7f4ce0322d9df8cad"
server_key_iv: "1dcaed70da4239359a51cbf4964fca6c"
server_key_version: "encryptionkey@0"
I20260808 14:49:48.913160 28719 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260808 14:49:48.916457 28735 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:49:48.917651 28719 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260808 14:49:48.917836 28719 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200577490656-27451-0/minicluster-data/master-0/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200577490656-27451-0/minicluster-data/master-0/wal
uuid: "8396b7aa47d74e64ae248bd64e44ac98"
format_stamp: "Formatted at 2026-08-08 14:49:48 on dist-test-slave-6k22"
server_key: "718a8ed8b0c0ceb7f4ce0322d9df8cad"
server_key_iv: "1dcaed70da4239359a51cbf4964fca6c"
server_key_version: "encryptionkey@0"
I20260808 14:49:48.918073 28719 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200577490656-27451-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200577490656-27451-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200577490656-27451-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:49:48.930649 28719 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:49:48.934849 28719 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:49:48.935117 28719 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:49:48.957101 28719 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.254:35549
I20260808 14:49:48.957120 28802 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.254:35549 every 8 connection(s)
I20260808 14:49:48.958549 28719 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
I20260808 14:49:48.960124 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 28719
I20260808 14:49:48.960337 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200577490656-27451-0/minicluster-data/master-0/wal/instance
I20260808 14:49:48.961228 27451 external_mini_cluster.cc:1428] Setting key 5ba0a4f29aeae49ddee42908f3f5a687
I20260808 14:49:48.963404 28803 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 08 14:49:48 dist-test-slave-6k22 krb5kdc[28704](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200588, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.206.254@KRBTEST.COM
I20260808 14:49:48.976920 28803 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8396b7aa47d74e64ae248bd64e44ac98: Bootstrap starting.
I20260808 14:49:48.980099 28803 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8396b7aa47d74e64ae248bd64e44ac98: Neither blocks nor log segments found. Creating new log.
I20260808 14:49:48.981179 28803 log.cc:824] T 00000000000000000000000000000000 P 8396b7aa47d74e64ae248bd64e44ac98: Log is configured to *not* fsync() on all Append() calls
I20260808 14:49:48.984069 28803 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8396b7aa47d74e64ae248bd64e44ac98: No bootstrap required, opened a new log
I20260808 14:49:48.984501 28806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:48.963297 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52514 (local address 127.26.206.254:35549)
0808 14:49:48.964121 (+ 824us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:48.964133 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:48.964173 (+ 40us) server_negotiation.cc:407] Connection header received
0808 14:49:48.965772 (+ 1599us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:48.965792 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:48.966182 (+ 390us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:48.966511 (+ 329us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:48.968294 (+ 1783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:48.969635 (+ 1341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:48.971417 (+ 1782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:48.972141 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:48.972276 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:48.977170 (+ 4894us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:49:48.977177 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:49:48.977194 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:49:48.977235 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:49:48.980479 (+ 3244us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:48.981177 (+ 698us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:48.981183 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:48.981189 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:48.981384 (+ 195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:48.981797 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:48.981802 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:48.981805 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:48.982317 (+ 512us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:49:48.982619 (+ 302us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:48.983070 (+ 451us) server_negotiation.cc:299] Negotiation successful
0808 14:49:48.983466 (+ 396us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":618,"thread_start_us":425,"threads_started":1}
I20260808 14:49:48.992091 28803 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8396b7aa47d74e64ae248bd64e44ac98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8396b7aa47d74e64ae248bd64e44ac98" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 35549 } }
I20260808 14:49:48.992426 28803 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8396b7aa47d74e64ae248bd64e44ac98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:49:48.992522 28803 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8396b7aa47d74e64ae248bd64e44ac98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8396b7aa47d74e64ae248bd64e44ac98, State: Initialized, Role: FOLLOWER
I20260808 14:49:48.993049 28803 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8396b7aa47d74e64ae248bd64e44ac98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8396b7aa47d74e64ae248bd64e44ac98" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 35549 } }
I20260808 14:49:48.993290 28803 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8396b7aa47d74e64ae248bd64e44ac98 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:49:48.993429 28803 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8396b7aa47d74e64ae248bd64e44ac98 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:49:48.993603 28803 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8396b7aa47d74e64ae248bd64e44ac98 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:49:48.995955 28803 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8396b7aa47d74e64ae248bd64e44ac98 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8396b7aa47d74e64ae248bd64e44ac98" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 35549 } }
I20260808 14:49:48.996450 28803 leader_election.cc:302] T 00000000000000000000000000000000 P 8396b7aa47d74e64ae248bd64e44ac98 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8396b7aa47d74e64ae248bd64e44ac98; no voters:
I20260808 14:49:48.997017 28803 leader_election.cc:288] T 00000000000000000000000000000000 P 8396b7aa47d74e64ae248bd64e44ac98 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:49:48.997140 28808 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8396b7aa47d74e64ae248bd64e44ac98 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:49:48.997900 28808 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8396b7aa47d74e64ae248bd64e44ac98 [term 1 LEADER]: Becoming Leader. State: Replica: 8396b7aa47d74e64ae248bd64e44ac98, State: Running, Role: LEADER
I20260808 14:49:48.998428 28808 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8396b7aa47d74e64ae248bd64e44ac98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8396b7aa47d74e64ae248bd64e44ac98" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 35549 } }
I20260808 14:49:48.999099 28803 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8396b7aa47d74e64ae248bd64e44ac98 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:49:49.000998 28809 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8396b7aa47d74e64ae248bd64e44ac98 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8396b7aa47d74e64ae248bd64e44ac98" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8396b7aa47d74e64ae248bd64e44ac98" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 35549 } } }
I20260808 14:49:49.001416 28809 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8396b7aa47d74e64ae248bd64e44ac98 [sys.catalog]: This master's current role is: LEADER
I20260808 14:49:49.001320 28810 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8396b7aa47d74e64ae248bd64e44ac98 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8396b7aa47d74e64ae248bd64e44ac98. Latest consensus state: current_term: 1 leader_uuid: "8396b7aa47d74e64ae248bd64e44ac98" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8396b7aa47d74e64ae248bd64e44ac98" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 35549 } } }
I20260808 14:49:49.001603 28810 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8396b7aa47d74e64ae248bd64e44ac98 [sys.catalog]: This master's current role is: LEADER
I20260808 14:49:49.002272 28814 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:49:49.007541 28814 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:49:49.015568 28814 catalog_manager.cc:1347] Generated new cluster ID: 75a607c9ef4c445e8a6bcf9513625363
I20260808 14:49:49.015671 28814 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:49:49.034801 28814 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:49:49.036196 28814 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:49:49.045290 28814 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8396b7aa47d74e64ae248bd64e44ac98: Generated new TSK 0
I20260808 14:49:49.046068 28814 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.206.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.206.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.206.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.193.keytab.
Entry for principal kudu/127.26.206.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.193.keytab.
I20260808 14:49:49.095479 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200577490656-27451-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200577490656-27451-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200577490656-27451-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200577490656-27451-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.206.193:0
--local_ip_for_outbound_sockets=127.26.206.193
--webserver_interface=127.26.206.193
--webserver_port=0
--tserver_master_addrs=127.26.206.254:35549
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.193.keytab
--principal=kudu/127.26.206.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.206.212:46847
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:49:49.417800 28832 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:49:49.418116 28832 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:49:49.418288 28832 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:49:49.425532 28832 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:49:49.425688 28832 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:49:49.425833 28832 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 14:49:49.425976 28832 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.206.193
I20260808 14:49:49.435420 28832 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:46847
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200577490656-27451-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200577490656-27451-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.193.keytab
--principal=kudu/127.26.206.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.206.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200577490656-27451-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.206.193
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.26.206.254:35549
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.206.193
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200577490656-27451-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:49:49.436676 28832 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:49:49.438006 28832 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:49:49.450933 28839 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:49:49.450984 28842 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:49:49.450886 28840 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:49:49.452170 28832 server_base.cc:1034] running on GCE node
I20260808 14:49:49.452766 28832 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:49:49.453615 28832 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:49:49.454864 28832 hybrid_clock.cc:648] HybridClock initialized: now 1786200589454784 us; error 50 us; skew 500 ppm
I20260808 14:49:49.455184 28832 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:49:49 dist-test-slave-6k22 krb5kdc[28704](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200589, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:49:49.458271 28832 init.cc:377] Logged in from keytab as kudu/127.26.206.193@KRBTEST.COM (short username kudu)
I20260808 14:49:49.459743 28832 webserver.cc:460] Webserver started at http://127.26.206.193:33605/ using document root <none> and password file <none>
I20260808 14:49:49.460424 28832 fs_manager.cc:359] Metadata directory not provided
I20260808 14:49:49.460553 28832 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:49:49.460870 28832 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:49:49.463742 28832 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200577490656-27451-0/minicluster-data/ts-0/data/instance:
uuid: "10eaeff5663d4d269cdc8254e98417f1"
format_stamp: "Formatted at 2026-08-08 14:49:49 on dist-test-slave-6k22"
server_key: "9ffd2d9db6bda2fa1fcc9a331f17fbca"
server_key_iv: "8c1155bee62790401d95b7993eecdb04"
server_key_version: "encryptionkey@0"
I20260808 14:49:49.464587 28832 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200577490656-27451-0/minicluster-data/ts-0/wal/instance:
uuid: "10eaeff5663d4d269cdc8254e98417f1"
format_stamp: "Formatted at 2026-08-08 14:49:49 on dist-test-slave-6k22"
server_key: "9ffd2d9db6bda2fa1fcc9a331f17fbca"
server_key_iv: "8c1155bee62790401d95b7993eecdb04"
server_key_version: "encryptionkey@0"
I20260808 14:49:49.469430 28832 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.003s
I20260808 14:49:49.472681 28850 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:49:49.473973 28832 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 14:49:49.474143 28832 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200577490656-27451-0/minicluster-data/ts-0/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200577490656-27451-0/minicluster-data/ts-0/wal
uuid: "10eaeff5663d4d269cdc8254e98417f1"
format_stamp: "Formatted at 2026-08-08 14:49:49 on dist-test-slave-6k22"
server_key: "9ffd2d9db6bda2fa1fcc9a331f17fbca"
server_key_iv: "8c1155bee62790401d95b7993eecdb04"
server_key_version: "encryptionkey@0"
I20260808 14:49:49.474397 28832 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200577490656-27451-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200577490656-27451-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200577490656-27451-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:49:49.485709 28832 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:49:49.490108 28832 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:49:49.490377 28832 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:49:49.493162 28832 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:49:49.493275 28832 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:49:49.493459 28832 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:49:49.493562 28832 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 14:49:49 dist-test-slave-6k22 krb5kdc[28704](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200589, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.193@KRBTEST.COM for kudu/127.26.206.254@KRBTEST.COM
I20260808 14:49:49.516556 28859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:49.493552 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.193:52087 (local address 127.26.206.254:35549)
0808 14:49:49.494080 (+ 528us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:49.494088 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:49.495069 (+ 981us) server_negotiation.cc:407] Connection header received
0808 14:49:49.497156 (+ 2087us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:49.497164 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:49.497246 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:49.497388 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:49.499643 (+ 2255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:49.500604 (+ 961us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:49.503041 (+ 2437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:49.503545 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:49.503698 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:49.508684 (+ 4986us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:49:49.508694 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:49:49.508701 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:49:49.508771 (+ 70us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:49:49.512913 (+ 4142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:49.513895 (+ 982us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:49.513904 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:49.513910 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:49.514086 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:49.514602 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:49.514610 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:49.514614 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:49.514892 (+ 278us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:49:49.515086 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:49.515946 (+ 860us) server_negotiation.cc:299] Negotiation successful
0808 14:49:49.516159 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":388,"thread_start_us":278,"threads_started":1}
I20260808 14:49:49.517478 28861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:49.494161 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:35549 (local address 127.26.206.193:52087)
0808 14:49:49.494910 (+ 749us) negotiation.cc:107] Waiting for socket to connect
0808 14:49:49.494948 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 14:49:49.496843 (+ 1895us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:49:49.497553 (+ 710us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:49:49.497561 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:49:49.498317 (+ 756us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:49:49.499335 (+ 1018us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:49.499365 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:49.500771 (+ 1406us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:49.500782 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:49.502891 (+ 2109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:49.502902 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:49.503815 (+ 913us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:49.503823 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:49.504144 (+ 321us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:49.505021 (+ 877us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:49:49.505056 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:49:49.508413 (+ 3357us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:49:49.513075 (+ 4662us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:49:49.513087 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:49:49.513105 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:49:49.513754 (+ 649us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:49:49.514234 (+ 480us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:49:49.514245 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:49:49.514248 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:49:49.514473 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:49:49.515036 (+ 563us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:49:49.515043 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:49:49.515494 (+ 451us) client_negotiation.cc:769] Sending connection context
0808 14:49:49.515871 (+ 377us) client_negotiation.cc:240] Negotiation successful
0808 14:49:49.516361 (+ 490us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":528,"thread_start_us":342,"threads_started":1}
I20260808 14:49:49.539984 28932 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:49.524160 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:35549 (local address 127.26.206.193:42971)
0808 14:49:49.524772 (+ 612us) negotiation.cc:107] Waiting for socket to connect
0808 14:49:49.524793 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 14:49:49.524947 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:49:49.525439 (+ 492us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:49:49.525466 (+ 27us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:49:49.526122 (+ 656us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:49:49.526560 (+ 438us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:49.526574 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:49.528085 (+ 1511us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:49.528093 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:49.530349 (+ 2256us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:49.530379 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:49.531462 (+ 1083us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:49.531492 (+ 30us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:49.531748 (+ 256us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:49.532462 (+ 714us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:49:49.532489 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:49:49.533653 (+ 1164us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:49:49.537039 (+ 3386us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:49:49.537045 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:49:49.537050 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:49:49.537495 (+ 445us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:49:49.537879 (+ 384us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:49:49.537884 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:49:49.537888 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:49:49.538096 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:49:49.538834 (+ 738us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:49:49.538841 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:49:49.539028 (+ 187us) client_negotiation.cc:769] Sending connection context
0808 14:49:49.539144 (+ 116us) client_negotiation.cc:240] Negotiation successful
0808 14:49:49.539393 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":503,"thread_start_us":378,"threads_started":1}
I20260808 14:49:49.540025 28859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:49.524102 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.193:42971 (local address 127.26.206.254:35549)
0808 14:49:49.524258 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:49.524262 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:49.524878 (+ 616us) server_negotiation.cc:407] Connection header received
0808 14:49:49.525060 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:49.525067 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:49.525147 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:49.525246 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:49.526785 (+ 1539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:49.527923 (+ 1138us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:49.530527 (+ 2604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:49.531098 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:49.531237 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:49.533907 (+ 2670us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:49:49.533914 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:49:49.533920 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:49:49.533961 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:49:49.536915 (+ 2954us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:49.537618 (+ 703us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:49.537625 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:49.537628 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:49.537755 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:49.538237 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:49.538245 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:49.538250 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:49.538680 (+ 430us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:49:49.538853 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:49.539297 (+ 444us) server_negotiation.cc:299] Negotiation successful
0808 14:49:49.539623 (+ 326us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260808 14:49:49.549643 28832 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.193:37879
I20260808 14:49:49.549721 28996 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.193:37879 every 8 connection(s)
I20260808 14:49:49.550879 28832 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200577490656-27451-0/minicluster-data/ts-0/data/info.pb
I20260808 14:49:49.552901 28997 heartbeater.cc:347] Connected to a master server at 127.26.206.254:35549
I20260808 14:49:49.553117 28997 heartbeater.cc:464] Registering TS with master...
I20260808 14:49:49.553663 28997 heartbeater.cc:511] Master 127.26.206.254:35549 requested a full tablet report, sending...
I20260808 14:49:49.554925 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 28832
I20260808 14:49:49.555127 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200577490656-27451-0/minicluster-data/ts-0/wal/instance
I20260808 14:49:49.555603 28754 ts_manager.cc:194] Registered new tserver with Master: 10eaeff5663d4d269cdc8254e98417f1 (127.26.206.193:37879)
I20260808 14:49:49.555907 27451 external_mini_cluster.cc:1428] Setting key b5d707b79c9788d035e6b019353dd1e0
I20260808 14:49:49.557446 28754 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.206.193@KRBTEST.COM'} at 127.26.206.193:52087
WARNING: no policy specified for kudu/127.26.206.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.206.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.206.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.194.keytab.
Entry for principal kudu/127.26.206.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.194.keytab.
I20260808 14:49:49.600641 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200577490656-27451-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200577490656-27451-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200577490656-27451-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200577490656-27451-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.206.194:0
--local_ip_for_outbound_sockets=127.26.206.194
--webserver_interface=127.26.206.194
--webserver_port=0
--tserver_master_addrs=127.26.206.254:35549
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.194.keytab
--principal=kudu/127.26.206.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.206.212:46847
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:49:49.922763 29001 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:49:49.923041 29001 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:49:49.923211 29001 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:49:49.930104 29001 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:49:49.930191 29001 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:49:49.930285 29001 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 14:49:49.930424 29001 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.206.194
I20260808 14:49:49.939790 29001 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:46847
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200577490656-27451-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200577490656-27451-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.194.keytab
--principal=kudu/127.26.206.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.206.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200577490656-27451-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.206.194
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.26.206.254:35549
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.206.194
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200577490656-27451-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:49:49.941030 29001 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:49:49.942341 29001 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:49:49.955534 29008 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:49:49.955906 29007 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:49:49.956159 29011 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:49:49.956252 29001 server_base.cc:1034] running on GCE node
I20260808 14:49:49.956815 29001 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:49:49.957665 29001 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:49:49.958863 29001 hybrid_clock.cc:648] HybridClock initialized: now 1786200589958798 us; error 43 us; skew 500 ppm
I20260808 14:49:49.959089 29001 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:49:49 dist-test-slave-6k22 krb5kdc[28704](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200589, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:49:49.970373 29001 init.cc:377] Logged in from keytab as kudu/127.26.206.194@KRBTEST.COM (short username kudu)
I20260808 14:49:49.971848 29001 webserver.cc:460] Webserver started at http://127.26.206.194:41149/ using document root <none> and password file <none>
I20260808 14:49:49.972554 29001 fs_manager.cc:359] Metadata directory not provided
I20260808 14:49:49.972662 29001 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:49:49.973001 29001 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:49:49.975903 29001 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200577490656-27451-0/minicluster-data/ts-1/data/instance:
uuid: "19b3f51d4a94491fb48f34684520859d"
format_stamp: "Formatted at 2026-08-08 14:49:49 on dist-test-slave-6k22"
server_key: "57ef048071d434324eb7619e9ad55088"
server_key_iv: "a521b53dffe05629cc476d9ef3ea34ff"
server_key_version: "encryptionkey@0"
I20260808 14:49:49.976660 29001 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200577490656-27451-0/minicluster-data/ts-1/wal/instance:
uuid: "19b3f51d4a94491fb48f34684520859d"
format_stamp: "Formatted at 2026-08-08 14:49:49 on dist-test-slave-6k22"
server_key: "57ef048071d434324eb7619e9ad55088"
server_key_iv: "a521b53dffe05629cc476d9ef3ea34ff"
server_key_version: "encryptionkey@0"
I20260808 14:49:49.982024 29001 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.004s
I20260808 14:49:49.985491 29018 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:49:49.986750 29001 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260808 14:49:49.986914 29001 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200577490656-27451-0/minicluster-data/ts-1/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200577490656-27451-0/minicluster-data/ts-1/wal
uuid: "19b3f51d4a94491fb48f34684520859d"
format_stamp: "Formatted at 2026-08-08 14:49:49 on dist-test-slave-6k22"
server_key: "57ef048071d434324eb7619e9ad55088"
server_key_iv: "a521b53dffe05629cc476d9ef3ea34ff"
server_key_version: "encryptionkey@0"
I20260808 14:49:49.987149 29001 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200577490656-27451-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200577490656-27451-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200577490656-27451-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:49:50.042757 29001 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:49:50.047694 29001 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:49:50.047971 29001 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:49:50.050642 29001 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:49:50.050770 29001 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:49:50.050921 29001 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:49:50.050997 29001 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 14:49:50 dist-test-slave-6k22 krb5kdc[28704](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200589, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.194@KRBTEST.COM for kudu/127.26.206.254@KRBTEST.COM
I20260808 14:49:50.077898 29027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:50.051515 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.194:48937 (local address 127.26.206.254:35549)
0808 14:49:50.053366 (+ 1851us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:50.053371 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:50.053397 (+ 26us) server_negotiation.cc:407] Connection header received
0808 14:49:50.056274 (+ 2877us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:50.056302 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:50.056404 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:50.056545 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:50.059187 (+ 2642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:50.060219 (+ 1032us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:50.063515 (+ 3296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:50.063970 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:50.064068 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:50.070266 (+ 6198us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:49:50.070274 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:49:50.070280 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:49:50.070324 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:49:50.073512 (+ 3188us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:50.074764 (+ 1252us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:50.074770 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:50.074776 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:50.074935 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:50.075658 (+ 723us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:50.075662 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:50.075664 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:50.076033 (+ 369us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:49:50.076202 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:50.077345 (+ 1143us) server_negotiation.cc:299] Negotiation successful
0808 14:49:50.077525 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1738,"thread_start_us":1611,"threads_started":1}
I20260808 14:49:50.080380 29029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:50.052289 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:35549 (local address 127.26.206.194:48937)
0808 14:49:50.053277 (+ 988us) negotiation.cc:107] Waiting for socket to connect
0808 14:49:50.053322 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 14:49:50.055948 (+ 2626us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:49:50.056875 (+ 927us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:49:50.056890 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:49:50.057814 (+ 924us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:49:50.058873 (+ 1059us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:50.058902 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:50.060416 (+ 1514us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:50.060423 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:50.063349 (+ 2926us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:50.063369 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:50.064226 (+ 857us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:50.064240 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:50.064606 (+ 366us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:50.065572 (+ 966us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:49:50.065605 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:49:50.069982 (+ 4377us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:49:50.073684 (+ 3702us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:49:50.073698 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:49:50.073719 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:49:50.074597 (+ 878us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:49:50.075080 (+ 483us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:49:50.075084 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:49:50.075086 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:49:50.075426 (+ 340us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:49:50.076227 (+ 801us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:49:50.076240 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:49:50.076842 (+ 602us) client_negotiation.cc:769] Sending connection context
0808 14:49:50.077265 (+ 423us) client_negotiation.cc:240] Negotiation successful
0808 14:49:50.078047 (+ 782us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":702,"thread_start_us":437,"threads_started":1}
I20260808 14:49:50.103224 29027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:50.086542 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.194:48275 (local address 127.26.206.254:35549)
0808 14:49:50.086805 (+ 263us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:50.086813 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:50.087403 (+ 590us) server_negotiation.cc:407] Connection header received
0808 14:49:50.087537 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:50.087545 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:50.087675 (+ 130us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:50.087819 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:50.088795 (+ 976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:50.090235 (+ 1440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:50.091791 (+ 1556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:50.092549 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:50.092690 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:50.095570 (+ 2880us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:49:50.095579 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:49:50.095615 (+ 36us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:49:50.095664 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:49:50.099473 (+ 3809us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:50.100590 (+ 1117us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:50.100598 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:50.100603 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:50.100777 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:50.101298 (+ 521us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:50.101305 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:50.101309 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:50.101800 (+ 491us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:49:50.101985 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:50.102540 (+ 555us) server_negotiation.cc:299] Negotiation successful
0808 14:49:50.102824 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260808 14:49:50.103479 29111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:50.086551 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:35549 (local address 127.26.206.194:48275)
0808 14:49:50.087308 (+ 757us) negotiation.cc:107] Waiting for socket to connect
0808 14:49:50.087328 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 14:49:50.087429 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:49:50.087879 (+ 450us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:49:50.087884 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:49:50.088362 (+ 478us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:49:50.088643 (+ 281us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:50.088652 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:50.090412 (+ 1760us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:50.090417 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:50.091621 (+ 1204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:50.091651 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:50.092786 (+ 1135us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:50.092793 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:50.093056 (+ 263us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:50.093778 (+ 722us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:49:50.093807 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:49:50.095273 (+ 1466us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:49:50.099741 (+ 4468us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:49:50.099746 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:49:50.099753 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:49:50.100453 (+ 700us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:49:50.100940 (+ 487us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:49:50.100947 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:49:50.100952 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:49:50.101142 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:49:50.101968 (+ 826us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:49:50.101975 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:49:50.102228 (+ 253us) client_negotiation.cc:769] Sending connection context
0808 14:49:50.102418 (+ 190us) client_negotiation.cc:240] Negotiation successful
0808 14:49:50.102827 (+ 409us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":596,"thread_start_us":432,"threads_started":1}
I20260808 14:49:50.105835 29001 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.194:42635
I20260808 14:49:50.105868 29156 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.194:42635 every 8 connection(s)
I20260808 14:49:50.107385 29001 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200577490656-27451-0/minicluster-data/ts-1/data/info.pb
I20260808 14:49:50.109562 29157 heartbeater.cc:347] Connected to a master server at 127.26.206.254:35549
I20260808 14:49:50.110185 29157 heartbeater.cc:464] Registering TS with master...
I20260808 14:49:50.110157 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 29001
I20260808 14:49:50.110364 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200577490656-27451-0/minicluster-data/ts-1/wal/instance
I20260808 14:49:50.111042 27451 external_mini_cluster.cc:1428] Setting key 7dc52eaa5bfe1e18649d4bb4b0ff7aa2
I20260808 14:49:50.111014 29157 heartbeater.cc:511] Master 127.26.206.254:35549 requested a full tablet report, sending...
I20260808 14:49:50.113004 28753 ts_manager.cc:194] Registered new tserver with Master: 19b3f51d4a94491fb48f34684520859d (127.26.206.194:42635)
I20260808 14:49:50.114171 28753 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.206.194@KRBTEST.COM'} at 127.26.206.194:48937
WARNING: no policy specified for kudu/127.26.206.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.206.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.206.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.195.keytab.
Entry for principal kudu/127.26.206.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.195.keytab.
I20260808 14:49:50.156162 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200577490656-27451-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200577490656-27451-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200577490656-27451-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200577490656-27451-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.206.195:0
--local_ip_for_outbound_sockets=127.26.206.195
--webserver_interface=127.26.206.195
--webserver_port=0
--tserver_master_addrs=127.26.206.254:35549
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.195.keytab
--principal=kudu/127.26.206.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.206.212:46847
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:49:50.476406 29161 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:49:50.476742 29161 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:49:50.476917 29161 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:49:50.484031 29161 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:49:50.484169 29161 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:49:50.484313 29161 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 14:49:50.484447 29161 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.206.195
I20260808 14:49:50.494014 29161 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:46847
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200577490656-27451-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200577490656-27451-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.195.keytab
--principal=kudu/127.26.206.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.206.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200577490656-27451-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.206.195
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.26.206.254:35549
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.206.195
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200577490656-27451-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:49:50.495319 29161 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:49:50.496692 29161 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:49:50.510000 29166 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:49:50.509965 29167 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:49:50.510031 29169 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:49:50.510980 29161 server_base.cc:1034] running on GCE node
I20260808 14:49:50.511605 29161 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:49:50.512562 29161 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:49:50.513779 29161 hybrid_clock.cc:648] HybridClock initialized: now 1786200590513726 us; error 25 us; skew 500 ppm
I20260808 14:49:50.514031 29161 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:49:50 dist-test-slave-6k22 krb5kdc[28704](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200590, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:49:50.517081 29161 init.cc:377] Logged in from keytab as kudu/127.26.206.195@KRBTEST.COM (short username kudu)
I20260808 14:49:50.518532 29161 webserver.cc:460] Webserver started at http://127.26.206.195:38487/ using document root <none> and password file <none>
I20260808 14:49:50.519224 29161 fs_manager.cc:359] Metadata directory not provided
I20260808 14:49:50.519340 29161 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:49:50.519752 29161 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:49:50.522675 29161 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200577490656-27451-0/minicluster-data/ts-2/data/instance:
uuid: "a1656fcf3d624257bff2de727b498722"
format_stamp: "Formatted at 2026-08-08 14:49:50 on dist-test-slave-6k22"
server_key: "514486754bb5c1968658c99b842cdece"
server_key_iv: "f7cba90b74e86610f72c0ac4afdf0beb"
server_key_version: "encryptionkey@0"
I20260808 14:49:50.523519 29161 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200577490656-27451-0/minicluster-data/ts-2/wal/instance:
uuid: "a1656fcf3d624257bff2de727b498722"
format_stamp: "Formatted at 2026-08-08 14:49:50 on dist-test-slave-6k22"
server_key: "514486754bb5c1968658c99b842cdece"
server_key_iv: "f7cba90b74e86610f72c0ac4afdf0beb"
server_key_version: "encryptionkey@0"
I20260808 14:49:50.528542 29161 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260808 14:49:50.531946 29177 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:49:50.533234 29161 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260808 14:49:50.533404 29161 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200577490656-27451-0/minicluster-data/ts-2/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200577490656-27451-0/minicluster-data/ts-2/wal
uuid: "a1656fcf3d624257bff2de727b498722"
format_stamp: "Formatted at 2026-08-08 14:49:50 on dist-test-slave-6k22"
server_key: "514486754bb5c1968658c99b842cdece"
server_key_iv: "f7cba90b74e86610f72c0ac4afdf0beb"
server_key_version: "encryptionkey@0"
I20260808 14:49:50.533604 29161 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200577490656-27451-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200577490656-27451-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200577490656-27451-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:49:50.560853 28997 heartbeater.cc:503] Master 127.26.206.254:35549 was elected leader, sending a full tablet report...
I20260808 14:49:50.567204 29161 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:49:50.571189 29161 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:49:50.571461 29161 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:49:50.574081 29161 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:49:50.574194 29161 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:49:50.574329 29161 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:49:50.574398 29161 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 14:49:50 dist-test-slave-6k22 krb5kdc[28704](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200590, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.195@KRBTEST.COM for kudu/127.26.206.254@KRBTEST.COM
I20260808 14:49:50.599836 29027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:50.574867 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.195:54635 (local address 127.26.206.254:35549)
0808 14:49:50.575068 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:50.575075 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:50.576612 (+ 1537us) server_negotiation.cc:407] Connection header received
0808 14:49:50.579033 (+ 2421us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:50.579039 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:50.579151 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:50.579268 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:50.581511 (+ 2243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:50.582802 (+ 1291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:50.586101 (+ 3299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:50.586573 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:50.586754 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:50.592118 (+ 5364us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:49:50.592122 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:49:50.592125 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:49:50.592189 (+ 64us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:49:50.595939 (+ 3750us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:50.596898 (+ 959us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:50.596907 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:50.596913 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:50.597115 (+ 202us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:50.597632 (+ 517us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:50.597639 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:50.597645 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:50.598097 (+ 452us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:49:50.598282 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:50.598956 (+ 674us) server_negotiation.cc:299] Negotiation successful
0808 14:49:50.599255 (+ 299us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260808 14:49:50.600660 29186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:50.575595 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:35549 (local address 127.26.206.195:54635)
0808 14:49:50.576436 (+ 841us) negotiation.cc:107] Waiting for socket to connect
0808 14:49:50.576483 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0808 14:49:50.578734 (+ 2251us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:49:50.579719 (+ 985us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:49:50.579728 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:49:50.580530 (+ 802us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:49:50.581333 (+ 803us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:50.581349 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:50.583014 (+ 1665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:50.583021 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:50.585839 (+ 2818us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:50.585860 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:50.587075 (+ 1215us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:50.587080 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:50.587416 (+ 336us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:50.588285 (+ 869us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:49:50.588325 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:49:50.591866 (+ 3541us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:49:50.596131 (+ 4265us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:49:50.596141 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:49:50.596162 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:49:50.596735 (+ 573us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:49:50.597285 (+ 550us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:49:50.597289 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:49:50.597292 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:49:50.597502 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:49:50.598234 (+ 732us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:49:50.598239 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:49:50.598579 (+ 340us) client_negotiation.cc:769] Sending connection context
0808 14:49:50.598798 (+ 219us) client_negotiation.cc:240] Negotiation successful
0808 14:49:50.599327 (+ 529us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":615,"thread_start_us":377,"threads_started":1}
I20260808 14:49:50.622632 29027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:50.606784 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.195:35003 (local address 127.26.206.254:35549)
0808 14:49:50.606976 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:50.606983 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:50.607784 (+ 801us) server_negotiation.cc:407] Connection header received
0808 14:49:50.608041 (+ 257us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:50.608049 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:50.608139 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:50.608280 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:50.609697 (+ 1417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:50.610645 (+ 948us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:50.613234 (+ 2589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:50.613802 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:50.613932 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:50.616630 (+ 2698us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:49:50.616635 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:49:50.616638 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:49:50.616667 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:49:50.619915 (+ 3248us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:50.620592 (+ 677us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:50.620597 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:50.620601 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:50.620830 (+ 229us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:50.621237 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:50.621241 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:50.621245 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:50.621492 (+ 247us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:49:50.621646 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:50.622116 (+ 470us) server_negotiation.cc:299] Negotiation successful
0808 14:49:50.622328 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260808 14:49:50.622790 29256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:50.606820 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:35549 (local address 127.26.206.195:35003)
0808 14:49:50.607640 (+ 820us) negotiation.cc:107] Waiting for socket to connect
0808 14:49:50.607670 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0808 14:49:50.607833 (+ 163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:49:50.608313 (+ 480us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:49:50.608321 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:49:50.609050 (+ 729us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:49:50.609540 (+ 490us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:50.609556 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:50.610837 (+ 1281us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:50.610842 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:50.613067 (+ 2225us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:50.613092 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:50.614148 (+ 1056us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:50.614153 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:50.614414 (+ 261us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:50.615089 (+ 675us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:49:50.615117 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:49:50.616371 (+ 1254us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:49:50.620035 (+ 3664us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:49:50.620040 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:49:50.620044 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:49:50.620468 (+ 424us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:49:50.620990 (+ 522us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:49:50.620995 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:49:50.620999 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:49:50.621120 (+ 121us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:49:50.621610 (+ 490us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:49:50.621615 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:49:50.621794 (+ 179us) client_negotiation.cc:769] Sending connection context
0808 14:49:50.621931 (+ 137us) client_negotiation.cc:240] Negotiation successful
0808 14:49:50.622234 (+ 303us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":595,"thread_start_us":396,"threads_started":1}
I20260808 14:49:50.630012 29161 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.195:38159
I20260808 14:49:50.630091 29311 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.195:38159 every 8 connection(s)
I20260808 14:49:50.631217 29161 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200577490656-27451-0/minicluster-data/ts-2/data/info.pb
I20260808 14:49:50.633185 29312 heartbeater.cc:347] Connected to a master server at 127.26.206.254:35549
I20260808 14:49:50.633194 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 29161
I20260808 14:49:50.633368 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200577490656-27451-0/minicluster-data/ts-2/wal/instance
I20260808 14:49:50.633447 29312 heartbeater.cc:464] Registering TS with master...
I20260808 14:49:50.633885 27451 external_mini_cluster.cc:1428] Setting key 7b6eac5f619febbcac72e3b1ae06f4e4
I20260808 14:49:50.634115 29312 heartbeater.cc:511] Master 127.26.206.254:35549 requested a full tablet report, sending...
I20260808 14:49:50.635430 28753 ts_manager.cc:194] Registered new tserver with Master: a1656fcf3d624257bff2de727b498722 (127.26.206.195:38159)
I20260808 14:49:50.636534 28753 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.206.195@KRBTEST.COM'} at 127.26.206.195:54635
I20260808 14:49:50.637068 27451 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 08 14:49:50 dist-test-slave-6k22 krb5kdc[28704](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200590, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 14:49:50 dist-test-slave-6k22 krb5kdc[28704](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200590, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.26.206.254@KRBTEST.COM
I20260808 14:49:50.686625 29027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:50.672552 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52516 (local address 127.26.206.254:35549)
0808 14:49:50.672793 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:50.672801 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:50.673127 (+ 326us) server_negotiation.cc:407] Connection header received
0808 14:49:50.673347 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:50.673355 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:50.673441 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:50.673548 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:50.674941 (+ 1393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:50.675745 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:50.677058 (+ 1313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:50.677521 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:50.677661 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:50.681521 (+ 3860us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:49:50.681526 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:49:50.681529 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:49:50.681563 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:49:50.684090 (+ 2527us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:50.684696 (+ 606us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:50.684703 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:50.684706 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:50.684848 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:50.685225 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:50.685231 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:50.685234 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:50.685522 (+ 288us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:49:50.685799 (+ 277us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:50.686071 (+ 272us) server_negotiation.cc:299] Negotiation successful
0808 14:49:50.686289 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260808 14:49:50.690591 28753 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52516:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:49:50.697672 28753 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:49:50.734720 29328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:50.710796 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47044 (local address 127.26.206.195:38159)
0808 14:49:50.725893 (+ 15097us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:50.725899 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:50.725925 (+ 26us) server_negotiation.cc:407] Connection header received
0808 14:49:50.726004 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:50.726009 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:50.726224 (+ 215us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:50.726422 (+ 198us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:49:50.727425 (+ 1003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:50.728990 (+ 1565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:50.731830 (+ 2840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:50.733368 (+ 1538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:50.733568 (+ 200us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:50.733765 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:50.734213 (+ 448us) server_negotiation.cc:299] Negotiation successful
0808 14:49:50.734383 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14943,"thread_start_us":14749,"threads_started":1}
I20260808 14:49:50.734779 29326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:50.709968 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.195:38159 (local address 127.0.0.1:47044)
0808 14:49:50.724650 (+ 14682us) negotiation.cc:107] Waiting for socket to connect
0808 14:49:50.724673 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 14:49:50.724838 (+ 165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:49:50.726762 (+ 1924us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:49:50.726766 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:49:50.726790 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:49:50.727165 (+ 375us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:50.727179 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:50.729139 (+ 1960us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:50.729144 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:50.731666 (+ 2522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:50.731682 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:50.733565 (+ 1883us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:50.733571 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:50.733993 (+ 422us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:50.734034 (+ 41us) client_negotiation.cc:769] Sending connection context
0808 14:49:50.734167 (+ 133us) client_negotiation.cc:240] Negotiation successful
0808 14:49:50.734351 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14485,"mutex_wait_us":78,"thread_start_us":16446,"threads_started":1}
I20260808 14:49:50.736286 29325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:50.709765 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.194:42635 (local address 127.0.0.1:41402)
0808 14:49:50.722517 (+ 12752us) negotiation.cc:107] Waiting for socket to connect
0808 14:49:50.722570 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0808 14:49:50.722813 (+ 243us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:49:50.726259 (+ 3446us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:49:50.726270 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:49:50.726299 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:49:50.726768 (+ 469us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:50.726779 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:50.728693 (+ 1914us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:50.728700 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:50.731679 (+ 2979us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:50.731691 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:50.735373 (+ 3682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:50.735378 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:50.735567 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:50.735626 (+ 59us) client_negotiation.cc:769] Sending connection context
0808 14:49:50.735717 (+ 91us) client_negotiation.cc:240] Negotiation successful
0808 14:49:50.735865 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12400,"mutex_wait_us":171,"thread_start_us":13174,"threads_started":1}
I20260808 14:49:50.736691 29331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:50.727287 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.193:37879 (local address 127.0.0.1:52448)
0808 14:49:50.728603 (+ 1316us) negotiation.cc:107] Waiting for socket to connect
0808 14:49:50.728640 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0808 14:49:50.728777 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:49:50.729407 (+ 630us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:49:50.729411 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:49:50.729433 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:49:50.730013 (+ 580us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:50.730023 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:50.731312 (+ 1289us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:50.731317 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:50.733473 (+ 2156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:50.733486 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:50.735871 (+ 2385us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:50.735877 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:50.736052 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:50.736082 (+ 30us) client_negotiation.cc:769] Sending connection context
0808 14:49:50.736190 (+ 108us) client_negotiation.cc:240] Negotiation successful
0808 14:49:50.736329 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1203,"mutex_wait_us":129,"thread_start_us":1077,"threads_started":1}
I20260808 14:49:50.736759 29330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:50.724306 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52448 (local address 127.26.206.193:37879)
0808 14:49:50.727061 (+ 2755us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:50.727068 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:50.728731 (+ 1663us) server_negotiation.cc:407] Connection header received
0808 14:49:50.728975 (+ 244us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:50.728982 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:50.729218 (+ 236us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:50.729403 (+ 185us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:49:50.730202 (+ 799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:50.731146 (+ 944us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:50.733653 (+ 2507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:50.735297 (+ 1644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:50.735423 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:50.735601 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:50.736266 (+ 665us) server_negotiation.cc:299] Negotiation successful
0808 14:49:50.736456 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2613,"thread_start_us":2487,"threads_started":1}
I20260808 14:49:50.737422 29327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:50.710054 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41402 (local address 127.26.206.194:42635)
0808 14:49:50.725435 (+ 15381us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:50.725448 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:50.725495 (+ 47us) server_negotiation.cc:407] Connection header received
0808 14:49:50.725618 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:50.725631 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:50.725973 (+ 342us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:50.726221 (+ 248us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:49:50.726992 (+ 771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:50.728554 (+ 1562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:50.733853 (+ 5299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:50.735147 (+ 1294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:50.735345 (+ 198us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:50.735516 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:50.735783 (+ 267us) server_negotiation.cc:299] Negotiation successful
0808 14:49:50.735963 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15167,"thread_start_us":15034,"threads_started":1}
I20260808 14:49:50.739295 29233 tablet_service.cc:1467] Processing CreateTablet for tablet ce7a8eb31dbc4186ae3f505fbd10fbcd (DEFAULT_TABLE table=test-table [id=ea833e7522e2424a862c9fe26f95cef6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:49:50.740295 29080 tablet_service.cc:1467] Processing CreateTablet for tablet ce7a8eb31dbc4186ae3f505fbd10fbcd (DEFAULT_TABLE table=test-table [id=ea833e7522e2424a862c9fe26f95cef6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:49:50.740412 28913 tablet_service.cc:1467] Processing CreateTablet for tablet ce7a8eb31dbc4186ae3f505fbd10fbcd (DEFAULT_TABLE table=test-table [id=ea833e7522e2424a862c9fe26f95cef6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:49:50.741019 29233 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ce7a8eb31dbc4186ae3f505fbd10fbcd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:49:50.741402 29080 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ce7a8eb31dbc4186ae3f505fbd10fbcd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:49:50.741714 28913 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ce7a8eb31dbc4186ae3f505fbd10fbcd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:49:50.752856 29332 tablet_bootstrap.cc:492] T ce7a8eb31dbc4186ae3f505fbd10fbcd P 19b3f51d4a94491fb48f34684520859d: Bootstrap starting.
I20260808 14:49:50.755858 29332 tablet_bootstrap.cc:654] T ce7a8eb31dbc4186ae3f505fbd10fbcd P 19b3f51d4a94491fb48f34684520859d: Neither blocks nor log segments found. Creating new log.
I20260808 14:49:50.756199 29334 tablet_bootstrap.cc:492] T ce7a8eb31dbc4186ae3f505fbd10fbcd P 10eaeff5663d4d269cdc8254e98417f1: Bootstrap starting.
I20260808 14:49:50.757252 29332 log.cc:824] T ce7a8eb31dbc4186ae3f505fbd10fbcd P 19b3f51d4a94491fb48f34684520859d: Log is configured to *not* fsync() on all Append() calls
I20260808 14:49:50.757858 29333 tablet_bootstrap.cc:492] T ce7a8eb31dbc4186ae3f505fbd10fbcd P a1656fcf3d624257bff2de727b498722: Bootstrap starting.
I20260808 14:49:50.760205 29334 tablet_bootstrap.cc:654] T ce7a8eb31dbc4186ae3f505fbd10fbcd P 10eaeff5663d4d269cdc8254e98417f1: Neither blocks nor log segments found. Creating new log.
I20260808 14:49:50.761003 29333 tablet_bootstrap.cc:654] T ce7a8eb31dbc4186ae3f505fbd10fbcd P a1656fcf3d624257bff2de727b498722: Neither blocks nor log segments found. Creating new log.
I20260808 14:49:50.761480 29334 log.cc:824] T ce7a8eb31dbc4186ae3f505fbd10fbcd P 10eaeff5663d4d269cdc8254e98417f1: Log is configured to *not* fsync() on all Append() calls
I20260808 14:49:50.762133 29333 log.cc:824] T ce7a8eb31dbc4186ae3f505fbd10fbcd P a1656fcf3d624257bff2de727b498722: Log is configured to *not* fsync() on all Append() calls
I20260808 14:49:50.762390 29332 tablet_bootstrap.cc:492] T ce7a8eb31dbc4186ae3f505fbd10fbcd P 19b3f51d4a94491fb48f34684520859d: No bootstrap required, opened a new log
I20260808 14:49:50.762655 29332 ts_tablet_manager.cc:1397] T ce7a8eb31dbc4186ae3f505fbd10fbcd P 19b3f51d4a94491fb48f34684520859d: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.005s
I20260808 14:49:50.764537 29334 tablet_bootstrap.cc:492] T ce7a8eb31dbc4186ae3f505fbd10fbcd P 10eaeff5663d4d269cdc8254e98417f1: No bootstrap required, opened a new log
I20260808 14:49:50.764798 29334 ts_tablet_manager.cc:1397] T ce7a8eb31dbc4186ae3f505fbd10fbcd P 10eaeff5663d4d269cdc8254e98417f1: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260808 14:49:50.765190 29333 tablet_bootstrap.cc:492] T ce7a8eb31dbc4186ae3f505fbd10fbcd P a1656fcf3d624257bff2de727b498722: No bootstrap required, opened a new log
I20260808 14:49:50.765440 29333 ts_tablet_manager.cc:1397] T ce7a8eb31dbc4186ae3f505fbd10fbcd P a1656fcf3d624257bff2de727b498722: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.000s
I20260808 14:49:50.772081 29334 raft_consensus.cc:348] T ce7a8eb31dbc4186ae3f505fbd10fbcd P 10eaeff5663d4d269cdc8254e98417f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19b3f51d4a94491fb48f34684520859d" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 42635 } } peers { permanent_uuid: "a1656fcf3d624257bff2de727b498722" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 38159 } } peers { permanent_uuid: "10eaeff5663d4d269cdc8254e98417f1" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 37879 } }
I20260808 14:49:50.772445 29334 raft_consensus.cc:374] T ce7a8eb31dbc4186ae3f505fbd10fbcd P 10eaeff5663d4d269cdc8254e98417f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:49:50.772573 29334 raft_consensus.cc:729] T ce7a8eb31dbc4186ae3f505fbd10fbcd P 10eaeff5663d4d269cdc8254e98417f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10eaeff5663d4d269cdc8254e98417f1, State: Initialized, Role: FOLLOWER
I20260808 14:49:50.773245 29334 consensus_queue.cc:260] T ce7a8eb31dbc4186ae3f505fbd10fbcd P 10eaeff5663d4d269cdc8254e98417f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19b3f51d4a94491fb48f34684520859d" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 42635 } } peers { permanent_uuid: "a1656fcf3d624257bff2de727b498722" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 38159 } } peers { permanent_uuid: "10eaeff5663d4d269cdc8254e98417f1" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 37879 } }
I20260808 14:49:50.773734 29332 raft_consensus.cc:348] T ce7a8eb31dbc4186ae3f505fbd10fbcd P 19b3f51d4a94491fb48f34684520859d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19b3f51d4a94491fb48f34684520859d" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 42635 } } peers { permanent_uuid: "a1656fcf3d624257bff2de727b498722" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 38159 } } peers { permanent_uuid: "10eaeff5663d4d269cdc8254e98417f1" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 37879 } }
I20260808 14:49:50.774247 29332 raft_consensus.cc:374] T ce7a8eb31dbc4186ae3f505fbd10fbcd P 19b3f51d4a94491fb48f34684520859d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:49:50.774405 29332 raft_consensus.cc:729] T ce7a8eb31dbc4186ae3f505fbd10fbcd P 19b3f51d4a94491fb48f34684520859d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19b3f51d4a94491fb48f34684520859d, State: Initialized, Role: FOLLOWER
I20260808 14:49:50.775036 29334 ts_tablet_manager.cc:1428] T ce7a8eb31dbc4186ae3f505fbd10fbcd P 10eaeff5663d4d269cdc8254e98417f1: Time spent starting tablet: real 0.010s user 0.010s sys 0.000s
I20260808 14:49:50.775177 29332 consensus_queue.cc:260] T ce7a8eb31dbc4186ae3f505fbd10fbcd P 19b3f51d4a94491fb48f34684520859d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19b3f51d4a94491fb48f34684520859d" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 42635 } } peers { permanent_uuid: "a1656fcf3d624257bff2de727b498722" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 38159 } } peers { permanent_uuid: "10eaeff5663d4d269cdc8254e98417f1" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 37879 } }
I20260808 14:49:50.776418 29333 raft_consensus.cc:348] T ce7a8eb31dbc4186ae3f505fbd10fbcd P a1656fcf3d624257bff2de727b498722 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19b3f51d4a94491fb48f34684520859d" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 42635 } } peers { permanent_uuid: "a1656fcf3d624257bff2de727b498722" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 38159 } } peers { permanent_uuid: "10eaeff5663d4d269cdc8254e98417f1" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 37879 } }
I20260808 14:49:50.776906 29333 raft_consensus.cc:374] T ce7a8eb31dbc4186ae3f505fbd10fbcd P a1656fcf3d624257bff2de727b498722 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:49:50.777037 29333 raft_consensus.cc:729] T ce7a8eb31dbc4186ae3f505fbd10fbcd P a1656fcf3d624257bff2de727b498722 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1656fcf3d624257bff2de727b498722, State: Initialized, Role: FOLLOWER
I20260808 14:49:50.777107 29332 ts_tablet_manager.cc:1428] T ce7a8eb31dbc4186ae3f505fbd10fbcd P 19b3f51d4a94491fb48f34684520859d: Time spent starting tablet: real 0.014s user 0.013s sys 0.000s
I20260808 14:49:50.777577 29157 heartbeater.cc:503] Master 127.26.206.254:35549 was elected leader, sending a full tablet report...
I20260808 14:49:50.777637 29333 consensus_queue.cc:260] T ce7a8eb31dbc4186ae3f505fbd10fbcd P a1656fcf3d624257bff2de727b498722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19b3f51d4a94491fb48f34684520859d" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 42635 } } peers { permanent_uuid: "a1656fcf3d624257bff2de727b498722" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 38159 } } peers { permanent_uuid: "10eaeff5663d4d269cdc8254e98417f1" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 37879 } }
I20260808 14:49:50.780515 29333 ts_tablet_manager.cc:1428] T ce7a8eb31dbc4186ae3f505fbd10fbcd P a1656fcf3d624257bff2de727b498722: Time spent starting tablet: real 0.015s user 0.011s sys 0.005s
I20260808 14:49:50.781154 29312 heartbeater.cc:503] Master 127.26.206.254:35549 was elected leader, sending a full tablet report...
W20260808 14:49:50.803268 28998 tablet.cc:2369] T ce7a8eb31dbc4186ae3f505fbd10fbcd P 10eaeff5663d4d269cdc8254e98417f1: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 14:49:50.859645 29158 tablet.cc:2369] T ce7a8eb31dbc4186ae3f505fbd10fbcd P 19b3f51d4a94491fb48f34684520859d: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 14:49:50.883101 29313 tablet.cc:2369] T ce7a8eb31dbc4186ae3f505fbd10fbcd P a1656fcf3d624257bff2de727b498722: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:49:50.908663 29340 raft_consensus.cc:482] T ce7a8eb31dbc4186ae3f505fbd10fbcd P 19b3f51d4a94491fb48f34684520859d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:49:50.908967 29340 raft_consensus.cc:504] T ce7a8eb31dbc4186ae3f505fbd10fbcd P 19b3f51d4a94491fb48f34684520859d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19b3f51d4a94491fb48f34684520859d" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 42635 } } peers { permanent_uuid: "a1656fcf3d624257bff2de727b498722" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 38159 } } peers { permanent_uuid: "10eaeff5663d4d269cdc8254e98417f1" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 37879 } }
I20260808 14:49:50.910679 29340 leader_election.cc:288] T ce7a8eb31dbc4186ae3f505fbd10fbcd P 19b3f51d4a94491fb48f34684520859d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1656fcf3d624257bff2de727b498722 (127.26.206.195:38159), 10eaeff5663d4d269cdc8254e98417f1 (127.26.206.193:37879)
I20260808 14:49:50.918218 29328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:50.911050 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.194:46865 (local address 127.26.206.195:38159)
0808 14:49:50.911260 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:50.911265 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:50.912591 (+ 1326us) server_negotiation.cc:407] Connection header received
0808 14:49:50.912834 (+ 243us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:50.912841 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:50.912929 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:50.913017 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:49:50.913842 (+ 825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:50.914532 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:50.916419 (+ 1887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:50.917212 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:50.917415 (+ 203us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:50.917496 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:50.917823 (+ 327us) server_negotiation.cc:299] Negotiation successful
0808 14:49:50.917945 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260808 14:49:50.918231 29330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:50.911150 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.194:42207 (local address 127.26.206.193:37879)
0808 14:49:50.911400 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:50.911409 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:50.912691 (+ 1282us) server_negotiation.cc:407] Connection header received
0808 14:49:50.912914 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:50.912922 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:50.913005 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:50.913104 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:49:50.913740 (+ 636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:50.914452 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:50.916403 (+ 1951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:50.917222 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:50.917410 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:50.917498 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:50.917845 (+ 347us) server_negotiation.cc:299] Negotiation successful
0808 14:49:50.917973 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260808 14:49:50.918452 29343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:50.911644 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.193:37879 (local address 127.26.206.194:42207)
0808 14:49:50.912600 (+ 956us) negotiation.cc:107] Waiting for socket to connect
0808 14:49:50.912614 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 14:49:50.912740 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:49:50.913138 (+ 398us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:49:50.913142 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:49:50.913167 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:49:50.913575 (+ 408us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:50.913588 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:50.914594 (+ 1006us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:50.914599 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:50.916237 (+ 1638us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:50.916252 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:50.917494 (+ 1242us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:50.917501 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:50.917689 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:50.917711 (+ 22us) client_negotiation.cc:769] Sending connection context
0808 14:49:50.917813 (+ 102us) client_negotiation.cc:240] Negotiation successful
0808 14:49:50.917933 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":847,"mutex_wait_us":44,"thread_start_us":581,"threads_started":1}
I20260808 14:49:50.918515 29342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:50.911518 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.195:38159 (local address 127.26.206.194:46865)
0808 14:49:50.912484 (+ 966us) negotiation.cc:107] Waiting for socket to connect
0808 14:49:50.912500 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 14:49:50.912661 (+ 161us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:49:50.913045 (+ 384us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:49:50.913049 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:49:50.913072 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:49:50.913693 (+ 621us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:50.913702 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:50.914669 (+ 967us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:50.914676 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:50.916267 (+ 1591us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:50.916280 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:50.917467 (+ 1187us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:50.917477 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:50.917656 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:50.917684 (+ 28us) client_negotiation.cc:769] Sending connection context
0808 14:49:50.917792 (+ 108us) client_negotiation.cc:240] Negotiation successful
0808 14:49:50.917923 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":834,"mutex_wait_us":24,"spinlock_wait_cycles":19200,"thread_start_us":566,"threads_started":1}
I20260808 14:49:50.919703 28943 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce7a8eb31dbc4186ae3f505fbd10fbcd" candidate_uuid: "19b3f51d4a94491fb48f34684520859d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10eaeff5663d4d269cdc8254e98417f1" is_pre_election: true
I20260808 14:49:50.919740 29261 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce7a8eb31dbc4186ae3f505fbd10fbcd" candidate_uuid: "19b3f51d4a94491fb48f34684520859d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1656fcf3d624257bff2de727b498722" is_pre_election: true
I20260808 14:49:50.920255 28943 raft_consensus.cc:2454] T ce7a8eb31dbc4186ae3f505fbd10fbcd P 10eaeff5663d4d269cdc8254e98417f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19b3f51d4a94491fb48f34684520859d in term 0.
I20260808 14:49:50.920260 29261 raft_consensus.cc:2454] T ce7a8eb31dbc4186ae3f505fbd10fbcd P a1656fcf3d624257bff2de727b498722 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19b3f51d4a94491fb48f34684520859d in term 0.
I20260808 14:49:50.920962 29020 leader_election.cc:302] T ce7a8eb31dbc4186ae3f505fbd10fbcd P 19b3f51d4a94491fb48f34684520859d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 10eaeff5663d4d269cdc8254e98417f1, 19b3f51d4a94491fb48f34684520859d, a1656fcf3d624257bff2de727b498722; no voters:
I20260808 14:49:50.921402 29340 raft_consensus.cc:2781] T ce7a8eb31dbc4186ae3f505fbd10fbcd P 19b3f51d4a94491fb48f34684520859d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:49:50.921578 29340 raft_consensus.cc:482] T ce7a8eb31dbc4186ae3f505fbd10fbcd P 19b3f51d4a94491fb48f34684520859d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:49:50.921722 29340 raft_consensus.cc:3037] T ce7a8eb31dbc4186ae3f505fbd10fbcd P 19b3f51d4a94491fb48f34684520859d [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:49:50.923967 29340 raft_consensus.cc:504] T ce7a8eb31dbc4186ae3f505fbd10fbcd P 19b3f51d4a94491fb48f34684520859d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19b3f51d4a94491fb48f34684520859d" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 42635 } } peers { permanent_uuid: "a1656fcf3d624257bff2de727b498722" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 38159 } } peers { permanent_uuid: "10eaeff5663d4d269cdc8254e98417f1" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 37879 } }
I20260808 14:49:50.924520 29340 leader_election.cc:288] T ce7a8eb31dbc4186ae3f505fbd10fbcd P 19b3f51d4a94491fb48f34684520859d [CANDIDATE]: Term 1 election: Requested vote from peers a1656fcf3d624257bff2de727b498722 (127.26.206.195:38159), 10eaeff5663d4d269cdc8254e98417f1 (127.26.206.193:37879)
I20260808 14:49:50.924928 29261 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce7a8eb31dbc4186ae3f505fbd10fbcd" candidate_uuid: "19b3f51d4a94491fb48f34684520859d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1656fcf3d624257bff2de727b498722"
I20260808 14:49:50.925029 28943 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce7a8eb31dbc4186ae3f505fbd10fbcd" candidate_uuid: "19b3f51d4a94491fb48f34684520859d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10eaeff5663d4d269cdc8254e98417f1"
I20260808 14:49:50.925089 29261 raft_consensus.cc:3037] T ce7a8eb31dbc4186ae3f505fbd10fbcd P a1656fcf3d624257bff2de727b498722 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:49:50.925241 28943 raft_consensus.cc:3037] T ce7a8eb31dbc4186ae3f505fbd10fbcd P 10eaeff5663d4d269cdc8254e98417f1 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:49:50.927295 29261 raft_consensus.cc:2454] T ce7a8eb31dbc4186ae3f505fbd10fbcd P a1656fcf3d624257bff2de727b498722 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19b3f51d4a94491fb48f34684520859d in term 1.
I20260808 14:49:50.927508 28943 raft_consensus.cc:2454] T ce7a8eb31dbc4186ae3f505fbd10fbcd P 10eaeff5663d4d269cdc8254e98417f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19b3f51d4a94491fb48f34684520859d in term 1.
I20260808 14:49:50.927722 29020 leader_election.cc:302] T ce7a8eb31dbc4186ae3f505fbd10fbcd P 19b3f51d4a94491fb48f34684520859d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19b3f51d4a94491fb48f34684520859d, a1656fcf3d624257bff2de727b498722; no voters:
I20260808 14:49:50.927985 29340 raft_consensus.cc:2781] T ce7a8eb31dbc4186ae3f505fbd10fbcd P 19b3f51d4a94491fb48f34684520859d [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:49:50.928419 29340 raft_consensus.cc:686] T ce7a8eb31dbc4186ae3f505fbd10fbcd P 19b3f51d4a94491fb48f34684520859d [term 1 LEADER]: Becoming Leader. State: Replica: 19b3f51d4a94491fb48f34684520859d, State: Running, Role: LEADER
I20260808 14:49:50.928929 29340 consensus_queue.cc:237] T ce7a8eb31dbc4186ae3f505fbd10fbcd P 19b3f51d4a94491fb48f34684520859d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19b3f51d4a94491fb48f34684520859d" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 42635 } } peers { permanent_uuid: "a1656fcf3d624257bff2de727b498722" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 38159 } } peers { permanent_uuid: "10eaeff5663d4d269cdc8254e98417f1" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 37879 } }
I20260808 14:49:50.933342 28752 catalog_manager.cc:5495] T ce7a8eb31dbc4186ae3f505fbd10fbcd P 19b3f51d4a94491fb48f34684520859d reported cstate change: term changed from 0 to 1, leader changed from <none> to 19b3f51d4a94491fb48f34684520859d (127.26.206.194). New cstate: current_term: 1 leader_uuid: "19b3f51d4a94491fb48f34684520859d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19b3f51d4a94491fb48f34684520859d" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 42635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1656fcf3d624257bff2de727b498722" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 38159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10eaeff5663d4d269cdc8254e98417f1" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 37879 } health_report { overall_health: UNKNOWN } } }
I20260808 14:49:50.976804 29327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:50.971043 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41404 (local address 127.26.206.194:42635)
0808 14:49:50.971228 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:50.971235 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:50.971461 (+ 226us) server_negotiation.cc:407] Connection header received
0808 14:49:50.971865 (+ 404us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:50.971869 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:50.971952 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:50.972085 (+ 133us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:49:50.972467 (+ 382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:50.973233 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:50.974552 (+ 1319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:50.974927 (+ 375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:50.975056 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:50.975558 (+ 502us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:49:50.976158 (+ 600us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:49:50.976316 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:50.976426 (+ 110us) server_negotiation.cc:299] Negotiation successful
0808 14:49:50.976507 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260808 14:49:50.991590 29261 raft_consensus.cc:1261] T ce7a8eb31dbc4186ae3f505fbd10fbcd P a1656fcf3d624257bff2de727b498722 [term 1 FOLLOWER]: Refusing update from remote peer 19b3f51d4a94491fb48f34684520859d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:49:50.992671 29340 consensus_queue.cc:1035] T ce7a8eb31dbc4186ae3f505fbd10fbcd P 19b3f51d4a94491fb48f34684520859d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1656fcf3d624257bff2de727b498722" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 38159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:49:50.993988 28943 raft_consensus.cc:1261] T ce7a8eb31dbc4186ae3f505fbd10fbcd P 10eaeff5663d4d269cdc8254e98417f1 [term 1 FOLLOWER]: Refusing update from remote peer 19b3f51d4a94491fb48f34684520859d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:49:50.994822 29340 consensus_queue.cc:1035] T ce7a8eb31dbc4186ae3f505fbd10fbcd P 19b3f51d4a94491fb48f34684520859d [LEADER]: Connected to new peer: Peer: permanent_uuid: "10eaeff5663d4d269cdc8254e98417f1" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 37879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:49:51.003647 29347 mvcc.cc:205] Tried to move back new op lower bound from 7316277620667289600 to 7316277620448870400. Current Snapshot: MvccSnapshot[applied={T|T < 7316277620667289600}]
I20260808 14:49:51.004805 29348 mvcc.cc:205] Tried to move back new op lower bound from 7316277620667289600 to 7316277620448870400. Current Snapshot: MvccSnapshot[applied={T|T < 7316277620667289600}]
I20260808 14:49:51.013182 29350 mvcc.cc:205] Tried to move back new op lower bound from 7316277620667289600 to 7316277620448870400. Current Snapshot: MvccSnapshot[applied={T|T < 7316277620667289600}]
I20260808 14:49:51.027585 28752 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52516:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:49:51.028123 28752 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52516:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:49:51.032510 28752 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 8396b7aa47d74e64ae248bd64e44ac98: Sending DeleteTablet for 3 replicas of tablet ce7a8eb31dbc4186ae3f505fbd10fbcd
I20260808 14:49:51.033950 29233 tablet_service.cc:1514] Processing DeleteTablet for tablet ce7a8eb31dbc4186ae3f505fbd10fbcd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:49:51 UTC) from {username='kudu', principal='kudu/127.26.206.254@KRBTEST.COM'} at 127.0.0.1:47044
I20260808 14:49:51.034157 28913 tablet_service.cc:1514] Processing DeleteTablet for tablet ce7a8eb31dbc4186ae3f505fbd10fbcd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:49:51 UTC) from {username='kudu', principal='kudu/127.26.206.254@KRBTEST.COM'} at 127.0.0.1:52448
I20260808 14:49:51.035998 29080 tablet_service.cc:1514] Processing DeleteTablet for tablet ce7a8eb31dbc4186ae3f505fbd10fbcd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:49:51 UTC) from {username='kudu', principal='kudu/127.26.206.254@KRBTEST.COM'} at 127.0.0.1:41402
I20260808 14:49:51.038564 28752 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52516:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:49:51.039245 28752 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:49:51.046767 29358 tablet_replica.cc:330] T ce7a8eb31dbc4186ae3f505fbd10fbcd P a1656fcf3d624257bff2de727b498722: stopping tablet replica
I20260808 14:49:51.048233 29079 tablet_service.cc:1467] Processing CreateTablet for tablet 9fafd344985c48b09b9b76a7f1c4cbf4 (DEFAULT_TABLE table=test-table [id=a2323b68d5484db7b105514279c0b71b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:49:51.048902 29079 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9fafd344985c48b09b9b76a7f1c4cbf4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:49:51.049448 29233 tablet_service.cc:1467] Processing CreateTablet for tablet 9fafd344985c48b09b9b76a7f1c4cbf4 (DEFAULT_TABLE table=test-table [id=a2323b68d5484db7b105514279c0b71b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:49:51.050112 29233 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9fafd344985c48b09b9b76a7f1c4cbf4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:49:51.052026 28911 tablet_service.cc:1467] Processing CreateTablet for tablet 9fafd344985c48b09b9b76a7f1c4cbf4 (DEFAULT_TABLE table=test-table [id=a2323b68d5484db7b105514279c0b71b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:49:51.052716 28911 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9fafd344985c48b09b9b76a7f1c4cbf4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:49:51.056941 29332 tablet_bootstrap.cc:492] T 9fafd344985c48b09b9b76a7f1c4cbf4 P 19b3f51d4a94491fb48f34684520859d: Bootstrap starting.
I20260808 14:49:51.057371 29358 raft_consensus.cc:2229] T ce7a8eb31dbc4186ae3f505fbd10fbcd P a1656fcf3d624257bff2de727b498722 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:49:51.057996 29358 raft_consensus.cc:2258] T ce7a8eb31dbc4186ae3f505fbd10fbcd P a1656fcf3d624257bff2de727b498722 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:49:51.058806 29332 tablet_bootstrap.cc:654] T 9fafd344985c48b09b9b76a7f1c4cbf4 P 19b3f51d4a94491fb48f34684520859d: Neither blocks nor log segments found. Creating new log.
I20260808 14:49:51.060536 29334 tablet_bootstrap.cc:492] T 9fafd344985c48b09b9b76a7f1c4cbf4 P 10eaeff5663d4d269cdc8254e98417f1: Bootstrap starting.
I20260808 14:49:51.061264 29360 tablet_replica.cc:330] T ce7a8eb31dbc4186ae3f505fbd10fbcd P 19b3f51d4a94491fb48f34684520859d: stopping tablet replica
I20260808 14:49:51.061316 29359 tablet_replica.cc:330] T ce7a8eb31dbc4186ae3f505fbd10fbcd P 10eaeff5663d4d269cdc8254e98417f1: stopping tablet replica
I20260808 14:49:51.062297 29358 ts_tablet_manager.cc:1905] T ce7a8eb31dbc4186ae3f505fbd10fbcd P a1656fcf3d624257bff2de727b498722: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:49:51.062446 29334 tablet_bootstrap.cc:654] T 9fafd344985c48b09b9b76a7f1c4cbf4 P 10eaeff5663d4d269cdc8254e98417f1: Neither blocks nor log segments found. Creating new log.
I20260808 14:49:51.062839 29360 raft_consensus.cc:2229] T ce7a8eb31dbc4186ae3f505fbd10fbcd P 19b3f51d4a94491fb48f34684520859d [term 1 LEADER]: Raft consensus shutting down.
I20260808 14:49:51.061862 29359 raft_consensus.cc:2229] T ce7a8eb31dbc4186ae3f505fbd10fbcd P 10eaeff5663d4d269cdc8254e98417f1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:49:51.063601 29359 raft_consensus.cc:2258] T ce7a8eb31dbc4186ae3f505fbd10fbcd P 10eaeff5663d4d269cdc8254e98417f1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:49:51.067333 29360 raft_consensus.cc:2258] T ce7a8eb31dbc4186ae3f505fbd10fbcd P 19b3f51d4a94491fb48f34684520859d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:49:51.068087 29359 ts_tablet_manager.cc:1905] T ce7a8eb31dbc4186ae3f505fbd10fbcd P 10eaeff5663d4d269cdc8254e98417f1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:49:51.076869 29359 ts_tablet_manager.cc:1918] T ce7a8eb31dbc4186ae3f505fbd10fbcd P 10eaeff5663d4d269cdc8254e98417f1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:49:51.077149 29359 log.cc:1196] T ce7a8eb31dbc4186ae3f505fbd10fbcd P 10eaeff5663d4d269cdc8254e98417f1: Deleting WAL directory at /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200577490656-27451-0/minicluster-data/ts-0/wal/wals/ce7a8eb31dbc4186ae3f505fbd10fbcd
I20260808 14:49:51.077798 29359 ts_tablet_manager.cc:1939] T ce7a8eb31dbc4186ae3f505fbd10fbcd P 10eaeff5663d4d269cdc8254e98417f1: Deleting consensus metadata
I20260808 14:49:51.078223 29333 tablet_bootstrap.cc:492] T 9fafd344985c48b09b9b76a7f1c4cbf4 P a1656fcf3d624257bff2de727b498722: Bootstrap starting.
I20260808 14:49:51.079802 28740 catalog_manager.cc:4841] TS 10eaeff5663d4d269cdc8254e98417f1 (127.26.206.193:37879): tablet ce7a8eb31dbc4186ae3f505fbd10fbcd (table test-table [id=ea833e7522e2424a862c9fe26f95cef6]) successfully deleted
I20260808 14:49:51.080659 29333 tablet_bootstrap.cc:654] T 9fafd344985c48b09b9b76a7f1c4cbf4 P a1656fcf3d624257bff2de727b498722: Neither blocks nor log segments found. Creating new log.
I20260808 14:49:51.081413 29334 tablet_bootstrap.cc:492] T 9fafd344985c48b09b9b76a7f1c4cbf4 P 10eaeff5663d4d269cdc8254e98417f1: No bootstrap required, opened a new log
I20260808 14:49:51.081547 29334 ts_tablet_manager.cc:1397] T 9fafd344985c48b09b9b76a7f1c4cbf4 P 10eaeff5663d4d269cdc8254e98417f1: Time spent bootstrapping tablet: real 0.021s user 0.003s sys 0.004s
I20260808 14:49:51.082348 29334 raft_consensus.cc:348] T 9fafd344985c48b09b9b76a7f1c4cbf4 P 10eaeff5663d4d269cdc8254e98417f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10eaeff5663d4d269cdc8254e98417f1" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 37879 } } peers { permanent_uuid: "19b3f51d4a94491fb48f34684520859d" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 42635 } } peers { permanent_uuid: "a1656fcf3d624257bff2de727b498722" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 38159 } }
I20260808 14:49:51.082580 29334 raft_consensus.cc:374] T 9fafd344985c48b09b9b76a7f1c4cbf4 P 10eaeff5663d4d269cdc8254e98417f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:49:51.082708 29334 raft_consensus.cc:729] T 9fafd344985c48b09b9b76a7f1c4cbf4 P 10eaeff5663d4d269cdc8254e98417f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10eaeff5663d4d269cdc8254e98417f1, State: Initialized, Role: FOLLOWER
I20260808 14:49:51.083089 29334 consensus_queue.cc:260] T 9fafd344985c48b09b9b76a7f1c4cbf4 P 10eaeff5663d4d269cdc8254e98417f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10eaeff5663d4d269cdc8254e98417f1" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 37879 } } peers { permanent_uuid: "19b3f51d4a94491fb48f34684520859d" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 42635 } } peers { permanent_uuid: "a1656fcf3d624257bff2de727b498722" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 38159 } }
I20260808 14:49:51.085817 29360 ts_tablet_manager.cc:1905] T ce7a8eb31dbc4186ae3f505fbd10fbcd P 19b3f51d4a94491fb48f34684520859d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:49:51.086001 29334 ts_tablet_manager.cc:1428] T 9fafd344985c48b09b9b76a7f1c4cbf4 P 10eaeff5663d4d269cdc8254e98417f1: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260808 14:49:51.090817 29332 tablet_bootstrap.cc:492] T 9fafd344985c48b09b9b76a7f1c4cbf4 P 19b3f51d4a94491fb48f34684520859d: No bootstrap required, opened a new log
I20260808 14:49:51.091020 29332 ts_tablet_manager.cc:1397] T 9fafd344985c48b09b9b76a7f1c4cbf4 P 19b3f51d4a94491fb48f34684520859d: Time spent bootstrapping tablet: real 0.034s user 0.017s sys 0.016s
I20260808 14:49:51.091287 29358 ts_tablet_manager.cc:1918] T ce7a8eb31dbc4186ae3f505fbd10fbcd P a1656fcf3d624257bff2de727b498722: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:49:51.091459 29358 log.cc:1196] T ce7a8eb31dbc4186ae3f505fbd10fbcd P a1656fcf3d624257bff2de727b498722: Deleting WAL directory at /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200577490656-27451-0/minicluster-data/ts-2/wal/wals/ce7a8eb31dbc4186ae3f505fbd10fbcd
I20260808 14:49:51.092087 29358 ts_tablet_manager.cc:1939] T ce7a8eb31dbc4186ae3f505fbd10fbcd P a1656fcf3d624257bff2de727b498722: Deleting consensus metadata
I20260808 14:49:51.092165 29332 raft_consensus.cc:348] T 9fafd344985c48b09b9b76a7f1c4cbf4 P 19b3f51d4a94491fb48f34684520859d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10eaeff5663d4d269cdc8254e98417f1" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 37879 } } peers { permanent_uuid: "19b3f51d4a94491fb48f34684520859d" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 42635 } } peers { permanent_uuid: "a1656fcf3d624257bff2de727b498722" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 38159 } }
I20260808 14:49:51.092444 29332 raft_consensus.cc:374] T 9fafd344985c48b09b9b76a7f1c4cbf4 P 19b3f51d4a94491fb48f34684520859d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:49:51.092552 29332 raft_consensus.cc:729] T 9fafd344985c48b09b9b76a7f1c4cbf4 P 19b3f51d4a94491fb48f34684520859d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19b3f51d4a94491fb48f34684520859d, State: Initialized, Role: FOLLOWER
I20260808 14:49:51.093959 29333 tablet_bootstrap.cc:492] T 9fafd344985c48b09b9b76a7f1c4cbf4 P a1656fcf3d624257bff2de727b498722: No bootstrap required, opened a new log
I20260808 14:49:51.094026 28737 catalog_manager.cc:4841] TS a1656fcf3d624257bff2de727b498722 (127.26.206.195:38159): tablet ce7a8eb31dbc4186ae3f505fbd10fbcd (table test-table [id=ea833e7522e2424a862c9fe26f95cef6]) successfully deleted
I20260808 14:49:51.094125 29333 ts_tablet_manager.cc:1397] T 9fafd344985c48b09b9b76a7f1c4cbf4 P a1656fcf3d624257bff2de727b498722: Time spent bootstrapping tablet: real 0.016s user 0.009s sys 0.000s
I20260808 14:49:51.093987 29332 consensus_queue.cc:260] T 9fafd344985c48b09b9b76a7f1c4cbf4 P 19b3f51d4a94491fb48f34684520859d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10eaeff5663d4d269cdc8254e98417f1" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 37879 } } peers { permanent_uuid: "19b3f51d4a94491fb48f34684520859d" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 42635 } } peers { permanent_uuid: "a1656fcf3d624257bff2de727b498722" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 38159 } }
I20260808 14:49:51.094607 29332 ts_tablet_manager.cc:1428] T 9fafd344985c48b09b9b76a7f1c4cbf4 P 19b3f51d4a94491fb48f34684520859d: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260808 14:49:51.095149 29333 raft_consensus.cc:348] T 9fafd344985c48b09b9b76a7f1c4cbf4 P a1656fcf3d624257bff2de727b498722 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10eaeff5663d4d269cdc8254e98417f1" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 37879 } } peers { permanent_uuid: "19b3f51d4a94491fb48f34684520859d" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 42635 } } peers { permanent_uuid: "a1656fcf3d624257bff2de727b498722" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 38159 } }
I20260808 14:49:51.095399 29333 raft_consensus.cc:374] T 9fafd344985c48b09b9b76a7f1c4cbf4 P a1656fcf3d624257bff2de727b498722 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:49:51.095522 29333 raft_consensus.cc:729] T 9fafd344985c48b09b9b76a7f1c4cbf4 P a1656fcf3d624257bff2de727b498722 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1656fcf3d624257bff2de727b498722, State: Initialized, Role: FOLLOWER
I20260808 14:49:51.095842 29333 consensus_queue.cc:260] T 9fafd344985c48b09b9b76a7f1c4cbf4 P a1656fcf3d624257bff2de727b498722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10eaeff5663d4d269cdc8254e98417f1" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 37879 } } peers { permanent_uuid: "19b3f51d4a94491fb48f34684520859d" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 42635 } } peers { permanent_uuid: "a1656fcf3d624257bff2de727b498722" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 38159 } }
I20260808 14:49:51.096458 29333 ts_tablet_manager.cc:1428] T 9fafd344985c48b09b9b76a7f1c4cbf4 P a1656fcf3d624257bff2de727b498722: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 14:49:51.099159 29360 ts_tablet_manager.cc:1918] T ce7a8eb31dbc4186ae3f505fbd10fbcd P 19b3f51d4a94491fb48f34684520859d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:49:51.099363 29360 log.cc:1196] T ce7a8eb31dbc4186ae3f505fbd10fbcd P 19b3f51d4a94491fb48f34684520859d: Deleting WAL directory at /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200577490656-27451-0/minicluster-data/ts-1/wal/wals/ce7a8eb31dbc4186ae3f505fbd10fbcd
I20260808 14:49:51.100039 29360 ts_tablet_manager.cc:1939] T ce7a8eb31dbc4186ae3f505fbd10fbcd P 19b3f51d4a94491fb48f34684520859d: Deleting consensus metadata
I20260808 14:49:51.101850 28740 catalog_manager.cc:4841] TS 19b3f51d4a94491fb48f34684520859d (127.26.206.194:42635): tablet ce7a8eb31dbc4186ae3f505fbd10fbcd (table test-table [id=ea833e7522e2424a862c9fe26f95cef6]) successfully deleted
I20260808 14:49:51.271608 29339 raft_consensus.cc:482] T 9fafd344985c48b09b9b76a7f1c4cbf4 P 10eaeff5663d4d269cdc8254e98417f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:49:51.271911 29339 raft_consensus.cc:504] T 9fafd344985c48b09b9b76a7f1c4cbf4 P 10eaeff5663d4d269cdc8254e98417f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10eaeff5663d4d269cdc8254e98417f1" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 37879 } } peers { permanent_uuid: "19b3f51d4a94491fb48f34684520859d" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 42635 } } peers { permanent_uuid: "a1656fcf3d624257bff2de727b498722" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 38159 } }
I20260808 14:49:51.273937 29339 leader_election.cc:288] T 9fafd344985c48b09b9b76a7f1c4cbf4 P 10eaeff5663d4d269cdc8254e98417f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 19b3f51d4a94491fb48f34684520859d (127.26.206.194:42635), a1656fcf3d624257bff2de727b498722 (127.26.206.195:38159)
I20260808 14:49:51.282665 29328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:51.274970 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.193:33637 (local address 127.26.206.195:38159)
0808 14:49:51.275146 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:51.275152 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:51.276305 (+ 1153us) server_negotiation.cc:407] Connection header received
0808 14:49:51.276498 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:51.276505 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:51.276577 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:51.276627 (+ 50us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:49:51.277406 (+ 779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:51.278588 (+ 1182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:51.280939 (+ 2351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:51.281681 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:51.281863 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:51.281938 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:51.282204 (+ 266us) server_negotiation.cc:299] Negotiation successful
0808 14:49:51.282378 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260808 14:49:51.282783 29366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:51.274333 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.195:38159 (local address 127.26.206.193:33637)
0808 14:49:51.276185 (+ 1852us) negotiation.cc:107] Waiting for socket to connect
0808 14:49:51.276203 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 14:49:51.276328 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:49:51.276802 (+ 474us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:49:51.276805 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:49:51.276824 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:49:51.277212 (+ 388us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:51.277223 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:51.278728 (+ 1505us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:51.278735 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:51.280802 (+ 2067us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:51.280811 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:51.281893 (+ 1082us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:51.281899 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:51.282054 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:51.282076 (+ 22us) client_negotiation.cc:769] Sending connection context
0808 14:49:51.282179 (+ 103us) client_negotiation.cc:240] Negotiation successful
0808 14:49:51.282362 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1725,"thread_start_us":1051,"threads_started":1}
I20260808 14:49:51.283741 29261 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9fafd344985c48b09b9b76a7f1c4cbf4" candidate_uuid: "10eaeff5663d4d269cdc8254e98417f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1656fcf3d624257bff2de727b498722" is_pre_election: true
I20260808 14:49:51.284071 29327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:51.274591 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.193:45409 (local address 127.26.206.194:42635)
0808 14:49:51.274784 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:51.274791 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:51.275842 (+ 1051us) server_negotiation.cc:407] Connection header received
0808 14:49:51.276152 (+ 310us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:51.276160 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:51.276256 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:51.276359 (+ 103us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:49:51.276998 (+ 639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:51.278095 (+ 1097us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:51.280748 (+ 2653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:51.282163 (+ 1415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:51.282359 (+ 196us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:51.282428 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:51.283500 (+ 1072us) server_negotiation.cc:299] Negotiation successful
0808 14:49:51.283706 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260808 14:49:51.284072 29261 raft_consensus.cc:2454] T 9fafd344985c48b09b9b76a7f1c4cbf4 P a1656fcf3d624257bff2de727b498722 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10eaeff5663d4d269cdc8254e98417f1 in term 0.
I20260808 14:49:51.284679 28852 leader_election.cc:302] T 9fafd344985c48b09b9b76a7f1c4cbf4 P 10eaeff5663d4d269cdc8254e98417f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10eaeff5663d4d269cdc8254e98417f1, a1656fcf3d624257bff2de727b498722; no voters:
I20260808 14:49:51.285058 29367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:51.274265 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.194:42635 (local address 127.26.206.193:45409)
0808 14:49:51.275719 (+ 1454us) negotiation.cc:107] Waiting for socket to connect
0808 14:49:51.275741 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 14:49:51.275968 (+ 227us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:49:51.276400 (+ 432us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:49:51.276405 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:49:51.276433 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:49:51.276812 (+ 379us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:51.276823 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:51.278223 (+ 1400us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:51.278230 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:51.280575 (+ 2345us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:51.280590 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:51.282657 (+ 2067us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:51.282664 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:51.283265 (+ 601us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:51.283307 (+ 42us) client_negotiation.cc:769] Sending connection context
0808 14:49:51.284371 (+ 1064us) client_negotiation.cc:240] Negotiation successful
0808 14:49:51.284547 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1295,"thread_start_us":1561,"threads_started":1}
I20260808 14:49:51.285137 29339 raft_consensus.cc:2781] T 9fafd344985c48b09b9b76a7f1c4cbf4 P 10eaeff5663d4d269cdc8254e98417f1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:49:51.285281 29339 raft_consensus.cc:482] T 9fafd344985c48b09b9b76a7f1c4cbf4 P 10eaeff5663d4d269cdc8254e98417f1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:49:51.285467 29339 raft_consensus.cc:3037] T 9fafd344985c48b09b9b76a7f1c4cbf4 P 10eaeff5663d4d269cdc8254e98417f1 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:49:51.287909 29339 raft_consensus.cc:504] T 9fafd344985c48b09b9b76a7f1c4cbf4 P 10eaeff5663d4d269cdc8254e98417f1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10eaeff5663d4d269cdc8254e98417f1" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 37879 } } peers { permanent_uuid: "19b3f51d4a94491fb48f34684520859d" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 42635 } } peers { permanent_uuid: "a1656fcf3d624257bff2de727b498722" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 38159 } }
I20260808 14:49:51.288753 29339 leader_election.cc:288] T 9fafd344985c48b09b9b76a7f1c4cbf4 P 10eaeff5663d4d269cdc8254e98417f1 [CANDIDATE]: Term 1 election: Requested vote from peers 19b3f51d4a94491fb48f34684520859d (127.26.206.194:42635), a1656fcf3d624257bff2de727b498722 (127.26.206.195:38159)
I20260808 14:49:51.289083 29101 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9fafd344985c48b09b9b76a7f1c4cbf4" candidate_uuid: "10eaeff5663d4d269cdc8254e98417f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19b3f51d4a94491fb48f34684520859d" is_pre_election: true
I20260808 14:49:51.289412 29261 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9fafd344985c48b09b9b76a7f1c4cbf4" candidate_uuid: "10eaeff5663d4d269cdc8254e98417f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1656fcf3d624257bff2de727b498722"
I20260808 14:49:51.289299 29100 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9fafd344985c48b09b9b76a7f1c4cbf4" candidate_uuid: "10eaeff5663d4d269cdc8254e98417f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19b3f51d4a94491fb48f34684520859d"
I20260808 14:49:51.289634 29261 raft_consensus.cc:3037] T 9fafd344985c48b09b9b76a7f1c4cbf4 P a1656fcf3d624257bff2de727b498722 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:49:51.289722 29101 raft_consensus.cc:2454] T 9fafd344985c48b09b9b76a7f1c4cbf4 P 19b3f51d4a94491fb48f34684520859d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10eaeff5663d4d269cdc8254e98417f1 in term 0.
I20260808 14:49:51.293145 29261 raft_consensus.cc:2454] T 9fafd344985c48b09b9b76a7f1c4cbf4 P a1656fcf3d624257bff2de727b498722 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10eaeff5663d4d269cdc8254e98417f1 in term 1.
I20260808 14:49:51.293566 28852 leader_election.cc:302] T 9fafd344985c48b09b9b76a7f1c4cbf4 P 10eaeff5663d4d269cdc8254e98417f1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10eaeff5663d4d269cdc8254e98417f1, a1656fcf3d624257bff2de727b498722; no voters: 19b3f51d4a94491fb48f34684520859d
I20260808 14:49:51.293886 29339 raft_consensus.cc:2781] T 9fafd344985c48b09b9b76a7f1c4cbf4 P 10eaeff5663d4d269cdc8254e98417f1 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:49:51.299086 29339 raft_consensus.cc:686] T 9fafd344985c48b09b9b76a7f1c4cbf4 P 10eaeff5663d4d269cdc8254e98417f1 [term 1 LEADER]: Becoming Leader. State: Replica: 10eaeff5663d4d269cdc8254e98417f1, State: Running, Role: LEADER
I20260808 14:49:51.299589 29339 consensus_queue.cc:237] T 9fafd344985c48b09b9b76a7f1c4cbf4 P 10eaeff5663d4d269cdc8254e98417f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10eaeff5663d4d269cdc8254e98417f1" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 37879 } } peers { permanent_uuid: "19b3f51d4a94491fb48f34684520859d" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 42635 } } peers { permanent_uuid: "a1656fcf3d624257bff2de727b498722" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 38159 } }
I20260808 14:49:51.303122 28754 catalog_manager.cc:5495] T 9fafd344985c48b09b9b76a7f1c4cbf4 P 10eaeff5663d4d269cdc8254e98417f1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 10eaeff5663d4d269cdc8254e98417f1 (127.26.206.193). New cstate: current_term: 1 leader_uuid: "10eaeff5663d4d269cdc8254e98417f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10eaeff5663d4d269cdc8254e98417f1" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 37879 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19b3f51d4a94491fb48f34684520859d" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 42635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1656fcf3d624257bff2de727b498722" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 38159 } health_report { overall_health: UNKNOWN } } }
Aug 08 14:49:51 dist-test-slave-6k22 krb5kdc[28704](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200588, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.254@KRBTEST.COM for kudu/127.26.206.254@KRBTEST.COM
I20260808 14:49:51.402817 29375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:51.386121 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:35549 (local address 127.0.0.1:52520)
0808 14:49:51.387117 (+ 996us) negotiation.cc:107] Waiting for socket to connect
0808 14:49:51.387133 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 14:49:51.387258 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:49:51.387777 (+ 519us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:49:51.387781 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:49:51.388464 (+ 683us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:49:51.388677 (+ 213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:51.388686 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:51.390180 (+ 1494us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:51.390184 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:51.391244 (+ 1060us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:51.391255 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:51.392284 (+ 1029us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:51.392288 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:51.392436 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:51.393176 (+ 740us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:49:51.393201 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:49:51.395751 (+ 2550us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:49:51.399891 (+ 4140us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:49:51.399901 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:49:51.399907 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:49:51.400391 (+ 484us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:49:51.400851 (+ 460us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:49:51.400855 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:49:51.400857 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:49:51.400986 (+ 129us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:49:51.401744 (+ 758us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:49:51.401750 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:49:51.401891 (+ 141us) client_negotiation.cc:769] Sending connection context
0808 14:49:51.402061 (+ 170us) client_negotiation.cc:240] Negotiation successful
0808 14:49:51.402368 (+ 307us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":865,"thread_start_us":691,"threads_started":1}
I20260808 14:49:51.402896 29376 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:51.386174 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52520 (local address 127.26.206.254:35549)
0808 14:49:51.386855 (+ 681us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:51.386864 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:51.387229 (+ 365us) server_negotiation.cc:407] Connection header received
0808 14:49:51.387424 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:51.387430 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:51.387529 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:51.387758 (+ 229us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:51.388829 (+ 1071us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:51.390035 (+ 1206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:51.391388 (+ 1353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:51.392113 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:51.392267 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:51.395973 (+ 3706us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:49:51.395981 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:49:51.395986 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:49:51.396023 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:49:51.399767 (+ 3744us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:51.400528 (+ 761us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:51.400537 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:51.400541 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:51.400729 (+ 188us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:51.401098 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:51.401103 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:51.401106 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:51.401608 (+ 502us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:49:51.401775 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:51.402181 (+ 406us) server_negotiation.cc:299] Negotiation successful
0808 14:49:51.402511 (+ 330us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":122,"server-negotiator.queue_time_us":493,"thread_start_us":333,"threads_started":1}
I20260808 14:49:51.408418 28754 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.26.206.254@KRBTEST.COM'} at 127.0.0.1:52520:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260808 14:49:51.409605 28754 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:49:51.416519 28911 tablet_service.cc:1467] Processing CreateTablet for tablet 0e9cdf81e2524585a257bcc45d995c86 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=6a0be41ef7c84ee5ac7d28ee8ba95459]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 14:49:51.416981 28911 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0e9cdf81e2524585a257bcc45d995c86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:49:51.417068 29233 tablet_service.cc:1467] Processing CreateTablet for tablet 0e9cdf81e2524585a257bcc45d995c86 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=6a0be41ef7c84ee5ac7d28ee8ba95459]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 14:49:51.417631 29233 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0e9cdf81e2524585a257bcc45d995c86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:49:51.419549 29080 tablet_service.cc:1467] Processing CreateTablet for tablet 0e9cdf81e2524585a257bcc45d995c86 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=6a0be41ef7c84ee5ac7d28ee8ba95459]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 14:49:51.420140 29080 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0e9cdf81e2524585a257bcc45d995c86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:49:51.424456 29334 tablet_bootstrap.cc:492] T 0e9cdf81e2524585a257bcc45d995c86 P 10eaeff5663d4d269cdc8254e98417f1: Bootstrap starting.
I20260808 14:49:51.426299 29334 tablet_bootstrap.cc:654] T 0e9cdf81e2524585a257bcc45d995c86 P 10eaeff5663d4d269cdc8254e98417f1: Neither blocks nor log segments found. Creating new log.
I20260808 14:49:51.427632 29333 tablet_bootstrap.cc:492] T 0e9cdf81e2524585a257bcc45d995c86 P a1656fcf3d624257bff2de727b498722: Bootstrap starting.
I20260808 14:49:51.428148 29332 tablet_bootstrap.cc:492] T 0e9cdf81e2524585a257bcc45d995c86 P 19b3f51d4a94491fb48f34684520859d: Bootstrap starting.
I20260808 14:49:51.429406 29333 tablet_bootstrap.cc:654] T 0e9cdf81e2524585a257bcc45d995c86 P a1656fcf3d624257bff2de727b498722: Neither blocks nor log segments found. Creating new log.
I20260808 14:49:51.429991 29332 tablet_bootstrap.cc:654] T 0e9cdf81e2524585a257bcc45d995c86 P 19b3f51d4a94491fb48f34684520859d: Neither blocks nor log segments found. Creating new log.
I20260808 14:49:51.430392 29334 tablet_bootstrap.cc:492] T 0e9cdf81e2524585a257bcc45d995c86 P 10eaeff5663d4d269cdc8254e98417f1: No bootstrap required, opened a new log
I20260808 14:49:51.430609 29334 ts_tablet_manager.cc:1397] T 0e9cdf81e2524585a257bcc45d995c86 P 10eaeff5663d4d269cdc8254e98417f1: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.005s
I20260808 14:49:51.431581 29334 raft_consensus.cc:348] T 0e9cdf81e2524585a257bcc45d995c86 P 10eaeff5663d4d269cdc8254e98417f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10eaeff5663d4d269cdc8254e98417f1" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 37879 } } peers { permanent_uuid: "19b3f51d4a94491fb48f34684520859d" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 42635 } } peers { permanent_uuid: "a1656fcf3d624257bff2de727b498722" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 38159 } }
I20260808 14:49:51.431995 29334 raft_consensus.cc:374] T 0e9cdf81e2524585a257bcc45d995c86 P 10eaeff5663d4d269cdc8254e98417f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:49:51.432137 29334 raft_consensus.cc:729] T 0e9cdf81e2524585a257bcc45d995c86 P 10eaeff5663d4d269cdc8254e98417f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10eaeff5663d4d269cdc8254e98417f1, State: Initialized, Role: FOLLOWER
I20260808 14:49:51.432554 29334 consensus_queue.cc:260] T 0e9cdf81e2524585a257bcc45d995c86 P 10eaeff5663d4d269cdc8254e98417f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10eaeff5663d4d269cdc8254e98417f1" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 37879 } } peers { permanent_uuid: "19b3f51d4a94491fb48f34684520859d" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 42635 } } peers { permanent_uuid: "a1656fcf3d624257bff2de727b498722" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 38159 } }
I20260808 14:49:51.433185 29339 tablet_replica.cc:439] T 0e9cdf81e2524585a257bcc45d995c86 P 10eaeff5663d4d269cdc8254e98417f1: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10eaeff5663d4d269cdc8254e98417f1" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 37879 } } peers { permanent_uuid: "19b3f51d4a94491fb48f34684520859d" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 42635 } } peers { permanent_uuid: "a1656fcf3d624257bff2de727b498722" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 38159 } } }
I20260808 14:49:51.433475 29339 tablet_replica.cc:442] T 0e9cdf81e2524585a257bcc45d995c86 P 10eaeff5663d4d269cdc8254e98417f1: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 14:49:51.437520 29334 ts_tablet_manager.cc:1428] T 0e9cdf81e2524585a257bcc45d995c86 P 10eaeff5663d4d269cdc8254e98417f1: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260808 14:49:51.442432 29332 tablet_bootstrap.cc:492] T 0e9cdf81e2524585a257bcc45d995c86 P 19b3f51d4a94491fb48f34684520859d: No bootstrap required, opened a new log
I20260808 14:49:51.442663 29332 ts_tablet_manager.cc:1397] T 0e9cdf81e2524585a257bcc45d995c86 P 19b3f51d4a94491fb48f34684520859d: Time spent bootstrapping tablet: real 0.015s user 0.001s sys 0.011s
I20260808 14:49:51.443459 29332 raft_consensus.cc:348] T 0e9cdf81e2524585a257bcc45d995c86 P 19b3f51d4a94491fb48f34684520859d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10eaeff5663d4d269cdc8254e98417f1" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 37879 } } peers { permanent_uuid: "19b3f51d4a94491fb48f34684520859d" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 42635 } } peers { permanent_uuid: "a1656fcf3d624257bff2de727b498722" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 38159 } }
I20260808 14:49:51.443817 29332 raft_consensus.cc:374] T 0e9cdf81e2524585a257bcc45d995c86 P 19b3f51d4a94491fb48f34684520859d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:49:51.443912 29332 raft_consensus.cc:729] T 0e9cdf81e2524585a257bcc45d995c86 P 19b3f51d4a94491fb48f34684520859d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19b3f51d4a94491fb48f34684520859d, State: Initialized, Role: FOLLOWER
I20260808 14:49:51.444203 29332 consensus_queue.cc:260] T 0e9cdf81e2524585a257bcc45d995c86 P 19b3f51d4a94491fb48f34684520859d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10eaeff5663d4d269cdc8254e98417f1" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 37879 } } peers { permanent_uuid: "19b3f51d4a94491fb48f34684520859d" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 42635 } } peers { permanent_uuid: "a1656fcf3d624257bff2de727b498722" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 38159 } }
I20260808 14:49:51.444402 29333 tablet_bootstrap.cc:492] T 0e9cdf81e2524585a257bcc45d995c86 P a1656fcf3d624257bff2de727b498722: No bootstrap required, opened a new log
I20260808 14:49:51.444579 29333 ts_tablet_manager.cc:1397] T 0e9cdf81e2524585a257bcc45d995c86 P a1656fcf3d624257bff2de727b498722: Time spent bootstrapping tablet: real 0.017s user 0.003s sys 0.011s
I20260808 14:49:51.444693 29344 tablet_replica.cc:439] T 0e9cdf81e2524585a257bcc45d995c86 P 19b3f51d4a94491fb48f34684520859d: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10eaeff5663d4d269cdc8254e98417f1" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 37879 } } peers { permanent_uuid: "19b3f51d4a94491fb48f34684520859d" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 42635 } } peers { permanent_uuid: "a1656fcf3d624257bff2de727b498722" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 38159 } } }
I20260808 14:49:51.445044 29344 tablet_replica.cc:442] T 0e9cdf81e2524585a257bcc45d995c86 P 19b3f51d4a94491fb48f34684520859d: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 14:49:51.445403 29333 raft_consensus.cc:348] T 0e9cdf81e2524585a257bcc45d995c86 P a1656fcf3d624257bff2de727b498722 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10eaeff5663d4d269cdc8254e98417f1" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 37879 } } peers { permanent_uuid: "19b3f51d4a94491fb48f34684520859d" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 42635 } } peers { permanent_uuid: "a1656fcf3d624257bff2de727b498722" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 38159 } }
I20260808 14:49:51.445683 29333 raft_consensus.cc:374] T 0e9cdf81e2524585a257bcc45d995c86 P a1656fcf3d624257bff2de727b498722 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:49:51.445731 29332 ts_tablet_manager.cc:1428] T 0e9cdf81e2524585a257bcc45d995c86 P 19b3f51d4a94491fb48f34684520859d: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260808 14:49:51.445765 29333 raft_consensus.cc:729] T 0e9cdf81e2524585a257bcc45d995c86 P a1656fcf3d624257bff2de727b498722 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1656fcf3d624257bff2de727b498722, State: Initialized, Role: FOLLOWER
I20260808 14:49:51.446029 29333 consensus_queue.cc:260] T 0e9cdf81e2524585a257bcc45d995c86 P a1656fcf3d624257bff2de727b498722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10eaeff5663d4d269cdc8254e98417f1" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 37879 } } peers { permanent_uuid: "19b3f51d4a94491fb48f34684520859d" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 42635 } } peers { permanent_uuid: "a1656fcf3d624257bff2de727b498722" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 38159 } }
I20260808 14:49:51.446749 29333 ts_tablet_manager.cc:1428] T 0e9cdf81e2524585a257bcc45d995c86 P a1656fcf3d624257bff2de727b498722: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260808 14:49:51.446583 29341 tablet_replica.cc:439] T 0e9cdf81e2524585a257bcc45d995c86 P a1656fcf3d624257bff2de727b498722: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10eaeff5663d4d269cdc8254e98417f1" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 37879 } } peers { permanent_uuid: "19b3f51d4a94491fb48f34684520859d" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 42635 } } peers { permanent_uuid: "a1656fcf3d624257bff2de727b498722" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 38159 } } }
I20260808 14:49:51.446972 29341 tablet_replica.cc:442] T 0e9cdf81e2524585a257bcc45d995c86 P a1656fcf3d624257bff2de727b498722: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 14:49:51.487447 29344 raft_consensus.cc:482] T 0e9cdf81e2524585a257bcc45d995c86 P 19b3f51d4a94491fb48f34684520859d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:49:51.487749 29344 raft_consensus.cc:504] T 0e9cdf81e2524585a257bcc45d995c86 P 19b3f51d4a94491fb48f34684520859d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10eaeff5663d4d269cdc8254e98417f1" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 37879 } } peers { permanent_uuid: "19b3f51d4a94491fb48f34684520859d" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 42635 } } peers { permanent_uuid: "a1656fcf3d624257bff2de727b498722" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 38159 } }
I20260808 14:49:51.488471 29344 leader_election.cc:288] T 0e9cdf81e2524585a257bcc45d995c86 P 19b3f51d4a94491fb48f34684520859d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10eaeff5663d4d269cdc8254e98417f1 (127.26.206.193:37879), a1656fcf3d624257bff2de727b498722 (127.26.206.195:38159)
I20260808 14:49:51.489043 28941 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e9cdf81e2524585a257bcc45d995c86" candidate_uuid: "19b3f51d4a94491fb48f34684520859d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10eaeff5663d4d269cdc8254e98417f1" is_pre_election: true
I20260808 14:49:51.489099 29261 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e9cdf81e2524585a257bcc45d995c86" candidate_uuid: "19b3f51d4a94491fb48f34684520859d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1656fcf3d624257bff2de727b498722" is_pre_election: true
I20260808 14:49:51.489328 28941 raft_consensus.cc:2454] T 0e9cdf81e2524585a257bcc45d995c86 P 10eaeff5663d4d269cdc8254e98417f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19b3f51d4a94491fb48f34684520859d in term 0.
I20260808 14:49:51.489396 29261 raft_consensus.cc:2454] T 0e9cdf81e2524585a257bcc45d995c86 P a1656fcf3d624257bff2de727b498722 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19b3f51d4a94491fb48f34684520859d in term 0.
I20260808 14:49:51.489818 29022 leader_election.cc:302] T 0e9cdf81e2524585a257bcc45d995c86 P 19b3f51d4a94491fb48f34684520859d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10eaeff5663d4d269cdc8254e98417f1, 19b3f51d4a94491fb48f34684520859d; no voters:
I20260808 14:49:51.490118 29344 raft_consensus.cc:2781] T 0e9cdf81e2524585a257bcc45d995c86 P 19b3f51d4a94491fb48f34684520859d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:49:51.490267 29344 raft_consensus.cc:482] T 0e9cdf81e2524585a257bcc45d995c86 P 19b3f51d4a94491fb48f34684520859d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:49:51.490391 29344 raft_consensus.cc:3037] T 0e9cdf81e2524585a257bcc45d995c86 P 19b3f51d4a94491fb48f34684520859d [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:49:51.493158 29344 raft_consensus.cc:504] T 0e9cdf81e2524585a257bcc45d995c86 P 19b3f51d4a94491fb48f34684520859d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10eaeff5663d4d269cdc8254e98417f1" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 37879 } } peers { permanent_uuid: "19b3f51d4a94491fb48f34684520859d" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 42635 } } peers { permanent_uuid: "a1656fcf3d624257bff2de727b498722" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 38159 } }
I20260808 14:49:51.493794 29344 leader_election.cc:288] T 0e9cdf81e2524585a257bcc45d995c86 P 19b3f51d4a94491fb48f34684520859d [CANDIDATE]: Term 1 election: Requested vote from peers 10eaeff5663d4d269cdc8254e98417f1 (127.26.206.193:37879), a1656fcf3d624257bff2de727b498722 (127.26.206.195:38159)
I20260808 14:49:51.494226 29261 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e9cdf81e2524585a257bcc45d995c86" candidate_uuid: "19b3f51d4a94491fb48f34684520859d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1656fcf3d624257bff2de727b498722"
I20260808 14:49:51.494221 28941 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e9cdf81e2524585a257bcc45d995c86" candidate_uuid: "19b3f51d4a94491fb48f34684520859d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10eaeff5663d4d269cdc8254e98417f1"
I20260808 14:49:51.494408 28941 raft_consensus.cc:3037] T 0e9cdf81e2524585a257bcc45d995c86 P 10eaeff5663d4d269cdc8254e98417f1 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:49:51.494441 29261 raft_consensus.cc:3037] T 0e9cdf81e2524585a257bcc45d995c86 P a1656fcf3d624257bff2de727b498722 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:49:51.496618 29261 raft_consensus.cc:2454] T 0e9cdf81e2524585a257bcc45d995c86 P a1656fcf3d624257bff2de727b498722 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19b3f51d4a94491fb48f34684520859d in term 1.
I20260808 14:49:51.497054 29020 leader_election.cc:302] T 0e9cdf81e2524585a257bcc45d995c86 P 19b3f51d4a94491fb48f34684520859d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19b3f51d4a94491fb48f34684520859d, a1656fcf3d624257bff2de727b498722; no voters:
I20260808 14:49:51.497354 29344 raft_consensus.cc:2781] T 0e9cdf81e2524585a257bcc45d995c86 P 19b3f51d4a94491fb48f34684520859d [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:49:51.497609 28941 raft_consensus.cc:2454] T 0e9cdf81e2524585a257bcc45d995c86 P 10eaeff5663d4d269cdc8254e98417f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19b3f51d4a94491fb48f34684520859d in term 1.
I20260808 14:49:51.497524 29344 raft_consensus.cc:686] T 0e9cdf81e2524585a257bcc45d995c86 P 19b3f51d4a94491fb48f34684520859d [term 1 LEADER]: Becoming Leader. State: Replica: 19b3f51d4a94491fb48f34684520859d, State: Running, Role: LEADER
I20260808 14:49:51.498358 29344 consensus_queue.cc:237] T 0e9cdf81e2524585a257bcc45d995c86 P 19b3f51d4a94491fb48f34684520859d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10eaeff5663d4d269cdc8254e98417f1" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 37879 } } peers { permanent_uuid: "19b3f51d4a94491fb48f34684520859d" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 42635 } } peers { permanent_uuid: "a1656fcf3d624257bff2de727b498722" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 38159 } }
I20260808 14:49:51.500455 29340 tablet_replica.cc:439] T 0e9cdf81e2524585a257bcc45d995c86 P 19b3f51d4a94491fb48f34684520859d: TxnStatusTablet state changed. Reason: New leader 19b3f51d4a94491fb48f34684520859d. Latest consensus state: current_term: 1 leader_uuid: "19b3f51d4a94491fb48f34684520859d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10eaeff5663d4d269cdc8254e98417f1" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 37879 } } peers { permanent_uuid: "19b3f51d4a94491fb48f34684520859d" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 42635 } } peers { permanent_uuid: "a1656fcf3d624257bff2de727b498722" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 38159 } } }
I20260808 14:49:51.500758 29340 tablet_replica.cc:442] T 0e9cdf81e2524585a257bcc45d995c86 P 19b3f51d4a94491fb48f34684520859d: This TxnStatusTablet replica's current role is: LEADER
I20260808 14:49:51.501365 28753 catalog_manager.cc:5495] T 0e9cdf81e2524585a257bcc45d995c86 P 19b3f51d4a94491fb48f34684520859d reported cstate change: term changed from 0 to 1, leader changed from <none> to 19b3f51d4a94491fb48f34684520859d (127.26.206.194). New cstate: current_term: 1 leader_uuid: "19b3f51d4a94491fb48f34684520859d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10eaeff5663d4d269cdc8254e98417f1" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 37879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19b3f51d4a94491fb48f34684520859d" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 42635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1656fcf3d624257bff2de727b498722" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 38159 } health_report { overall_health: UNKNOWN } } }
I20260808 14:49:51.505016 29382 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260808 14:49:51.505429 29382 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260808 14:49:51.531611 29375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:51.526117 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.194:42635 (local address 127.0.0.1:41410)
0808 14:49:51.526388 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0808 14:49:51.526402 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 14:49:51.526516 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:49:51.526915 (+ 399us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:49:51.526918 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:49:51.526928 (+ 10us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 14:49:51.527069 (+ 141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:51.527075 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:51.528440 (+ 1365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:51.528443 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:51.529463 (+ 1020us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:51.529474 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:51.530446 (+ 972us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:51.530450 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:51.530596 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:51.530645 (+ 49us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 14:49:51.531110 (+ 465us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 14:49:51.531131 (+ 21us) client_negotiation.cc:769] Sending connection context
0808 14:49:51.531209 (+ 78us) client_negotiation.cc:240] Negotiation successful
0808 14:49:51.531327 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147}
I20260808 14:49:51.531639 29327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:51.526073 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41410 (local address 127.26.206.194:42635)
0808 14:49:51.526228 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:51.526232 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:51.526484 (+ 252us) server_negotiation.cc:407] Connection header received
0808 14:49:51.526673 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:51.526678 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:51.526761 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:51.526875 (+ 114us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:49:51.527184 (+ 309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:51.528318 (+ 1134us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:51.529603 (+ 1285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:51.530304 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:51.530433 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:51.530811 (+ 378us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:49:51.530964 (+ 153us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:49:51.531059 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:51.531253 (+ 194us) server_negotiation.cc:299] Negotiation successful
0808 14:49:51.531344 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260808 14:49:51.535660 28941 raft_consensus.cc:1261] T 0e9cdf81e2524585a257bcc45d995c86 P 10eaeff5663d4d269cdc8254e98417f1 [term 1 FOLLOWER]: Refusing update from remote peer 19b3f51d4a94491fb48f34684520859d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:49:51.535717 29261 raft_consensus.cc:1261] T 0e9cdf81e2524585a257bcc45d995c86 P a1656fcf3d624257bff2de727b498722 [term 1 FOLLOWER]: Refusing update from remote peer 19b3f51d4a94491fb48f34684520859d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:49:51.536288 29340 consensus_queue.cc:1035] T 0e9cdf81e2524585a257bcc45d995c86 P 19b3f51d4a94491fb48f34684520859d [LEADER]: Connected to new peer: Peer: permanent_uuid: "10eaeff5663d4d269cdc8254e98417f1" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 37879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:49:51.536791 29344 consensus_queue.cc:1035] T 0e9cdf81e2524585a257bcc45d995c86 P 19b3f51d4a94491fb48f34684520859d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1656fcf3d624257bff2de727b498722" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 38159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:49:51.540654 29341 tablet_replica.cc:439] T 0e9cdf81e2524585a257bcc45d995c86 P a1656fcf3d624257bff2de727b498722: TxnStatusTablet state changed. Reason: New leader 19b3f51d4a94491fb48f34684520859d. Latest consensus state: current_term: 1 leader_uuid: "19b3f51d4a94491fb48f34684520859d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10eaeff5663d4d269cdc8254e98417f1" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 37879 } } peers { permanent_uuid: "19b3f51d4a94491fb48f34684520859d" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 42635 } } peers { permanent_uuid: "a1656fcf3d624257bff2de727b498722" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 38159 } } }
I20260808 14:49:51.540952 29341 tablet_replica.cc:442] T 0e9cdf81e2524585a257bcc45d995c86 P a1656fcf3d624257bff2de727b498722: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 14:49:51.544405 29341 tablet_replica.cc:439] T 0e9cdf81e2524585a257bcc45d995c86 P a1656fcf3d624257bff2de727b498722: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "19b3f51d4a94491fb48f34684520859d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10eaeff5663d4d269cdc8254e98417f1" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 37879 } } peers { permanent_uuid: "19b3f51d4a94491fb48f34684520859d" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 42635 } } peers { permanent_uuid: "a1656fcf3d624257bff2de727b498722" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 38159 } } }
I20260808 14:49:51.544627 29341 tablet_replica.cc:442] T 0e9cdf81e2524585a257bcc45d995c86 P a1656fcf3d624257bff2de727b498722: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 14:49:51.548297 29340 tablet_replica.cc:439] T 0e9cdf81e2524585a257bcc45d995c86 P 19b3f51d4a94491fb48f34684520859d: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "19b3f51d4a94491fb48f34684520859d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10eaeff5663d4d269cdc8254e98417f1" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 37879 } } peers { permanent_uuid: "19b3f51d4a94491fb48f34684520859d" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 42635 } } peers { permanent_uuid: "a1656fcf3d624257bff2de727b498722" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 38159 } } }
I20260808 14:49:51.548594 29340 tablet_replica.cc:442] T 0e9cdf81e2524585a257bcc45d995c86 P 19b3f51d4a94491fb48f34684520859d: This TxnStatusTablet replica's current role is: LEADER
I20260808 14:49:51.555078 29339 tablet_replica.cc:439] T 0e9cdf81e2524585a257bcc45d995c86 P 10eaeff5663d4d269cdc8254e98417f1: TxnStatusTablet state changed. Reason: New leader 19b3f51d4a94491fb48f34684520859d. Latest consensus state: current_term: 1 leader_uuid: "19b3f51d4a94491fb48f34684520859d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10eaeff5663d4d269cdc8254e98417f1" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 37879 } } peers { permanent_uuid: "19b3f51d4a94491fb48f34684520859d" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 42635 } } peers { permanent_uuid: "a1656fcf3d624257bff2de727b498722" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 38159 } } }
I20260808 14:49:51.555402 29339 tablet_replica.cc:442] T 0e9cdf81e2524585a257bcc45d995c86 P 10eaeff5663d4d269cdc8254e98417f1: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 14:49:51.563879 29340 tablet_replica.cc:439] T 0e9cdf81e2524585a257bcc45d995c86 P 19b3f51d4a94491fb48f34684520859d: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "19b3f51d4a94491fb48f34684520859d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10eaeff5663d4d269cdc8254e98417f1" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 37879 } } peers { permanent_uuid: "19b3f51d4a94491fb48f34684520859d" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 42635 } } peers { permanent_uuid: "a1656fcf3d624257bff2de727b498722" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 38159 } } }
I20260808 14:49:51.564158 29340 tablet_replica.cc:442] T 0e9cdf81e2524585a257bcc45d995c86 P 19b3f51d4a94491fb48f34684520859d: This TxnStatusTablet replica's current role is: LEADER
I20260808 14:49:51.564841 29339 tablet_replica.cc:439] T 0e9cdf81e2524585a257bcc45d995c86 P 10eaeff5663d4d269cdc8254e98417f1: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "19b3f51d4a94491fb48f34684520859d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10eaeff5663d4d269cdc8254e98417f1" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 37879 } } peers { permanent_uuid: "19b3f51d4a94491fb48f34684520859d" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 42635 } } peers { permanent_uuid: "a1656fcf3d624257bff2de727b498722" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 38159 } } }
I20260808 14:49:51.565124 29339 tablet_replica.cc:442] T 0e9cdf81e2524585a257bcc45d995c86 P 10eaeff5663d4d269cdc8254e98417f1: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 14:49:51.598029 29397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:51.575214 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52452 (local address 127.26.206.193:37879)
0808 14:49:51.588310 (+ 13096us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:51.588316 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:51.591059 (+ 2743us) server_negotiation.cc:407] Connection header received
0808 14:49:51.591234 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:51.591240 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:51.591442 (+ 202us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:51.591726 (+ 284us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:49:51.592486 (+ 760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:51.593521 (+ 1035us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:51.595251 (+ 1730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:51.595988 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:51.596134 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:51.596633 (+ 499us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:49:51.597352 (+ 719us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:49:51.597512 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:51.597593 (+ 81us) server_negotiation.cc:299] Negotiation successful
0808 14:49:51.597675 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12944,"thread_start_us":13116,"threads_started":1}
I20260808 14:49:51.619005 29327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:51.612874 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.193:46129 (local address 127.26.206.194:42635)
0808 14:49:51.613123 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:51.613130 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:51.613649 (+ 519us) server_negotiation.cc:407] Connection header received
0808 14:49:51.613874 (+ 225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:51.613880 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:51.613959 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:51.614078 (+ 119us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:49:51.614664 (+ 586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:51.615537 (+ 873us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:51.617068 (+ 1531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:51.617527 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:51.617678 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:51.618219 (+ 541us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:49:51.618331 (+ 112us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:49:51.618461 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:51.618588 (+ 127us) server_negotiation.cc:299] Negotiation successful
0808 14:49:51.618661 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260808 14:49:51.619127 29400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:51.612885 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.194:42635 (local address 127.26.206.193:46129)
0808 14:49:51.613545 (+ 660us) negotiation.cc:107] Waiting for socket to connect
0808 14:49:51.613562 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 14:49:51.613719 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:49:51.614095 (+ 376us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:49:51.614100 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:49:51.614112 (+ 12us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 14:49:51.614482 (+ 370us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:51.614494 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:51.615742 (+ 1248us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:51.615748 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:51.616894 (+ 1146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:51.616932 (+ 38us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:51.617723 (+ 791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:51.617732 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:51.617915 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:51.618005 (+ 90us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 14:49:51.618465 (+ 460us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 14:49:51.618480 (+ 15us) client_negotiation.cc:769] Sending connection context
0808 14:49:51.618554 (+ 74us) client_negotiation.cc:240] Negotiation successful
0808 14:49:51.618697 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":484,"thread_start_us":343,"threads_started":1}
I20260808 14:49:51.631268 29100 raft_consensus.cc:3037] T 9fafd344985c48b09b9b76a7f1c4cbf4 P 19b3f51d4a94491fb48f34684520859d [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:49:51.634912 29100 raft_consensus.cc:1261] T 9fafd344985c48b09b9b76a7f1c4cbf4 P 19b3f51d4a94491fb48f34684520859d [term 1 FOLLOWER]: Refusing update from remote peer 10eaeff5663d4d269cdc8254e98417f1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:49:51.635836 29261 raft_consensus.cc:1261] T 9fafd344985c48b09b9b76a7f1c4cbf4 P a1656fcf3d624257bff2de727b498722 [term 1 FOLLOWER]: Refusing update from remote peer 10eaeff5663d4d269cdc8254e98417f1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:49:51.635691 29368 consensus_queue.cc:1035] T 9fafd344985c48b09b9b76a7f1c4cbf4 P 10eaeff5663d4d269cdc8254e98417f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19b3f51d4a94491fb48f34684520859d" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 42635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:49:51.636575 29368 consensus_queue.cc:1035] T 9fafd344985c48b09b9b76a7f1c4cbf4 P 10eaeff5663d4d269cdc8254e98417f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1656fcf3d624257bff2de727b498722" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 38159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:49:51.700563 29397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:51.693668 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.194:59489 (local address 127.26.206.193:37879)
0808 14:49:51.693849 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:51.693857 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:51.694755 (+ 898us) server_negotiation.cc:407] Connection header received
0808 14:49:51.694959 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:51.694965 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:51.695078 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:51.695170 (+ 92us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:49:51.696007 (+ 837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:51.696796 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:51.698332 (+ 1536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:51.699002 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:51.699124 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:51.699672 (+ 548us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:49:51.699851 (+ 179us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:49:51.699963 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:51.700114 (+ 151us) server_negotiation.cc:299] Negotiation successful
0808 14:49:51.700208 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260808 14:49:51.700661 29406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:51.693802 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.193:37879 (local address 127.26.206.194:59489)
0808 14:49:51.694620 (+ 818us) negotiation.cc:107] Waiting for socket to connect
0808 14:49:51.694642 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 14:49:51.694815 (+ 173us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:49:51.695205 (+ 390us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:49:51.695210 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:49:51.695223 (+ 13us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 14:49:51.695804 (+ 581us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:51.695820 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:51.696950 (+ 1130us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:51.696954 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:51.698181 (+ 1227us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:51.698192 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:51.699241 (+ 1049us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:51.699248 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:51.699415 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:51.699471 (+ 56us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 14:49:51.699950 (+ 479us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 14:49:51.699961 (+ 11us) client_negotiation.cc:769] Sending connection context
0808 14:49:51.700089 (+ 128us) client_negotiation.cc:240] Negotiation successful
0808 14:49:51.700228 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":585,"thread_start_us":366,"threads_started":1}
I20260808 14:49:51.747417 28753 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52516:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:49:51.747732 28753 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52516:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:49:51.751503 28753 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 8396b7aa47d74e64ae248bd64e44ac98: Sending DeleteTablet for 3 replicas of tablet 9fafd344985c48b09b9b76a7f1c4cbf4
I20260808 14:49:51.752677 28911 tablet_service.cc:1514] Processing DeleteTablet for tablet 9fafd344985c48b09b9b76a7f1c4cbf4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:49:51 UTC) from {username='kudu', principal='kudu/127.26.206.254@KRBTEST.COM'} at 127.0.0.1:52448
I20260808 14:49:51.752661 29233 tablet_service.cc:1514] Processing DeleteTablet for tablet 9fafd344985c48b09b9b76a7f1c4cbf4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:49:51 UTC) from {username='kudu', principal='kudu/127.26.206.254@KRBTEST.COM'} at 127.0.0.1:47044
I20260808 14:49:51.756649 29080 tablet_service.cc:1514] Processing DeleteTablet for tablet 9fafd344985c48b09b9b76a7f1c4cbf4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:49:51 UTC) from {username='kudu', principal='kudu/127.26.206.254@KRBTEST.COM'} at 127.0.0.1:41402
I20260808 14:49:51.767004 29412 tablet_replica.cc:330] T 9fafd344985c48b09b9b76a7f1c4cbf4 P 10eaeff5663d4d269cdc8254e98417f1: stopping tablet replica
I20260808 14:49:51.767339 29412 raft_consensus.cc:2229] T 9fafd344985c48b09b9b76a7f1c4cbf4 P 10eaeff5663d4d269cdc8254e98417f1 [term 1 LEADER]: Raft consensus shutting down.
I20260808 14:49:51.767952 29414 tablet_replica.cc:330] T 9fafd344985c48b09b9b76a7f1c4cbf4 P 19b3f51d4a94491fb48f34684520859d: stopping tablet replica
I20260808 14:49:51.768606 29412 raft_consensus.cc:2258] T 9fafd344985c48b09b9b76a7f1c4cbf4 P 10eaeff5663d4d269cdc8254e98417f1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:49:51.768906 29414 raft_consensus.cc:2229] T 9fafd344985c48b09b9b76a7f1c4cbf4 P 19b3f51d4a94491fb48f34684520859d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:49:51.769382 29414 raft_consensus.cc:2258] T 9fafd344985c48b09b9b76a7f1c4cbf4 P 19b3f51d4a94491fb48f34684520859d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:49:51.771485 29414 ts_tablet_manager.cc:1905] T 9fafd344985c48b09b9b76a7f1c4cbf4 P 19b3f51d4a94491fb48f34684520859d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:49:51.772022 29412 ts_tablet_manager.cc:1905] T 9fafd344985c48b09b9b76a7f1c4cbf4 P 10eaeff5663d4d269cdc8254e98417f1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:49:51.788002 29414 ts_tablet_manager.cc:1918] T 9fafd344985c48b09b9b76a7f1c4cbf4 P 19b3f51d4a94491fb48f34684520859d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 14:49:51.788532 29411 tablet_replica.cc:330] T 9fafd344985c48b09b9b76a7f1c4cbf4 P a1656fcf3d624257bff2de727b498722: stopping tablet replica
I20260808 14:49:51.788793 29411 raft_consensus.cc:2229] T 9fafd344985c48b09b9b76a7f1c4cbf4 P a1656fcf3d624257bff2de727b498722 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:49:51.789103 29411 raft_consensus.cc:2258] T 9fafd344985c48b09b9b76a7f1c4cbf4 P a1656fcf3d624257bff2de727b498722 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:49:51.790226 29411 ts_tablet_manager.cc:1905] T 9fafd344985c48b09b9b76a7f1c4cbf4 P a1656fcf3d624257bff2de727b498722: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:49:51.797518 29411 ts_tablet_manager.cc:1918] T 9fafd344985c48b09b9b76a7f1c4cbf4 P a1656fcf3d624257bff2de727b498722: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 14:49:51.797865 29412 ts_tablet_manager.cc:1918] T 9fafd344985c48b09b9b76a7f1c4cbf4 P 10eaeff5663d4d269cdc8254e98417f1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 14:49:51.798069 29412 log.cc:1196] T 9fafd344985c48b09b9b76a7f1c4cbf4 P 10eaeff5663d4d269cdc8254e98417f1: Deleting WAL directory at /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200577490656-27451-0/minicluster-data/ts-0/wal/wals/9fafd344985c48b09b9b76a7f1c4cbf4
I20260808 14:49:51.798266 29414 log.cc:1196] T 9fafd344985c48b09b9b76a7f1c4cbf4 P 19b3f51d4a94491fb48f34684520859d: Deleting WAL directory at /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200577490656-27451-0/minicluster-data/ts-1/wal/wals/9fafd344985c48b09b9b76a7f1c4cbf4
I20260808 14:49:51.798906 29412 ts_tablet_manager.cc:1939] T 9fafd344985c48b09b9b76a7f1c4cbf4 P 10eaeff5663d4d269cdc8254e98417f1: Deleting consensus metadata
I20260808 14:49:51.799465 29414 ts_tablet_manager.cc:1939] T 9fafd344985c48b09b9b76a7f1c4cbf4 P 19b3f51d4a94491fb48f34684520859d: Deleting consensus metadata
I20260808 14:49:51.800750 28740 catalog_manager.cc:4841] TS 10eaeff5663d4d269cdc8254e98417f1 (127.26.206.193:37879): tablet 9fafd344985c48b09b9b76a7f1c4cbf4 (table test-table [id=a2323b68d5484db7b105514279c0b71b]) successfully deleted
I20260808 14:49:51.802105 28740 catalog_manager.cc:4841] TS 19b3f51d4a94491fb48f34684520859d (127.26.206.194:42635): tablet 9fafd344985c48b09b9b76a7f1c4cbf4 (table test-table [id=a2323b68d5484db7b105514279c0b71b]) successfully deleted
I20260808 14:49:51.802659 29411 log.cc:1196] T 9fafd344985c48b09b9b76a7f1c4cbf4 P a1656fcf3d624257bff2de727b498722: Deleting WAL directory at /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200577490656-27451-0/minicluster-data/ts-2/wal/wals/9fafd344985c48b09b9b76a7f1c4cbf4
I20260808 14:49:51.803196 29411 ts_tablet_manager.cc:1939] T 9fafd344985c48b09b9b76a7f1c4cbf4 P a1656fcf3d624257bff2de727b498722: Deleting consensus metadata
Aug 08 14:49:51 dist-test-slave-6k22 krb5kdc[28704](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200590, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.26.206.193@KRBTEST.COM
I20260808 14:49:51.804420 28737 catalog_manager.cc:4841] TS a1656fcf3d624257bff2de727b498722 (127.26.206.195:38159): tablet 9fafd344985c48b09b9b76a7f1c4cbf4 (table test-table [id=a2323b68d5484db7b105514279c0b71b]) successfully deleted
I20260808 14:49:51.812608 29397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:51.782802 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52462 (local address 127.26.206.193:37879)
0808 14:49:51.782994 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:51.783001 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:51.791774 (+ 8773us) server_negotiation.cc:407] Connection header received
0808 14:49:51.792104 (+ 330us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:51.792111 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:51.792230 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:51.792323 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:51.794640 (+ 2317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:51.795817 (+ 1177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:51.797804 (+ 1987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:51.798586 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:51.798701 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:51.804735 (+ 6034us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:49:51.804755 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:49:51.804781 (+ 26us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:49:51.804824 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:49:51.809139 (+ 4315us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:51.810010 (+ 871us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:51.810027 (+ 17us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:51.810031 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:51.810220 (+ 189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:51.810641 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:51.810646 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:51.810650 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:51.811138 (+ 488us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:49:51.811496 (+ 358us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:51.811869 (+ 373us) server_negotiation.cc:299] Negotiation successful
0808 14:49:51.812113 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
W20260808 14:49:51.813486 28992 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52462
I20260808 14:49:51.840035 29376 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:51.817666 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52530 (local address 127.26.206.254:35549)
0808 14:49:51.817936 (+ 270us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:51.817944 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:51.824036 (+ 6092us) server_negotiation.cc:407] Connection header received
0808 14:49:51.824237 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:51.824243 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:51.824352 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:51.824467 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:51.826177 (+ 1710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:51.827300 (+ 1123us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:51.829109 (+ 1809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:51.829810 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:51.829955 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:51.833039 (+ 3084us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:49:51.833046 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:49:51.833066 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:49:51.833111 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:49:51.836809 (+ 3698us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:51.837678 (+ 869us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:51.837683 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:51.837687 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:51.837825 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:51.838289 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:51.838294 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:51.838297 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:51.838646 (+ 349us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:49:51.838868 (+ 222us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:51.839297 (+ 429us) server_negotiation.cc:299] Negotiation successful
0808 14:49:51.839509 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
W20260808 14:49:51.840654 28753 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52530
I20260808 14:49:51.843377 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 28832
I20260808 14:49:51.862574 29397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:51.845940 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52474 (local address 127.26.206.193:37879)
0808 14:49:51.846422 (+ 482us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:51.846429 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:51.846450 (+ 21us) server_negotiation.cc:407] Connection header received
0808 14:49:51.846520 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:51.846527 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:51.846604 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:51.846717 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:51.848330 (+ 1613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:51.849428 (+ 1098us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:51.851322 (+ 1894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:51.852119 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:51.852258 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:51.855320 (+ 3062us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:49:51.855328 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:49:51.855332 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:49:51.855400 (+ 68us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:49:51.859444 (+ 4044us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:51.860332 (+ 888us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:51.860337 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:51.860341 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:51.860508 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:51.860959 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:51.860964 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:51.860966 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:51.861360 (+ 394us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:49:51.861654 (+ 294us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:51.861957 (+ 303us) server_negotiation.cc:299] Negotiation successful
0808 14:49:51.862198 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":333}
W20260808 14:49:51.863296 28992 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52474
W20260808 14:49:51.863938 27451 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 28832: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 14:49:51.864171 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 28832
I20260808 14:49:51.893795 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 29001
Aug 08 14:49:51 dist-test-slave-6k22 krb5kdc[28704](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200590, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.26.206.194@KRBTEST.COM
I20260808 14:49:51.911262 29327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:51.894633 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41426 (local address 127.26.206.194:42635)
0808 14:49:51.894798 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:51.894802 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:51.894822 (+ 20us) server_negotiation.cc:407] Connection header received
0808 14:49:51.895020 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:51.895023 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:51.895084 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:51.895187 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:51.896719 (+ 1532us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:51.897513 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:51.899286 (+ 1773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:51.899893 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:51.900007 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:51.905170 (+ 5163us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:49:51.905188 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:49:51.905212 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:49:51.905244 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:49:51.908461 (+ 3217us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:51.909154 (+ 693us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:51.909169 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:51.909171 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:51.909305 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:51.909693 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:51.909703 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:51.909708 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:51.910086 (+ 378us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:49:51.910416 (+ 330us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:51.910654 (+ 238us) server_negotiation.cc:299] Negotiation successful
0808 14:49:51.910901 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
W20260808 14:49:51.912058 29152 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:41426
W20260808 14:49:51.912827 27451 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 29001: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 14:49:51.912981 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 29001
I20260808 14:49:51.940274 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 29161
Aug 08 14:49:51 dist-test-slave-6k22 krb5kdc[28704](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200590, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.26.206.195@KRBTEST.COM
I20260808 14:49:51.955956 29419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:51.941110 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47056 (local address 127.26.206.195:38159)
0808 14:49:51.941711 (+ 601us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:51.941715 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:51.941731 (+ 16us) server_negotiation.cc:407] Connection header received
0808 14:49:51.941787 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:51.941790 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:51.941855 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:51.941946 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:51.943296 (+ 1350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:51.944251 (+ 955us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:51.945493 (+ 1242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:51.945910 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:51.946001 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:51.950366 (+ 4365us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:49:51.950381 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:49:51.950397 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:49:51.950428 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:49:51.953427 (+ 2999us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:51.954044 (+ 617us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:51.954052 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:51.954054 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:51.954211 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:51.954532 (+ 321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:51.954536 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:51.954537 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:51.954904 (+ 367us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:49:51.955181 (+ 277us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:51.955391 (+ 210us) server_negotiation.cc:299] Negotiation successful
0808 14:49:51.955632 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":499,"thread_start_us":326,"threads_started":1}
W20260808 14:49:51.956801 29305 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:47056
W20260808 14:49:51.957546 27451 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 29161: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 14:49:51.957726 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 29161
I20260808 14:49:51.976042 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 28719
I20260808 14:49:51.977157 28798 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:49:52.096941 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 28719
2026-08-08T14:49:52Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (4893 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200577490656-27451-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:49:52 dist-test-slave-6k22 krb5kdc[29423](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:49:52 dist-test-slave-6k22 krb5kdc[29423](info): set up 2 sockets
Aug 08 14:49:52 dist-test-slave-6k22 krb5kdc[29423](info): commencing operation
krb5kdc: starting...
W20260808 14:49:53.258584 27451 mini_kdc.cc:121] Time spent starting KDC: real 1.113s user 0.001s sys 0.021s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200577490656-27451-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200577490656-27451-0/krb5kdc/test-user.keytab.
Aug 08 14:49:53 dist-test-slave-6k22 krb5kdc[29423](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200593, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:49:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:49:53Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.206.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.206.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.206.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.254.keytab.
Entry for principal kudu/127.26.206.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.254.keytab.
I20260808 14:49:53.465190 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200577490656-27451-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200577490656-27451-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200577490656-27451-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.206.254:42107
--webserver_interface=127.26.206.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.254.keytab
--principal=kudu/127.26.206.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.206.212:33281
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.206.254:42107
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:49:53.787918 29437 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:49:53.788199 29437 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:49:53.788353 29437 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:49:53.795372 29437 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:49:53.795496 29437 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260808 14:49:53.795593 29437 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:49:53.795709 29437 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:49:53.795797 29437 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:49:53.795892 29437 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:49:53.805459 29437 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:33281
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200577490656-27451-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200577490656-27451-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.206.254:42107
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.254.keytab
--principal=kudu/127.26.206.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.206.254:42107
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.206.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200577490656-27451-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:49:53.806628 29437 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:49:53.807973 29437 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:49:53.819631 29447 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:49:53.819674 29445 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:49:53.819896 29444 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:49:53.821346 29437 server_base.cc:1034] running on GCE node
I20260808 14:49:53.822230 29437 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:49:53.823704 29437 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:49:53.824954 29437 hybrid_clock.cc:648] HybridClock initialized: now 1786200593824895 us; error 37 us; skew 500 ppm
I20260808 14:49:53.825309 29437 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:49:53 dist-test-slave-6k22 krb5kdc[29423](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200593, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:49:53.828437 29437 init.cc:377] Logged in from keytab as kudu/127.26.206.254@KRBTEST.COM (short username kudu)
I20260808 14:49:53.829871 29437 webserver.cc:460] Webserver started at http://127.26.206.254:40805/ using document root <none> and password file <none>
I20260808 14:49:53.830572 29437 fs_manager.cc:359] Metadata directory not provided
I20260808 14:49:53.830705 29437 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:49:53.831028 29437 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:49:53.834203 29437 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200577490656-27451-0/minicluster-data/master-0/data/instance:
uuid: "391255c8e7224cc9864773b0724db188"
format_stamp: "Formatted at 2026-08-08 14:49:53 on dist-test-slave-6k22"
server_key: "4fd37f9e9c2286d5b72598b04f69cb44"
server_key_iv: "3438b5126e2ac24c0ed3673364fb520c"
server_key_version: "encryptionkey@0"
I20260808 14:49:53.834993 29437 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200577490656-27451-0/minicluster-data/master-0/wal/instance:
uuid: "391255c8e7224cc9864773b0724db188"
format_stamp: "Formatted at 2026-08-08 14:49:53 on dist-test-slave-6k22"
server_key: "4fd37f9e9c2286d5b72598b04f69cb44"
server_key_iv: "3438b5126e2ac24c0ed3673364fb520c"
server_key_version: "encryptionkey@0"
I20260808 14:49:53.840152 29437 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.005s
I20260808 14:49:53.843467 29454 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:49:53.844756 29437 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 14:49:53.844992 29437 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200577490656-27451-0/minicluster-data/master-0/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200577490656-27451-0/minicluster-data/master-0/wal
uuid: "391255c8e7224cc9864773b0724db188"
format_stamp: "Formatted at 2026-08-08 14:49:53 on dist-test-slave-6k22"
server_key: "4fd37f9e9c2286d5b72598b04f69cb44"
server_key_iv: "3438b5126e2ac24c0ed3673364fb520c"
server_key_version: "encryptionkey@0"
I20260808 14:49:53.845211 29437 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200577490656-27451-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200577490656-27451-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200577490656-27451-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:49:53.862598 29437 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:49:53.866490 29437 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:49:53.866761 29437 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:49:53.888908 29437 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.254:42107
I20260808 14:49:53.888916 29526 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.254:42107 every 8 connection(s)
I20260808 14:49:53.890309 29437 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
I20260808 14:49:53.894110 29527 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:49:53.894258 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 29437
I20260808 14:49:53.894492 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200577490656-27451-0/minicluster-data/master-0/wal/instance
I20260808 14:49:53.895346 27451 external_mini_cluster.cc:1428] Setting key 65f955b4b608acff9d0fb29a6543e16e
I20260808 14:49:53.908133 29527 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 391255c8e7224cc9864773b0724db188: Bootstrap starting.
Aug 08 14:49:53 dist-test-slave-6k22 krb5kdc[29423](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200593, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.206.254@KRBTEST.COM
I20260808 14:49:53.911880 29527 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 391255c8e7224cc9864773b0724db188: Neither blocks nor log segments found. Creating new log.
I20260808 14:49:53.912958 29527 log.cc:824] T 00000000000000000000000000000000 P 391255c8e7224cc9864773b0724db188: Log is configured to *not* fsync() on all Append() calls
I20260808 14:49:53.916177 29527 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 391255c8e7224cc9864773b0724db188: No bootstrap required, opened a new log
I20260808 14:49:53.920089 29530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:53.897475 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35178 (local address 127.26.206.254:42107)
0808 14:49:53.898308 (+ 833us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:53.898318 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:53.898360 (+ 42us) server_negotiation.cc:407] Connection header received
0808 14:49:53.900463 (+ 2103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:53.900484 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:53.900881 (+ 397us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:53.901209 (+ 328us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:53.902963 (+ 1754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:53.904347 (+ 1384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:53.906186 (+ 1839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:53.906830 (+ 644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:53.906952 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:53.911703 (+ 4751us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:49:53.911710 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:49:53.911723 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:49:53.911764 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:49:53.915487 (+ 3723us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:53.916190 (+ 703us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:53.916202 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:53.916211 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:53.916445 (+ 234us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:53.916835 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:53.916841 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:53.916857 (+ 16us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:53.917546 (+ 689us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:49:53.917820 (+ 274us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:53.918184 (+ 364us) server_negotiation.cc:299] Negotiation successful
0808 14:49:53.918668 (+ 484us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":611,"thread_start_us":405,"threads_started":1}
I20260808 14:49:53.925755 29527 raft_consensus.cc:348] T 00000000000000000000000000000000 P 391255c8e7224cc9864773b0724db188 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "391255c8e7224cc9864773b0724db188" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 42107 } }
I20260808 14:49:53.926182 29527 raft_consensus.cc:374] T 00000000000000000000000000000000 P 391255c8e7224cc9864773b0724db188 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:49:53.926285 29527 raft_consensus.cc:729] T 00000000000000000000000000000000 P 391255c8e7224cc9864773b0724db188 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 391255c8e7224cc9864773b0724db188, State: Initialized, Role: FOLLOWER
I20260808 14:49:53.926911 29527 consensus_queue.cc:260] T 00000000000000000000000000000000 P 391255c8e7224cc9864773b0724db188 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "391255c8e7224cc9864773b0724db188" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 42107 } }
I20260808 14:49:53.927170 29527 raft_consensus.cc:388] T 00000000000000000000000000000000 P 391255c8e7224cc9864773b0724db188 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:49:53.927306 29527 raft_consensus.cc:482] T 00000000000000000000000000000000 P 391255c8e7224cc9864773b0724db188 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:49:53.927484 29527 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 391255c8e7224cc9864773b0724db188 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:49:53.929522 29527 raft_consensus.cc:504] T 00000000000000000000000000000000 P 391255c8e7224cc9864773b0724db188 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "391255c8e7224cc9864773b0724db188" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 42107 } }
I20260808 14:49:53.930001 29527 leader_election.cc:302] T 00000000000000000000000000000000 P 391255c8e7224cc9864773b0724db188 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 391255c8e7224cc9864773b0724db188; no voters:
I20260808 14:49:53.930540 29527 leader_election.cc:288] T 00000000000000000000000000000000 P 391255c8e7224cc9864773b0724db188 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:49:53.930670 29532 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 391255c8e7224cc9864773b0724db188 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:49:53.931420 29532 raft_consensus.cc:686] T 00000000000000000000000000000000 P 391255c8e7224cc9864773b0724db188 [term 1 LEADER]: Becoming Leader. State: Replica: 391255c8e7224cc9864773b0724db188, State: Running, Role: LEADER
I20260808 14:49:53.932003 29532 consensus_queue.cc:237] T 00000000000000000000000000000000 P 391255c8e7224cc9864773b0724db188 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "391255c8e7224cc9864773b0724db188" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 42107 } }
I20260808 14:49:53.932734 29527 sys_catalog.cc:564] T 00000000000000000000000000000000 P 391255c8e7224cc9864773b0724db188 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:49:53.940564 29533 sys_catalog.cc:455] T 00000000000000000000000000000000 P 391255c8e7224cc9864773b0724db188 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "391255c8e7224cc9864773b0724db188" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "391255c8e7224cc9864773b0724db188" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 42107 } } }
I20260808 14:49:53.940601 29534 sys_catalog.cc:455] T 00000000000000000000000000000000 P 391255c8e7224cc9864773b0724db188 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 391255c8e7224cc9864773b0724db188. Latest consensus state: current_term: 1 leader_uuid: "391255c8e7224cc9864773b0724db188" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "391255c8e7224cc9864773b0724db188" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 42107 } } }
I20260808 14:49:53.940963 29533 sys_catalog.cc:458] T 00000000000000000000000000000000 P 391255c8e7224cc9864773b0724db188 [sys.catalog]: This master's current role is: LEADER
I20260808 14:49:53.940971 29534 sys_catalog.cc:458] T 00000000000000000000000000000000 P 391255c8e7224cc9864773b0724db188 [sys.catalog]: This master's current role is: LEADER
W20260808 14:49:53.945920 29546 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 391255c8e7224cc9864773b0724db188: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 14:49:53.946050 29546 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 14:49:53.946198 29547 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:49:53.948386 29547 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:49:53.961862 29547 catalog_manager.cc:1347] Generated new cluster ID: 06967bc98c6043fe8cf891924cca9592
I20260808 14:49:53.961978 29547 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:49:53.969871 29547 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:49:53.971097 29547 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:49:53.985800 29547 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 391255c8e7224cc9864773b0724db188: Generated new TSK 0
I20260808 14:49:53.986589 29547 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.206.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.206.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.206.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.193.keytab.
Entry for principal kudu/127.26.206.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.193.keytab.
I20260808 14:49:54.039506 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200577490656-27451-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200577490656-27451-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200577490656-27451-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200577490656-27451-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.206.193:0
--local_ip_for_outbound_sockets=127.26.206.193
--webserver_interface=127.26.206.193
--webserver_port=0
--tserver_master_addrs=127.26.206.254:42107
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.193.keytab
--principal=kudu/127.26.206.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.206.212:33281
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:49:54.369262 29553 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:49:54.369541 29553 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:49:54.369721 29553 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:49:54.376626 29553 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:49:54.376727 29553 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:49:54.376905 29553 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260808 14:49:54.376991 29553 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 14:49:54.377120 29553 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.206.193
I20260808 14:49:54.386372 29553 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:33281
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200577490656-27451-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200577490656-27451-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.193.keytab
--principal=kudu/127.26.206.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.206.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200577490656-27451-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.206.193
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.26.206.254:42107
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.206.193
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200577490656-27451-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:49:54.387732 29553 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:49:54.389235 29553 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:49:54.402438 29559 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:49:54.402390 29560 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:49:54.402441 29563 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:49:54.403256 29553 server_base.cc:1034] running on GCE node
I20260808 14:49:54.403983 29553 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:49:54.404985 29553 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:49:54.406184 29553 hybrid_clock.cc:648] HybridClock initialized: now 1786200594406128 us; error 53 us; skew 500 ppm
I20260808 14:49:54.406513 29553 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:49:54 dist-test-slave-6k22 krb5kdc[29423](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200594, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:49:54.409665 29553 init.cc:377] Logged in from keytab as kudu/127.26.206.193@KRBTEST.COM (short username kudu)
I20260808 14:49:54.411206 29553 webserver.cc:460] Webserver started at http://127.26.206.193:36781/ using document root <none> and password file <none>
I20260808 14:49:54.411957 29553 fs_manager.cc:359] Metadata directory not provided
I20260808 14:49:54.412104 29553 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:49:54.412423 29553 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:49:54.415330 29553 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200577490656-27451-0/minicluster-data/ts-0/data/instance:
uuid: "8fc0d02ecec34e88b5dff67bbe42ab86"
format_stamp: "Formatted at 2026-08-08 14:49:54 on dist-test-slave-6k22"
server_key: "2f10d281a6b05e40a6732c0bb3600cab"
server_key_iv: "f4f9faf959a4974dc9c0f6c71ca2d33e"
server_key_version: "encryptionkey@0"
I20260808 14:49:54.416152 29553 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200577490656-27451-0/minicluster-data/ts-0/wal/instance:
uuid: "8fc0d02ecec34e88b5dff67bbe42ab86"
format_stamp: "Formatted at 2026-08-08 14:49:54 on dist-test-slave-6k22"
server_key: "2f10d281a6b05e40a6732c0bb3600cab"
server_key_iv: "f4f9faf959a4974dc9c0f6c71ca2d33e"
server_key_version: "encryptionkey@0"
I20260808 14:49:54.421236 29553 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260808 14:49:54.424746 29570 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:49:54.425966 29553 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 14:49:54.426141 29553 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200577490656-27451-0/minicluster-data/ts-0/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200577490656-27451-0/minicluster-data/ts-0/wal
uuid: "8fc0d02ecec34e88b5dff67bbe42ab86"
format_stamp: "Formatted at 2026-08-08 14:49:54 on dist-test-slave-6k22"
server_key: "2f10d281a6b05e40a6732c0bb3600cab"
server_key_iv: "f4f9faf959a4974dc9c0f6c71ca2d33e"
server_key_version: "encryptionkey@0"
I20260808 14:49:54.426357 29553 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200577490656-27451-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200577490656-27451-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200577490656-27451-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:49:54.441794 29553 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:49:54.445853 29553 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:49:54.446151 29553 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:49:54.448953 29553 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:49:54.449074 29553 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:49:54.449215 29553 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:49:54.449357 29553 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.001s sys 0.000s
Aug 08 14:49:54 dist-test-slave-6k22 krb5kdc[29423](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200594, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.193@KRBTEST.COM for kudu/127.26.206.254@KRBTEST.COM
I20260808 14:49:54.472559 29580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:54.449392 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.193:57353 (local address 127.26.206.254:42107)
0808 14:49:54.449935 (+ 543us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:54.449943 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:54.451001 (+ 1058us) server_negotiation.cc:407] Connection header received
0808 14:49:54.453105 (+ 2104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:54.453111 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:54.453193 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:54.453316 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:54.455327 (+ 2011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:54.456633 (+ 1306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:54.458963 (+ 2330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:54.459827 (+ 864us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:54.459992 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:54.464811 (+ 4819us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:49:54.464820 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:49:54.464828 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:49:54.464878 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:49:54.468798 (+ 3920us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:54.470018 (+ 1220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:54.470026 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:54.470030 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:54.470220 (+ 190us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:54.470688 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:54.470695 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:54.470699 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:54.470990 (+ 291us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:49:54.471139 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:54.471955 (+ 816us) server_negotiation.cc:299] Negotiation successful
0808 14:49:54.472172 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":413,"thread_start_us":343,"threads_started":1}
I20260808 14:49:54.473613 29583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:54.450101 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:42107 (local address 127.26.206.193:57353)
0808 14:49:54.450829 (+ 728us) negotiation.cc:107] Waiting for socket to connect
0808 14:49:54.450864 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0808 14:49:54.452768 (+ 1904us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:49:54.453512 (+ 744us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:49:54.453519 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:49:54.454249 (+ 730us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:49:54.455088 (+ 839us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:54.455144 (+ 56us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:54.456851 (+ 1707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:54.456856 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:54.458796 (+ 1940us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:54.458814 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:54.460088 (+ 1274us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:54.460099 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:54.460413 (+ 314us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:54.461099 (+ 686us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:49:54.461123 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:49:54.464542 (+ 3419us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:49:54.469055 (+ 4513us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:49:54.469067 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:49:54.469093 (+ 26us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:49:54.469882 (+ 789us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:49:54.470352 (+ 470us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:49:54.470363 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:49:54.470366 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:49:54.470572 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:49:54.471128 (+ 556us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:49:54.471134 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:49:54.471501 (+ 367us) client_negotiation.cc:769] Sending connection context
0808 14:49:54.471883 (+ 382us) client_negotiation.cc:240] Negotiation successful
0808 14:49:54.472430 (+ 547us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":507,"thread_start_us":313,"threads_started":1}
I20260808 14:49:54.496016 29553 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.193:37433
I20260808 14:49:54.496065 29707 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.193:37433 every 8 connection(s)
I20260808 14:49:54.497376 29580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:54.481317 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.193:33369 (local address 127.26.206.254:42107)
0808 14:49:54.481555 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:54.481562 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:54.481960 (+ 398us) server_negotiation.cc:407] Connection header received
0808 14:49:54.482179 (+ 219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:54.482186 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:54.482288 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:54.482399 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:54.483474 (+ 1075us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:54.484754 (+ 1280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:54.487197 (+ 2443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:54.487945 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:54.488089 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:54.490724 (+ 2635us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:49:54.490731 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:49:54.490737 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:49:54.490777 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:49:54.494282 (+ 3505us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:54.495269 (+ 987us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:54.495274 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:54.495278 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:54.495465 (+ 187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:54.496025 (+ 560us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:54.496032 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:54.496037 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:54.496385 (+ 348us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:49:54.496496 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:54.496991 (+ 495us) server_negotiation.cc:299] Negotiation successful
0808 14:49:54.497151 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260808 14:49:54.497677 29553 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200577490656-27451-0/minicluster-data/ts-0/data/info.pb
I20260808 14:49:54.497792 29663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:54.481187 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:42107 (local address 127.26.206.193:33369)
0808 14:49:54.481839 (+ 652us) negotiation.cc:107] Waiting for socket to connect
0808 14:49:54.481863 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0808 14:49:54.482028 (+ 165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:49:54.482453 (+ 425us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:49:54.482473 (+ 20us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:49:54.483025 (+ 552us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:49:54.483317 (+ 292us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:54.483326 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:54.484924 (+ 1598us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:54.484930 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:54.487014 (+ 2084us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:54.487036 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:54.488135 (+ 1099us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:54.488140 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:54.488249 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:54.489059 (+ 810us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:49:54.489094 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:49:54.490486 (+ 1392us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:49:54.494409 (+ 3923us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:49:54.494414 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:49:54.494420 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:49:54.495117 (+ 697us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:49:54.495645 (+ 528us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:49:54.495656 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:49:54.495663 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:49:54.495889 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:49:54.496520 (+ 631us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:49:54.496525 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:49:54.496734 (+ 209us) client_negotiation.cc:769] Sending connection context
0808 14:49:54.496909 (+ 175us) client_negotiation.cc:240] Negotiation successful
0808 14:49:54.497246 (+ 337us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":483,"thread_start_us":333,"threads_started":1}
I20260808 14:49:54.499850 29708 heartbeater.cc:347] Connected to a master server at 127.26.206.254:42107
I20260808 14:49:54.500108 29708 heartbeater.cc:464] Registering TS with master...
I20260808 14:49:54.500921 29708 heartbeater.cc:511] Master 127.26.206.254:42107 requested a full tablet report, sending...
I20260808 14:49:54.501197 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 29553
I20260808 14:49:54.501464 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200577490656-27451-0/minicluster-data/ts-0/wal/instance
I20260808 14:49:54.502233 27451 external_mini_cluster.cc:1428] Setting key 053af8ab8c9a746a8c590621994a2681
I20260808 14:49:54.504132 29475 ts_manager.cc:194] Registered new tserver with Master: 8fc0d02ecec34e88b5dff67bbe42ab86 (127.26.206.193:37433)
I20260808 14:49:54.505532 29475 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.206.193@KRBTEST.COM'} at 127.26.206.193:57353
WARNING: no policy specified for kudu/127.26.206.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.206.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.206.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.194.keytab.
Entry for principal kudu/127.26.206.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.194.keytab.
I20260808 14:49:54.546852 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200577490656-27451-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200577490656-27451-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200577490656-27451-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200577490656-27451-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.206.194:0
--local_ip_for_outbound_sockets=127.26.206.194
--webserver_interface=127.26.206.194
--webserver_port=0
--tserver_master_addrs=127.26.206.254:42107
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.194.keytab
--principal=kudu/127.26.206.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.206.212:33281
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:49:54.888808 29712 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:49:54.889103 29712 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:49:54.889290 29712 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:49:54.896449 29712 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:49:54.896605 29712 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:49:54.896786 29712 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260808 14:49:54.896886 29712 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 14:49:54.897033 29712 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.206.194
I20260808 14:49:54.906629 29712 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:33281
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200577490656-27451-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200577490656-27451-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.194.keytab
--principal=kudu/127.26.206.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.206.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200577490656-27451-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.206.194
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.26.206.254:42107
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.206.194
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200577490656-27451-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:49:54.907934 29712 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:49:54.909266 29712 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:49:54.922734 29718 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:49:54.922820 29717 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:49:54.922766 29720 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:49:54.923774 29712 server_base.cc:1034] running on GCE node
I20260808 14:49:54.924430 29712 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:49:54.925292 29712 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:49:54.926479 29712 hybrid_clock.cc:648] HybridClock initialized: now 1786200594926427 us; error 46 us; skew 500 ppm
I20260808 14:49:54.926783 29712 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:49:54 dist-test-slave-6k22 krb5kdc[29423](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200594, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:49:54.929816 29712 init.cc:377] Logged in from keytab as kudu/127.26.206.194@KRBTEST.COM (short username kudu)
I20260808 14:49:54.931535 29712 webserver.cc:460] Webserver started at http://127.26.206.194:34441/ using document root <none> and password file <none>
I20260808 14:49:54.932305 29712 fs_manager.cc:359] Metadata directory not provided
I20260808 14:49:54.932463 29712 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:49:54.932852 29712 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:49:54.936072 29712 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200577490656-27451-0/minicluster-data/ts-1/data/instance:
uuid: "2c40e0aed672465e9c53c9e7e62aaff2"
format_stamp: "Formatted at 2026-08-08 14:49:54 on dist-test-slave-6k22"
server_key: "42b0912f3bcbc0b395f96592e7f86312"
server_key_iv: "4e7a282d5fdc68c456d53db048624fe7"
server_key_version: "encryptionkey@0"
I20260808 14:49:54.936882 29712 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200577490656-27451-0/minicluster-data/ts-1/wal/instance:
uuid: "2c40e0aed672465e9c53c9e7e62aaff2"
format_stamp: "Formatted at 2026-08-08 14:49:54 on dist-test-slave-6k22"
server_key: "42b0912f3bcbc0b395f96592e7f86312"
server_key_iv: "4e7a282d5fdc68c456d53db048624fe7"
server_key_version: "encryptionkey@0"
I20260808 14:49:54.942210 29712 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.004s
I20260808 14:49:54.945833 29727 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:49:54.947186 29712 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 14:49:54.947367 29712 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200577490656-27451-0/minicluster-data/ts-1/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200577490656-27451-0/minicluster-data/ts-1/wal
uuid: "2c40e0aed672465e9c53c9e7e62aaff2"
format_stamp: "Formatted at 2026-08-08 14:49:54 on dist-test-slave-6k22"
server_key: "42b0912f3bcbc0b395f96592e7f86312"
server_key_iv: "4e7a282d5fdc68c456d53db048624fe7"
server_key_version: "encryptionkey@0"
I20260808 14:49:54.947594 29712 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200577490656-27451-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200577490656-27451-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200577490656-27451-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:49:54.968032 29712 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:49:54.976760 29712 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:49:54.977084 29712 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:49:54.979785 29712 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:49:54.979918 29712 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:49:54.980041 29712 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:49:54.980173 29712 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.001s sys 0.000s
Aug 08 14:49:54 dist-test-slave-6k22 krb5kdc[29423](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200594, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.194@KRBTEST.COM for kudu/127.26.206.254@KRBTEST.COM
I20260808 14:49:55.001705 29580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:54.980204 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.194:40509 (local address 127.26.206.254:42107)
0808 14:49:54.980417 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:54.980425 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:54.981825 (+ 1400us) server_negotiation.cc:407] Connection header received
0808 14:49:54.983917 (+ 2092us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:54.983923 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:54.984013 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:54.984123 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:54.986241 (+ 2118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:54.987383 (+ 1142us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:54.989646 (+ 2263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:54.990206 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:54.990349 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:54.995317 (+ 4968us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:49:54.995325 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:49:54.995334 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:49:54.995366 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:49:54.998553 (+ 3187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:54.999257 (+ 704us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:54.999262 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:54.999266 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:54.999400 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:54.999936 (+ 536us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:54.999941 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:54.999943 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:55.000282 (+ 339us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:49:55.000454 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:55.001092 (+ 638us) server_negotiation.cc:299] Negotiation successful
0808 14:49:55.001358 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260808 14:49:55.002812 29737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:54.980880 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:42107 (local address 127.26.206.194:40509)
0808 14:49:54.981651 (+ 771us) negotiation.cc:107] Waiting for socket to connect
0808 14:49:54.981696 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 14:49:54.983475 (+ 1779us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:49:54.984348 (+ 873us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:49:54.984356 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:49:54.985093 (+ 737us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:49:54.985995 (+ 902us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:54.986025 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:54.987549 (+ 1524us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:54.987577 (+ 28us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:54.989502 (+ 1925us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:54.989514 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:54.990707 (+ 1193us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:54.990717 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:54.991040 (+ 323us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:54.991729 (+ 689us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:49:54.991756 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:49:54.995008 (+ 3252us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:49:54.998694 (+ 3686us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:49:54.998702 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:49:54.998716 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:49:54.999127 (+ 411us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:49:54.999513 (+ 386us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:49:54.999518 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:49:54.999521 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:49:54.999786 (+ 265us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:49:55.000419 (+ 633us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:49:55.000426 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:49:55.000747 (+ 321us) client_negotiation.cc:769] Sending connection context
0808 14:49:55.001002 (+ 255us) client_negotiation.cc:240] Negotiation successful
0808 14:49:55.001510 (+ 508us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":546,"thread_start_us":351,"threads_started":1}
I20260808 14:49:55.023590 29580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:55.009610 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.194:49145 (local address 127.26.206.254:42107)
0808 14:49:55.009752 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:55.009756 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:55.010135 (+ 379us) server_negotiation.cc:407] Connection header received
0808 14:49:55.010318 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:55.010322 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:55.010376 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:55.010450 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:55.011945 (+ 1495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:55.013081 (+ 1136us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:55.014421 (+ 1340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:55.014800 (+ 379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:55.014937 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:55.017249 (+ 2312us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:49:55.017257 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:49:55.017262 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:49:55.017299 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:49:55.020846 (+ 3547us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:55.021480 (+ 634us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:55.021487 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:55.021490 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:55.021690 (+ 200us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:55.022100 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:55.022106 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:55.022109 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:55.022428 (+ 319us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:49:55.022579 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:55.022986 (+ 407us) server_negotiation.cc:299] Negotiation successful
0808 14:49:55.023207 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260808 14:49:55.023700 29806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:55.009105 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:42107 (local address 127.26.206.194:49145)
0808 14:49:55.010013 (+ 908us) negotiation.cc:107] Waiting for socket to connect
0808 14:49:55.010038 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0808 14:49:55.010204 (+ 166us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:49:55.010518 (+ 314us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:49:55.010525 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:49:55.011257 (+ 732us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:49:55.011782 (+ 525us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:55.011799 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:55.013237 (+ 1438us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:55.013245 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:55.014271 (+ 1026us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:55.014282 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:55.014980 (+ 698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:55.014986 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:55.015157 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:55.015898 (+ 741us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:49:55.015926 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:49:55.017035 (+ 1109us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:49:55.020969 (+ 3934us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:49:55.020975 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:49:55.020983 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:49:55.021363 (+ 380us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:49:55.021859 (+ 496us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:49:55.021864 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:49:55.021867 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:49:55.021993 (+ 126us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:49:55.022545 (+ 552us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:49:55.022549 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:49:55.022724 (+ 175us) client_negotiation.cc:769] Sending connection context
0808 14:49:55.022894 (+ 170us) client_negotiation.cc:240] Negotiation successful
0808 14:49:55.023207 (+ 313us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":664,"spinlock_wait_cycles":28928,"thread_start_us":650,"threads_started":1}
I20260808 14:49:55.034581 29712 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.194:33511
I20260808 14:49:55.034621 29869 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.194:33511 every 8 connection(s)
I20260808 14:49:55.036007 29712 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200577490656-27451-0/minicluster-data/ts-1/data/info.pb
I20260808 14:49:55.036481 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 29712
I20260808 14:49:55.036717 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200577490656-27451-0/minicluster-data/ts-1/wal/instance
I20260808 14:49:55.037180 27451 external_mini_cluster.cc:1428] Setting key 689abb0511e1ea99bfd34fb8cdd24938
I20260808 14:49:55.038453 29871 heartbeater.cc:347] Connected to a master server at 127.26.206.254:42107
I20260808 14:49:55.038781 29871 heartbeater.cc:464] Registering TS with master...
I20260808 14:49:55.039830 29871 heartbeater.cc:511] Master 127.26.206.254:42107 requested a full tablet report, sending...
I20260808 14:49:55.041711 29474 ts_manager.cc:194] Registered new tserver with Master: 2c40e0aed672465e9c53c9e7e62aaff2 (127.26.206.194:33511)
I20260808 14:49:55.043040 29474 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.206.194@KRBTEST.COM'} at 127.26.206.194:40509
WARNING: no policy specified for kudu/127.26.206.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.206.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.206.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.195.keytab.
Entry for principal kudu/127.26.206.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.195.keytab.
I20260808 14:49:55.082185 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200577490656-27451-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200577490656-27451-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200577490656-27451-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200577490656-27451-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.206.195:0
--local_ip_for_outbound_sockets=127.26.206.195
--webserver_interface=127.26.206.195
--webserver_port=0
--tserver_master_addrs=127.26.206.254:42107
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.195.keytab
--principal=kudu/127.26.206.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.206.212:33281
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:49:55.402220 29875 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:49:55.402513 29875 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:49:55.402611 29875 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:49:55.409991 29875 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:49:55.410099 29875 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:49:55.410182 29875 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260808 14:49:55.410234 29875 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 14:49:55.410307 29875 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.206.195
I20260808 14:49:55.419803 29875 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:33281
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200577490656-27451-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200577490656-27451-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.195.keytab
--principal=kudu/127.26.206.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.206.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200577490656-27451-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.206.195
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.26.206.254:42107
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.206.195
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200577490656-27451-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:49:55.420970 29875 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:49:55.422185 29875 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:49:55.434877 29880 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:49:55.434852 29883 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:49:55.434969 29881 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:49:55.436143 29875 server_base.cc:1034] running on GCE node
I20260808 14:49:55.436733 29875 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:49:55.437613 29875 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:49:55.438841 29875 hybrid_clock.cc:648] HybridClock initialized: now 1786200595438798 us; error 53 us; skew 500 ppm
I20260808 14:49:55.439143 29875 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:49:55 dist-test-slave-6k22 krb5kdc[29423](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200595, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:49:55.442201 29875 init.cc:377] Logged in from keytab as kudu/127.26.206.195@KRBTEST.COM (short username kudu)
I20260808 14:49:55.443596 29875 webserver.cc:460] Webserver started at http://127.26.206.195:45273/ using document root <none> and password file <none>
I20260808 14:49:55.444231 29875 fs_manager.cc:359] Metadata directory not provided
I20260808 14:49:55.444377 29875 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:49:55.444677 29875 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:49:55.447491 29875 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200577490656-27451-0/minicluster-data/ts-2/data/instance:
uuid: "904e26d82d1e46ff99739a527f3969c8"
format_stamp: "Formatted at 2026-08-08 14:49:55 on dist-test-slave-6k22"
server_key: "6a63599aecf77673bc229b6f553aac55"
server_key_iv: "d96258125e1a929ec5fdb6b8d4bd4448"
server_key_version: "encryptionkey@0"
I20260808 14:49:55.448346 29875 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200577490656-27451-0/minicluster-data/ts-2/wal/instance:
uuid: "904e26d82d1e46ff99739a527f3969c8"
format_stamp: "Formatted at 2026-08-08 14:49:55 on dist-test-slave-6k22"
server_key: "6a63599aecf77673bc229b6f553aac55"
server_key_iv: "d96258125e1a929ec5fdb6b8d4bd4448"
server_key_version: "encryptionkey@0"
I20260808 14:49:55.453438 29875 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.003s
I20260808 14:49:55.456737 29891 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:49:55.457934 29875 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 14:49:55.458103 29875 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200577490656-27451-0/minicluster-data/ts-2/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200577490656-27451-0/minicluster-data/ts-2/wal
uuid: "904e26d82d1e46ff99739a527f3969c8"
format_stamp: "Formatted at 2026-08-08 14:49:55 on dist-test-slave-6k22"
server_key: "6a63599aecf77673bc229b6f553aac55"
server_key_iv: "d96258125e1a929ec5fdb6b8d4bd4448"
server_key_version: "encryptionkey@0"
I20260808 14:49:55.458302 29875 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200577490656-27451-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200577490656-27451-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200577490656-27451-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:49:55.480038 29875 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:49:55.483853 29875 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:49:55.484133 29875 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:49:55.486689 29875 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:49:55.486835 29875 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:49:55.486959 29875 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:49:55.487054 29875 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 14:49:55 dist-test-slave-6k22 krb5kdc[29423](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200595, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.195@KRBTEST.COM for kudu/127.26.206.254@KRBTEST.COM
I20260808 14:49:55.508152 29708 heartbeater.cc:503] Master 127.26.206.254:42107 was elected leader, sending a full tablet report...
I20260808 14:49:55.510545 29580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:55.487458 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.195:48401 (local address 127.26.206.254:42107)
0808 14:49:55.487678 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:55.487684 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:55.489101 (+ 1417us) server_negotiation.cc:407] Connection header received
0808 14:49:55.492164 (+ 3063us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:55.492170 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:55.492277 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:55.492394 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:55.494617 (+ 2223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:55.495714 (+ 1097us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:55.498770 (+ 3056us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:55.499392 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:55.499525 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:55.502958 (+ 3433us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:49:55.502966 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:49:55.502973 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:49:55.503021 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:49:55.506601 (+ 3580us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:55.507363 (+ 762us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:55.507369 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:55.507374 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:55.507511 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:55.508046 (+ 535us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:55.508055 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:55.508061 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:55.508553 (+ 492us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:49:55.508800 (+ 247us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:55.509702 (+ 902us) server_negotiation.cc:299] Negotiation successful
0808 14:49:55.510037 (+ 335us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260808 14:49:55.511157 29902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:55.488007 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:42107 (local address 127.26.206.195:48401)
0808 14:49:55.488913 (+ 906us) negotiation.cc:107] Waiting for socket to connect
0808 14:49:55.488964 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0808 14:49:55.491772 (+ 2808us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:49:55.492673 (+ 901us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:49:55.492681 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:49:55.493414 (+ 733us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:49:55.494360 (+ 946us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:55.494393 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:55.495910 (+ 1517us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:55.495915 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:55.498619 (+ 2704us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:55.498631 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:55.499668 (+ 1037us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:55.499677 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:55.499867 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:55.500562 (+ 695us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:49:55.500588 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:49:55.502749 (+ 2161us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:49:55.506754 (+ 4005us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:49:55.506770 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:49:55.506789 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:49:55.507213 (+ 424us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:49:55.507666 (+ 453us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:49:55.507671 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:49:55.507674 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:49:55.507900 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:49:55.508756 (+ 856us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:49:55.508773 (+ 17us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:49:55.509174 (+ 401us) client_negotiation.cc:769] Sending connection context
0808 14:49:55.509469 (+ 295us) client_negotiation.cc:240] Negotiation successful
0808 14:49:55.510004 (+ 535us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":601,"thread_start_us":358,"threads_started":1}
I20260808 14:49:55.532773 29956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:55.517344 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:42107 (local address 127.26.206.195:43921)
0808 14:49:55.518156 (+ 812us) negotiation.cc:107] Waiting for socket to connect
0808 14:49:55.518181 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0808 14:49:55.518341 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:49:55.518694 (+ 353us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:49:55.518702 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:49:55.519484 (+ 782us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:49:55.519972 (+ 488us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:55.519988 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:55.520964 (+ 976us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:55.520972 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:55.523066 (+ 2094us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:55.523086 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:55.524028 (+ 942us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:55.524037 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:55.524209 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:55.524929 (+ 720us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:49:55.524960 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:49:55.526072 (+ 1112us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:49:55.529579 (+ 3507us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:49:55.529583 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:49:55.529585 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:49:55.530130 (+ 545us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:49:55.530568 (+ 438us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:49:55.530573 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:49:55.530577 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:49:55.530722 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:49:55.531255 (+ 533us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:49:55.531270 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:49:55.531468 (+ 198us) client_negotiation.cc:769] Sending connection context
0808 14:49:55.531682 (+ 214us) client_negotiation.cc:240] Negotiation successful
0808 14:49:55.532060 (+ 378us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":624,"thread_start_us":376,"threads_started":1}
I20260808 14:49:55.533365 29580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:55.517338 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.195:43921 (local address 127.26.206.254:42107)
0808 14:49:55.517551 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:55.517559 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:55.518288 (+ 729us) server_negotiation.cc:407] Connection header received
0808 14:49:55.518474 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:55.518477 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:55.518548 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:55.518629 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:55.520124 (+ 1495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:55.520824 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:55.523215 (+ 2391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:55.523834 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:55.523973 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:55.526261 (+ 2288us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:49:55.526266 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:49:55.526270 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:49:55.526298 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:49:55.529412 (+ 3114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:55.530321 (+ 909us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:55.530332 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:55.530335 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:55.530451 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:55.530842 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:55.530850 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:55.530854 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:55.531134 (+ 280us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:49:55.531303 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:55.532785 (+ 1482us) server_negotiation.cc:299] Negotiation successful
0808 14:49:55.533055 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260808 14:49:55.545934 29875 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.195:41007
I20260808 14:49:55.545974 30025 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.195:41007 every 8 connection(s)
I20260808 14:49:55.547178 29875 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200577490656-27451-0/minicluster-data/ts-2/data/info.pb
I20260808 14:49:55.549335 30027 heartbeater.cc:347] Connected to a master server at 127.26.206.254:42107
I20260808 14:49:55.549521 30027 heartbeater.cc:464] Registering TS with master...
I20260808 14:49:55.550135 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 29875
I20260808 14:49:55.550274 30027 heartbeater.cc:511] Master 127.26.206.254:42107 requested a full tablet report, sending...
I20260808 14:49:55.550354 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200577490656-27451-0/minicluster-data/ts-2/wal/instance
I20260808 14:49:55.550962 27451 external_mini_cluster.cc:1428] Setting key 404973b0c6dd5c599608b1457f10867f
I20260808 14:49:55.551820 29474 ts_manager.cc:194] Registered new tserver with Master: 904e26d82d1e46ff99739a527f3969c8 (127.26.206.195:41007)
I20260808 14:49:55.552848 29474 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.206.195@KRBTEST.COM'} at 127.26.206.195:48401
I20260808 14:49:55.554150 27451 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 08 14:49:55 dist-test-slave-6k22 krb5kdc[29423](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200595, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 14:49:55 dist-test-slave-6k22 krb5kdc[29423](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200595, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.206.254@KRBTEST.COM
I20260808 14:49:55.604813 29580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:55.591340 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35188 (local address 127.26.206.254:42107)
0808 14:49:55.591613 (+ 273us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:55.591621 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:55.591803 (+ 182us) server_negotiation.cc:407] Connection header received
0808 14:49:55.591962 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:55.591967 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:55.592031 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:55.592117 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:55.593491 (+ 1374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:55.594227 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:55.595416 (+ 1189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:55.595860 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:55.595953 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:55.599683 (+ 3730us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:49:55.599688 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:49:55.599690 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:49:55.599722 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:49:55.602169 (+ 2447us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:55.602786 (+ 617us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:55.602791 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:55.602796 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:55.602927 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:55.603309 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:55.603315 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:55.603318 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:55.603640 (+ 322us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:49:55.603910 (+ 270us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:55.604200 (+ 290us) server_negotiation.cc:299] Negotiation successful
0808 14:49:55.604426 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260808 14:49:55.608889 29475 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35188:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:49:55.616096 29475 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:49:55.639798 30044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:55.628189 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58020 (local address 127.26.206.195:41007)
0808 14:49:55.631529 (+ 3340us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:55.631537 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:55.631591 (+ 54us) server_negotiation.cc:407] Connection header received
0808 14:49:55.631690 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:55.631695 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:55.631869 (+ 174us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:55.632058 (+ 189us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:49:55.632704 (+ 646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:55.634061 (+ 1357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:55.637195 (+ 3134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:55.638672 (+ 1477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:55.638869 (+ 197us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:55.639024 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:55.639312 (+ 288us) server_negotiation.cc:299] Negotiation successful
0808 14:49:55.639428 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3165,"thread_start_us":3001,"threads_started":1}
I20260808 14:49:55.639940 30041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:55.627488 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.195:41007 (local address 127.0.0.1:58020)
0808 14:49:55.629789 (+ 2301us) negotiation.cc:107] Waiting for socket to connect
0808 14:49:55.629808 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 14:49:55.629947 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:49:55.632047 (+ 2100us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:49:55.632052 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:49:55.632077 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:49:55.632500 (+ 423us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:55.632518 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:55.634186 (+ 1668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:55.634193 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:55.636999 (+ 2806us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:55.637014 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:55.638886 (+ 1872us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:55.638894 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:55.639071 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:55.639124 (+ 53us) client_negotiation.cc:769] Sending connection context
0808 14:49:55.639268 (+ 144us) client_negotiation.cc:240] Negotiation successful
0808 14:49:55.639452 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2179,"mutex_wait_us":67,"spinlock_wait_cycles":5376,"thread_start_us":947,"threads_started":1}
I20260808 14:49:55.640123 30045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:55.629177 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.194:33511 (local address 127.0.0.1:55618)
0808 14:49:55.630767 (+ 1590us) negotiation.cc:107] Waiting for socket to connect
0808 14:49:55.630788 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 14:49:55.630917 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:49:55.632415 (+ 1498us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:49:55.632425 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:49:55.632459 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:49:55.633971 (+ 1512us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:55.633984 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:55.635665 (+ 1681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:55.635669 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:55.637565 (+ 1896us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:55.637578 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:55.639239 (+ 1661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:55.639246 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:55.639425 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:55.639455 (+ 30us) client_negotiation.cc:769] Sending connection context
0808 14:49:55.639537 (+ 82us) client_negotiation.cc:240] Negotiation successful
0808 14:49:55.639692 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1442,"mutex_wait_us":7,"thread_start_us":1240,"threads_started":1}
I20260808 14:49:55.640674 30042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:55.627370 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.193:37433 (local address 127.0.0.1:49960)
0808 14:49:55.628335 (+ 965us) negotiation.cc:107] Waiting for socket to connect
0808 14:49:55.628378 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 14:49:55.628547 (+ 169us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:49:55.629799 (+ 1252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:49:55.629806 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:49:55.629837 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:49:55.630357 (+ 520us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:55.630374 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:55.632513 (+ 2139us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:55.632519 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:55.637001 (+ 4482us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:55.637014 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:55.639747 (+ 2733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:55.639756 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:55.640005 (+ 249us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:55.640034 (+ 29us) client_negotiation.cc:769] Sending connection context
0808 14:49:55.640122 (+ 88us) client_negotiation.cc:240] Negotiation successful
0808 14:49:55.640243 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":700,"mutex_wait_us":652,"spinlock_wait_cycles":15104,"thread_start_us":1985,"threads_started":1}
I20260808 14:49:55.640867 30046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:55.629821 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55618 (local address 127.26.206.194:33511)
0808 14:49:55.631738 (+ 1917us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:55.631745 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:55.631771 (+ 26us) server_negotiation.cc:407] Connection header received
0808 14:49:55.631860 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:55.631868 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:55.632130 (+ 262us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:55.632322 (+ 192us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:49:55.634181 (+ 1859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:55.635437 (+ 1256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:55.637758 (+ 2321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:55.638730 (+ 972us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:55.638933 (+ 203us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:55.639091 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:55.640420 (+ 1329us) server_negotiation.cc:299] Negotiation successful
0808 14:49:55.640598 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1763,"thread_start_us":1616,"threads_started":1}
I20260808 14:49:55.641489 30043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:55.627650 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49960 (local address 127.26.206.193:37433)
0808 14:49:55.629131 (+ 1481us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:55.629140 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:55.629167 (+ 27us) server_negotiation.cc:407] Connection header received
0808 14:49:55.629266 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:55.629276 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:55.629536 (+ 260us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:55.630611 (+ 1075us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:49:55.630833 (+ 222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:55.632349 (+ 1516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:55.637195 (+ 4846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:55.638672 (+ 1477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:55.638851 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:55.639024 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:55.641014 (+ 1990us) server_negotiation.cc:299] Negotiation successful
0808 14:49:55.641188 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1308,"thread_start_us":1166,"threads_started":1}
I20260808 14:49:55.643961 29952 tablet_service.cc:1467] Processing CreateTablet for tablet e13954245a2d442aaaf29aca665cb3bb (DEFAULT_TABLE table=test-table [id=64278e433a7f487e959a3d3a4bd44d95]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:49:55.644305 29786 tablet_service.cc:1467] Processing CreateTablet for tablet e13954245a2d442aaaf29aca665cb3bb (DEFAULT_TABLE table=test-table [id=64278e433a7f487e959a3d3a4bd44d95]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:49:55.645246 29952 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e13954245a2d442aaaf29aca665cb3bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:49:55.644917 29632 tablet_service.cc:1467] Processing CreateTablet for tablet e13954245a2d442aaaf29aca665cb3bb (DEFAULT_TABLE table=test-table [id=64278e433a7f487e959a3d3a4bd44d95]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:49:55.645740 29786 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e13954245a2d442aaaf29aca665cb3bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:49:55.646229 29632 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e13954245a2d442aaaf29aca665cb3bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:49:55.656399 30047 tablet_bootstrap.cc:492] T e13954245a2d442aaaf29aca665cb3bb P 904e26d82d1e46ff99739a527f3969c8: Bootstrap starting.
I20260808 14:49:55.659965 30047 tablet_bootstrap.cc:654] T e13954245a2d442aaaf29aca665cb3bb P 904e26d82d1e46ff99739a527f3969c8: Neither blocks nor log segments found. Creating new log.
I20260808 14:49:55.661386 30047 log.cc:824] T e13954245a2d442aaaf29aca665cb3bb P 904e26d82d1e46ff99739a527f3969c8: Log is configured to *not* fsync() on all Append() calls
I20260808 14:49:55.661590 30048 tablet_bootstrap.cc:492] T e13954245a2d442aaaf29aca665cb3bb P 8fc0d02ecec34e88b5dff67bbe42ab86: Bootstrap starting.
I20260808 14:49:55.663111 30050 tablet_bootstrap.cc:492] T e13954245a2d442aaaf29aca665cb3bb P 2c40e0aed672465e9c53c9e7e62aaff2: Bootstrap starting.
I20260808 14:49:55.666023 30050 tablet_bootstrap.cc:654] T e13954245a2d442aaaf29aca665cb3bb P 2c40e0aed672465e9c53c9e7e62aaff2: Neither blocks nor log segments found. Creating new log.
I20260808 14:49:55.666234 30048 tablet_bootstrap.cc:654] T e13954245a2d442aaaf29aca665cb3bb P 8fc0d02ecec34e88b5dff67bbe42ab86: Neither blocks nor log segments found. Creating new log.
I20260808 14:49:55.667318 30050 log.cc:824] T e13954245a2d442aaaf29aca665cb3bb P 2c40e0aed672465e9c53c9e7e62aaff2: Log is configured to *not* fsync() on all Append() calls
I20260808 14:49:55.667389 30048 log.cc:824] T e13954245a2d442aaaf29aca665cb3bb P 8fc0d02ecec34e88b5dff67bbe42ab86: Log is configured to *not* fsync() on all Append() calls
I20260808 14:49:55.669147 30047 tablet_bootstrap.cc:492] T e13954245a2d442aaaf29aca665cb3bb P 904e26d82d1e46ff99739a527f3969c8: No bootstrap required, opened a new log
I20260808 14:49:55.669468 30047 ts_tablet_manager.cc:1397] T e13954245a2d442aaaf29aca665cb3bb P 904e26d82d1e46ff99739a527f3969c8: Time spent bootstrapping tablet: real 0.013s user 0.006s sys 0.005s
I20260808 14:49:55.669764 30050 tablet_bootstrap.cc:492] T e13954245a2d442aaaf29aca665cb3bb P 2c40e0aed672465e9c53c9e7e62aaff2: No bootstrap required, opened a new log
I20260808 14:49:55.670007 30050 ts_tablet_manager.cc:1397] T e13954245a2d442aaaf29aca665cb3bb P 2c40e0aed672465e9c53c9e7e62aaff2: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260808 14:49:55.676185 30048 tablet_bootstrap.cc:492] T e13954245a2d442aaaf29aca665cb3bb P 8fc0d02ecec34e88b5dff67bbe42ab86: No bootstrap required, opened a new log
I20260808 14:49:55.676460 30048 ts_tablet_manager.cc:1397] T e13954245a2d442aaaf29aca665cb3bb P 8fc0d02ecec34e88b5dff67bbe42ab86: Time spent bootstrapping tablet: real 0.015s user 0.005s sys 0.008s
I20260808 14:49:55.677613 30050 raft_consensus.cc:348] T e13954245a2d442aaaf29aca665cb3bb P 2c40e0aed672465e9c53c9e7e62aaff2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fc0d02ecec34e88b5dff67bbe42ab86" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 37433 } } peers { permanent_uuid: "904e26d82d1e46ff99739a527f3969c8" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 41007 } } peers { permanent_uuid: "2c40e0aed672465e9c53c9e7e62aaff2" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 33511 } }
I20260808 14:49:55.678000 30050 raft_consensus.cc:374] T e13954245a2d442aaaf29aca665cb3bb P 2c40e0aed672465e9c53c9e7e62aaff2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:49:55.678121 30050 raft_consensus.cc:729] T e13954245a2d442aaaf29aca665cb3bb P 2c40e0aed672465e9c53c9e7e62aaff2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c40e0aed672465e9c53c9e7e62aaff2, State: Initialized, Role: FOLLOWER
I20260808 14:49:55.678730 30050 consensus_queue.cc:260] T e13954245a2d442aaaf29aca665cb3bb P 2c40e0aed672465e9c53c9e7e62aaff2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fc0d02ecec34e88b5dff67bbe42ab86" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 37433 } } peers { permanent_uuid: "904e26d82d1e46ff99739a527f3969c8" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 41007 } } peers { permanent_uuid: "2c40e0aed672465e9c53c9e7e62aaff2" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 33511 } }
I20260808 14:49:55.679842 29871 heartbeater.cc:503] Master 127.26.206.254:42107 was elected leader, sending a full tablet report...
I20260808 14:49:55.680332 30050 ts_tablet_manager.cc:1428] T e13954245a2d442aaaf29aca665cb3bb P 2c40e0aed672465e9c53c9e7e62aaff2: Time spent starting tablet: real 0.010s user 0.007s sys 0.004s
I20260808 14:49:55.681208 30047 raft_consensus.cc:348] T e13954245a2d442aaaf29aca665cb3bb P 904e26d82d1e46ff99739a527f3969c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fc0d02ecec34e88b5dff67bbe42ab86" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 37433 } } peers { permanent_uuid: "904e26d82d1e46ff99739a527f3969c8" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 41007 } } peers { permanent_uuid: "2c40e0aed672465e9c53c9e7e62aaff2" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 33511 } }
I20260808 14:49:55.681610 30047 raft_consensus.cc:374] T e13954245a2d442aaaf29aca665cb3bb P 904e26d82d1e46ff99739a527f3969c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:49:55.681739 30047 raft_consensus.cc:729] T e13954245a2d442aaaf29aca665cb3bb P 904e26d82d1e46ff99739a527f3969c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 904e26d82d1e46ff99739a527f3969c8, State: Initialized, Role: FOLLOWER
I20260808 14:49:55.682365 30047 consensus_queue.cc:260] T e13954245a2d442aaaf29aca665cb3bb P 904e26d82d1e46ff99739a527f3969c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fc0d02ecec34e88b5dff67bbe42ab86" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 37433 } } peers { permanent_uuid: "904e26d82d1e46ff99739a527f3969c8" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 41007 } } peers { permanent_uuid: "2c40e0aed672465e9c53c9e7e62aaff2" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 33511 } }
I20260808 14:49:55.683466 30027 heartbeater.cc:503] Master 127.26.206.254:42107 was elected leader, sending a full tablet report...
I20260808 14:49:55.684038 30047 ts_tablet_manager.cc:1428] T e13954245a2d442aaaf29aca665cb3bb P 904e26d82d1e46ff99739a527f3969c8: Time spent starting tablet: real 0.014s user 0.016s sys 0.000s
I20260808 14:49:55.688000 30048 raft_consensus.cc:348] T e13954245a2d442aaaf29aca665cb3bb P 8fc0d02ecec34e88b5dff67bbe42ab86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fc0d02ecec34e88b5dff67bbe42ab86" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 37433 } } peers { permanent_uuid: "904e26d82d1e46ff99739a527f3969c8" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 41007 } } peers { permanent_uuid: "2c40e0aed672465e9c53c9e7e62aaff2" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 33511 } }
I20260808 14:49:55.688381 30048 raft_consensus.cc:374] T e13954245a2d442aaaf29aca665cb3bb P 8fc0d02ecec34e88b5dff67bbe42ab86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:49:55.688484 30048 raft_consensus.cc:729] T e13954245a2d442aaaf29aca665cb3bb P 8fc0d02ecec34e88b5dff67bbe42ab86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fc0d02ecec34e88b5dff67bbe42ab86, State: Initialized, Role: FOLLOWER
I20260808 14:49:55.688989 30048 consensus_queue.cc:260] T e13954245a2d442aaaf29aca665cb3bb P 8fc0d02ecec34e88b5dff67bbe42ab86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fc0d02ecec34e88b5dff67bbe42ab86" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 37433 } } peers { permanent_uuid: "904e26d82d1e46ff99739a527f3969c8" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 41007 } } peers { permanent_uuid: "2c40e0aed672465e9c53c9e7e62aaff2" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 33511 } }
I20260808 14:49:55.690212 30048 ts_tablet_manager.cc:1428] T e13954245a2d442aaaf29aca665cb3bb P 8fc0d02ecec34e88b5dff67bbe42ab86: Time spent starting tablet: real 0.014s user 0.010s sys 0.003s
I20260808 14:49:55.712359 30057 raft_consensus.cc:482] T e13954245a2d442aaaf29aca665cb3bb P 8fc0d02ecec34e88b5dff67bbe42ab86 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:49:55.712692 30057 raft_consensus.cc:504] T e13954245a2d442aaaf29aca665cb3bb P 8fc0d02ecec34e88b5dff67bbe42ab86 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fc0d02ecec34e88b5dff67bbe42ab86" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 37433 } } peers { permanent_uuid: "904e26d82d1e46ff99739a527f3969c8" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 41007 } } peers { permanent_uuid: "2c40e0aed672465e9c53c9e7e62aaff2" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 33511 } }
I20260808 14:49:55.714464 30057 leader_election.cc:288] T e13954245a2d442aaaf29aca665cb3bb P 8fc0d02ecec34e88b5dff67bbe42ab86 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 904e26d82d1e46ff99739a527f3969c8 (127.26.206.195:41007), 2c40e0aed672465e9c53c9e7e62aaff2 (127.26.206.194:33511)
I20260808 14:49:55.723209 30046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:55.715878 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.193:50923 (local address 127.26.206.194:33511)
0808 14:49:55.716109 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:55.716116 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:55.716290 (+ 174us) server_negotiation.cc:407] Connection header received
0808 14:49:55.716446 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:55.716450 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:55.716503 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:55.716571 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:49:55.717172 (+ 601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:55.718179 (+ 1007us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:55.720795 (+ 2616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:55.722020 (+ 1225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:55.722196 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:55.722269 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:55.722817 (+ 548us) server_negotiation.cc:299] Negotiation successful
0808 14:49:55.722937 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260808 14:49:55.723405 30059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:55.715496 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.194:33511 (local address 127.26.206.193:50923)
0808 14:49:55.716148 (+ 652us) negotiation.cc:107] Waiting for socket to connect
0808 14:49:55.716186 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 14:49:55.716310 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:49:55.716620 (+ 310us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:49:55.716628 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:49:55.716659 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:49:55.717008 (+ 349us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:55.717016 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:55.718300 (+ 1284us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:55.718307 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:55.720622 (+ 2315us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:55.720637 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:55.722317 (+ 1680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:55.722321 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:55.722572 (+ 251us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:55.722665 (+ 93us) client_negotiation.cc:769] Sending connection context
0808 14:49:55.722764 (+ 99us) client_negotiation.cc:240] Negotiation successful
0808 14:49:55.722940 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":526,"mutex_wait_us":168,"thread_start_us":351,"threads_started":1}
I20260808 14:49:55.723502 30044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:55.714843 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.193:43909 (local address 127.26.206.195:41007)
0808 14:49:55.715085 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:55.715094 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:55.715978 (+ 884us) server_negotiation.cc:407] Connection header received
0808 14:49:55.716062 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:55.716066 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:55.716123 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:55.716195 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:49:55.716877 (+ 682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:55.717907 (+ 1030us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:55.720787 (+ 2880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:55.722037 (+ 1250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:55.722196 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:55.722269 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:55.722807 (+ 538us) server_negotiation.cc:299] Negotiation successful
0808 14:49:55.722937 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260808 14:49:55.723584 30058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:55.714809 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.195:41007 (local address 127.26.206.193:43909)
0808 14:49:55.715470 (+ 661us) negotiation.cc:107] Waiting for socket to connect
0808 14:49:55.715491 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 14:49:55.715656 (+ 165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:49:55.716248 (+ 592us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:49:55.716253 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:49:55.716278 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:49:55.716701 (+ 423us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:55.716718 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:55.718041 (+ 1323us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:55.718045 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:55.720626 (+ 2581us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:55.720637 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:55.722294 (+ 1657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:55.722306 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:55.722574 (+ 268us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:55.722674 (+ 100us) client_negotiation.cc:769] Sending connection context
0808 14:49:55.722770 (+ 96us) client_negotiation.cc:240] Negotiation successful
0808 14:49:55.722944 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":530,"mutex_wait_us":265,"thread_start_us":367,"threads_started":1}
I20260808 14:49:55.724586 29816 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e13954245a2d442aaaf29aca665cb3bb" candidate_uuid: "8fc0d02ecec34e88b5dff67bbe42ab86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c40e0aed672465e9c53c9e7e62aaff2" is_pre_election: true
I20260808 14:49:55.724642 29974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e13954245a2d442aaaf29aca665cb3bb" candidate_uuid: "8fc0d02ecec34e88b5dff67bbe42ab86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "904e26d82d1e46ff99739a527f3969c8" is_pre_election: true
I20260808 14:49:55.725070 29816 raft_consensus.cc:2454] T e13954245a2d442aaaf29aca665cb3bb P 2c40e0aed672465e9c53c9e7e62aaff2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8fc0d02ecec34e88b5dff67bbe42ab86 in term 0.
I20260808 14:49:55.725164 29974 raft_consensus.cc:2454] T e13954245a2d442aaaf29aca665cb3bb P 904e26d82d1e46ff99739a527f3969c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8fc0d02ecec34e88b5dff67bbe42ab86 in term 0.
I20260808 14:49:55.725728 29576 leader_election.cc:302] T e13954245a2d442aaaf29aca665cb3bb P 8fc0d02ecec34e88b5dff67bbe42ab86 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c40e0aed672465e9c53c9e7e62aaff2, 8fc0d02ecec34e88b5dff67bbe42ab86; no voters:
I20260808 14:49:55.726109 30057 raft_consensus.cc:2781] T e13954245a2d442aaaf29aca665cb3bb P 8fc0d02ecec34e88b5dff67bbe42ab86 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:49:55.726267 30057 raft_consensus.cc:482] T e13954245a2d442aaaf29aca665cb3bb P 8fc0d02ecec34e88b5dff67bbe42ab86 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:49:55.726397 30057 raft_consensus.cc:3037] T e13954245a2d442aaaf29aca665cb3bb P 8fc0d02ecec34e88b5dff67bbe42ab86 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:49:55.728650 30057 raft_consensus.cc:504] T e13954245a2d442aaaf29aca665cb3bb P 8fc0d02ecec34e88b5dff67bbe42ab86 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fc0d02ecec34e88b5dff67bbe42ab86" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 37433 } } peers { permanent_uuid: "904e26d82d1e46ff99739a527f3969c8" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 41007 } } peers { permanent_uuid: "2c40e0aed672465e9c53c9e7e62aaff2" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 33511 } }
I20260808 14:49:55.729223 30057 leader_election.cc:288] T e13954245a2d442aaaf29aca665cb3bb P 8fc0d02ecec34e88b5dff67bbe42ab86 [CANDIDATE]: Term 1 election: Requested vote from peers 904e26d82d1e46ff99739a527f3969c8 (127.26.206.195:41007), 2c40e0aed672465e9c53c9e7e62aaff2 (127.26.206.194:33511)
I20260808 14:49:55.729622 29974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e13954245a2d442aaaf29aca665cb3bb" candidate_uuid: "8fc0d02ecec34e88b5dff67bbe42ab86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "904e26d82d1e46ff99739a527f3969c8"
I20260808 14:49:55.729666 29816 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e13954245a2d442aaaf29aca665cb3bb" candidate_uuid: "8fc0d02ecec34e88b5dff67bbe42ab86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c40e0aed672465e9c53c9e7e62aaff2"
I20260808 14:49:55.729818 29974 raft_consensus.cc:3037] T e13954245a2d442aaaf29aca665cb3bb P 904e26d82d1e46ff99739a527f3969c8 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:49:55.729843 29816 raft_consensus.cc:3037] T e13954245a2d442aaaf29aca665cb3bb P 2c40e0aed672465e9c53c9e7e62aaff2 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:49:55.732187 29816 raft_consensus.cc:2454] T e13954245a2d442aaaf29aca665cb3bb P 2c40e0aed672465e9c53c9e7e62aaff2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8fc0d02ecec34e88b5dff67bbe42ab86 in term 1.
I20260808 14:49:55.732188 29974 raft_consensus.cc:2454] T e13954245a2d442aaaf29aca665cb3bb P 904e26d82d1e46ff99739a527f3969c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8fc0d02ecec34e88b5dff67bbe42ab86 in term 1.
I20260808 14:49:55.732550 29576 leader_election.cc:302] T e13954245a2d442aaaf29aca665cb3bb P 8fc0d02ecec34e88b5dff67bbe42ab86 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8fc0d02ecec34e88b5dff67bbe42ab86, 904e26d82d1e46ff99739a527f3969c8; no voters:
I20260808 14:49:55.732899 30057 raft_consensus.cc:2781] T e13954245a2d442aaaf29aca665cb3bb P 8fc0d02ecec34e88b5dff67bbe42ab86 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:49:55.733439 30057 raft_consensus.cc:686] T e13954245a2d442aaaf29aca665cb3bb P 8fc0d02ecec34e88b5dff67bbe42ab86 [term 1 LEADER]: Becoming Leader. State: Replica: 8fc0d02ecec34e88b5dff67bbe42ab86, State: Running, Role: LEADER
I20260808 14:49:55.733898 30057 consensus_queue.cc:237] T e13954245a2d442aaaf29aca665cb3bb P 8fc0d02ecec34e88b5dff67bbe42ab86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fc0d02ecec34e88b5dff67bbe42ab86" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 37433 } } peers { permanent_uuid: "904e26d82d1e46ff99739a527f3969c8" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 41007 } } peers { permanent_uuid: "2c40e0aed672465e9c53c9e7e62aaff2" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 33511 } }
I20260808 14:49:55.738225 29475 catalog_manager.cc:5495] T e13954245a2d442aaaf29aca665cb3bb P 8fc0d02ecec34e88b5dff67bbe42ab86 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8fc0d02ecec34e88b5dff67bbe42ab86 (127.26.206.193). New cstate: current_term: 1 leader_uuid: "8fc0d02ecec34e88b5dff67bbe42ab86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fc0d02ecec34e88b5dff67bbe42ab86" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 37433 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "904e26d82d1e46ff99739a527f3969c8" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 41007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c40e0aed672465e9c53c9e7e62aaff2" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 33511 } health_report { overall_health: UNKNOWN } } }
W20260808 14:49:55.750617 29709 tablet.cc:2369] T e13954245a2d442aaaf29aca665cb3bb P 8fc0d02ecec34e88b5dff67bbe42ab86: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 14:49:55.793870 29872 tablet.cc:2369] T e13954245a2d442aaaf29aca665cb3bb P 2c40e0aed672465e9c53c9e7e62aaff2: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 08 14:49:55 dist-test-slave-6k22 krb5kdc[29423](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200593, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.254@KRBTEST.COM for kudu/127.26.206.254@KRBTEST.COM
W20260808 14:49:55.798868 30028 tablet.cc:2369] T e13954245a2d442aaaf29aca665cb3bb P 904e26d82d1e46ff99739a527f3969c8: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:49:55.803175 29580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:55.789947 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35196 (local address 127.26.206.254:42107)
0808 14:49:55.790114 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:55.790119 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:55.790650 (+ 531us) server_negotiation.cc:407] Connection header received
0808 14:49:55.790800 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:55.790804 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:55.790860 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:55.790940 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:55.792164 (+ 1224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:55.792936 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:55.794186 (+ 1250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:55.794581 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:55.794717 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:55.797859 (+ 3142us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:49:55.797864 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:49:55.797867 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:49:55.797892 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:49:55.800643 (+ 2751us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:55.801264 (+ 621us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:55.801272 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:55.801288 (+ 16us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:55.801392 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:55.801758 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:55.801764 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:55.801768 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:55.802025 (+ 257us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:49:55.802171 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:55.802560 (+ 389us) server_negotiation.cc:299] Negotiation successful
0808 14:49:55.802861 (+ 301us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":119,"server-negotiator.queue_time_us":65}
I20260808 14:49:55.803210 30067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:55.789988 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:42107 (local address 127.0.0.1:35196)
0808 14:49:55.790551 (+ 563us) negotiation.cc:107] Waiting for socket to connect
0808 14:49:55.790566 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 14:49:55.790682 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:49:55.790980 (+ 298us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:49:55.790983 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:49:55.791692 (+ 709us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:49:55.792018 (+ 326us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:55.792027 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:55.793041 (+ 1014us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:55.793044 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:55.794023 (+ 979us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:55.794037 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:55.794753 (+ 716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:55.794759 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:55.794929 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:55.795625 (+ 696us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:49:55.795643 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:49:55.797684 (+ 2041us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:49:55.800772 (+ 3088us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:49:55.800792 (+ 20us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:49:55.800799 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:49:55.801151 (+ 352us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:49:55.801501 (+ 350us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:49:55.801505 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:49:55.801509 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:49:55.801656 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:49:55.802147 (+ 491us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:49:55.802154 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:49:55.802320 (+ 166us) client_negotiation.cc:769] Sending connection context
0808 14:49:55.802477 (+ 157us) client_negotiation.cc:240] Negotiation successful
0808 14:49:55.802739 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":445,"thread_start_us":306,"threads_started":1}
I20260808 14:49:55.808202 29475 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.26.206.254@KRBTEST.COM'} at 127.0.0.1:35196:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260808 14:49:55.809124 29475 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:49:55.816089 29786 tablet_service.cc:1467] Processing CreateTablet for tablet 61da1a5ffe804381b3dc6b93dd19d4ad (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=2f2eb08414db43acafa7d29bfa3b669c]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 14:49:55.816000 29632 tablet_service.cc:1467] Processing CreateTablet for tablet 61da1a5ffe804381b3dc6b93dd19d4ad (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=2f2eb08414db43acafa7d29bfa3b669c]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 14:49:55.816298 29952 tablet_service.cc:1467] Processing CreateTablet for tablet 61da1a5ffe804381b3dc6b93dd19d4ad (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=2f2eb08414db43acafa7d29bfa3b669c]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 14:49:55.817010 29786 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 61da1a5ffe804381b3dc6b93dd19d4ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:49:55.817031 29632 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 61da1a5ffe804381b3dc6b93dd19d4ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:49:55.817037 29952 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 61da1a5ffe804381b3dc6b93dd19d4ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:49:55.822806 30050 tablet_bootstrap.cc:492] T 61da1a5ffe804381b3dc6b93dd19d4ad P 2c40e0aed672465e9c53c9e7e62aaff2: Bootstrap starting.
I20260808 14:49:55.824178 30047 tablet_bootstrap.cc:492] T 61da1a5ffe804381b3dc6b93dd19d4ad P 904e26d82d1e46ff99739a527f3969c8: Bootstrap starting.
I20260808 14:49:55.824523 30050 tablet_bootstrap.cc:654] T 61da1a5ffe804381b3dc6b93dd19d4ad P 2c40e0aed672465e9c53c9e7e62aaff2: Neither blocks nor log segments found. Creating new log.
I20260808 14:49:55.825878 30047 tablet_bootstrap.cc:654] T 61da1a5ffe804381b3dc6b93dd19d4ad P 904e26d82d1e46ff99739a527f3969c8: Neither blocks nor log segments found. Creating new log.
I20260808 14:49:55.826025 30048 tablet_bootstrap.cc:492] T 61da1a5ffe804381b3dc6b93dd19d4ad P 8fc0d02ecec34e88b5dff67bbe42ab86: Bootstrap starting.
I20260808 14:49:55.827598 30048 tablet_bootstrap.cc:654] T 61da1a5ffe804381b3dc6b93dd19d4ad P 8fc0d02ecec34e88b5dff67bbe42ab86: Neither blocks nor log segments found. Creating new log.
I20260808 14:49:55.828022 30047 tablet_bootstrap.cc:492] T 61da1a5ffe804381b3dc6b93dd19d4ad P 904e26d82d1e46ff99739a527f3969c8: No bootstrap required, opened a new log
I20260808 14:49:55.828173 30047 ts_tablet_manager.cc:1397] T 61da1a5ffe804381b3dc6b93dd19d4ad P 904e26d82d1e46ff99739a527f3969c8: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260808 14:49:55.828297 30050 tablet_bootstrap.cc:492] T 61da1a5ffe804381b3dc6b93dd19d4ad P 2c40e0aed672465e9c53c9e7e62aaff2: No bootstrap required, opened a new log
I20260808 14:49:55.828447 30050 ts_tablet_manager.cc:1397] T 61da1a5ffe804381b3dc6b93dd19d4ad P 2c40e0aed672465e9c53c9e7e62aaff2: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.003s
I20260808 14:49:55.829041 30050 raft_consensus.cc:348] T 61da1a5ffe804381b3dc6b93dd19d4ad P 2c40e0aed672465e9c53c9e7e62aaff2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fc0d02ecec34e88b5dff67bbe42ab86" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 37433 } } peers { permanent_uuid: "2c40e0aed672465e9c53c9e7e62aaff2" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 33511 } } peers { permanent_uuid: "904e26d82d1e46ff99739a527f3969c8" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 41007 } }
I20260808 14:49:55.829245 30050 raft_consensus.cc:374] T 61da1a5ffe804381b3dc6b93dd19d4ad P 2c40e0aed672465e9c53c9e7e62aaff2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:49:55.829088 30047 raft_consensus.cc:348] T 61da1a5ffe804381b3dc6b93dd19d4ad P 904e26d82d1e46ff99739a527f3969c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fc0d02ecec34e88b5dff67bbe42ab86" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 37433 } } peers { permanent_uuid: "2c40e0aed672465e9c53c9e7e62aaff2" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 33511 } } peers { permanent_uuid: "904e26d82d1e46ff99739a527f3969c8" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 41007 } }
I20260808 14:49:55.829347 30050 raft_consensus.cc:729] T 61da1a5ffe804381b3dc6b93dd19d4ad P 2c40e0aed672465e9c53c9e7e62aaff2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c40e0aed672465e9c53c9e7e62aaff2, State: Initialized, Role: FOLLOWER
I20260808 14:49:55.829386 30047 raft_consensus.cc:374] T 61da1a5ffe804381b3dc6b93dd19d4ad P 904e26d82d1e46ff99739a527f3969c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:49:55.829593 30047 raft_consensus.cc:729] T 61da1a5ffe804381b3dc6b93dd19d4ad P 904e26d82d1e46ff99739a527f3969c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 904e26d82d1e46ff99739a527f3969c8, State: Initialized, Role: FOLLOWER
I20260808 14:49:55.829567 30050 consensus_queue.cc:260] T 61da1a5ffe804381b3dc6b93dd19d4ad P 2c40e0aed672465e9c53c9e7e62aaff2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fc0d02ecec34e88b5dff67bbe42ab86" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 37433 } } peers { permanent_uuid: "2c40e0aed672465e9c53c9e7e62aaff2" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 33511 } } peers { permanent_uuid: "904e26d82d1e46ff99739a527f3969c8" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 41007 } }
I20260808 14:49:55.830014 30047 consensus_queue.cc:260] T 61da1a5ffe804381b3dc6b93dd19d4ad P 904e26d82d1e46ff99739a527f3969c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fc0d02ecec34e88b5dff67bbe42ab86" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 37433 } } peers { permanent_uuid: "2c40e0aed672465e9c53c9e7e62aaff2" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 33511 } } peers { permanent_uuid: "904e26d82d1e46ff99739a527f3969c8" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 41007 } }
I20260808 14:49:55.830415 30054 tablet_replica.cc:439] T 61da1a5ffe804381b3dc6b93dd19d4ad P 2c40e0aed672465e9c53c9e7e62aaff2: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fc0d02ecec34e88b5dff67bbe42ab86" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 37433 } } peers { permanent_uuid: "2c40e0aed672465e9c53c9e7e62aaff2" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 33511 } } peers { permanent_uuid: "904e26d82d1e46ff99739a527f3969c8" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 41007 } } }
I20260808 14:49:55.830785 30054 tablet_replica.cc:442] T 61da1a5ffe804381b3dc6b93dd19d4ad P 2c40e0aed672465e9c53c9e7e62aaff2: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 14:49:55.830504 30056 tablet_replica.cc:439] T 61da1a5ffe804381b3dc6b93dd19d4ad P 904e26d82d1e46ff99739a527f3969c8: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fc0d02ecec34e88b5dff67bbe42ab86" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 37433 } } peers { permanent_uuid: "2c40e0aed672465e9c53c9e7e62aaff2" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 33511 } } peers { permanent_uuid: "904e26d82d1e46ff99739a527f3969c8" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 41007 } } }
I20260808 14:49:55.830931 30056 tablet_replica.cc:442] T 61da1a5ffe804381b3dc6b93dd19d4ad P 904e26d82d1e46ff99739a527f3969c8: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 14:49:55.832165 30047 ts_tablet_manager.cc:1428] T 61da1a5ffe804381b3dc6b93dd19d4ad P 904e26d82d1e46ff99739a527f3969c8: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260808 14:49:55.833801 30050 ts_tablet_manager.cc:1428] T 61da1a5ffe804381b3dc6b93dd19d4ad P 2c40e0aed672465e9c53c9e7e62aaff2: Time spent starting tablet: real 0.005s user 0.000s sys 0.002s
I20260808 14:49:55.836719 30048 tablet_bootstrap.cc:492] T 61da1a5ffe804381b3dc6b93dd19d4ad P 8fc0d02ecec34e88b5dff67bbe42ab86: No bootstrap required, opened a new log
I20260808 14:49:55.836874 30048 ts_tablet_manager.cc:1397] T 61da1a5ffe804381b3dc6b93dd19d4ad P 8fc0d02ecec34e88b5dff67bbe42ab86: Time spent bootstrapping tablet: real 0.011s user 0.009s sys 0.000s
I20260808 14:49:55.837497 30048 raft_consensus.cc:348] T 61da1a5ffe804381b3dc6b93dd19d4ad P 8fc0d02ecec34e88b5dff67bbe42ab86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fc0d02ecec34e88b5dff67bbe42ab86" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 37433 } } peers { permanent_uuid: "2c40e0aed672465e9c53c9e7e62aaff2" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 33511 } } peers { permanent_uuid: "904e26d82d1e46ff99739a527f3969c8" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 41007 } }
I20260808 14:49:55.837670 30048 raft_consensus.cc:374] T 61da1a5ffe804381b3dc6b93dd19d4ad P 8fc0d02ecec34e88b5dff67bbe42ab86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:49:55.837815 30048 raft_consensus.cc:729] T 61da1a5ffe804381b3dc6b93dd19d4ad P 8fc0d02ecec34e88b5dff67bbe42ab86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fc0d02ecec34e88b5dff67bbe42ab86, State: Initialized, Role: FOLLOWER
I20260808 14:49:55.838049 30048 consensus_queue.cc:260] T 61da1a5ffe804381b3dc6b93dd19d4ad P 8fc0d02ecec34e88b5dff67bbe42ab86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fc0d02ecec34e88b5dff67bbe42ab86" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 37433 } } peers { permanent_uuid: "2c40e0aed672465e9c53c9e7e62aaff2" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 33511 } } peers { permanent_uuid: "904e26d82d1e46ff99739a527f3969c8" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 41007 } }
I20260808 14:49:55.838536 30048 ts_tablet_manager.cc:1428] T 61da1a5ffe804381b3dc6b93dd19d4ad P 8fc0d02ecec34e88b5dff67bbe42ab86: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260808 14:49:55.838495 30057 tablet_replica.cc:439] T 61da1a5ffe804381b3dc6b93dd19d4ad P 8fc0d02ecec34e88b5dff67bbe42ab86: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fc0d02ecec34e88b5dff67bbe42ab86" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 37433 } } peers { permanent_uuid: "2c40e0aed672465e9c53c9e7e62aaff2" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 33511 } } peers { permanent_uuid: "904e26d82d1e46ff99739a527f3969c8" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 41007 } } }
I20260808 14:49:55.838798 30057 tablet_replica.cc:442] T 61da1a5ffe804381b3dc6b93dd19d4ad P 8fc0d02ecec34e88b5dff67bbe42ab86: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 14:49:56.145026 30057 raft_consensus.cc:482] T 61da1a5ffe804381b3dc6b93dd19d4ad P 8fc0d02ecec34e88b5dff67bbe42ab86 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:49:56.145220 30057 raft_consensus.cc:504] T 61da1a5ffe804381b3dc6b93dd19d4ad P 8fc0d02ecec34e88b5dff67bbe42ab86 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fc0d02ecec34e88b5dff67bbe42ab86" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 37433 } } peers { permanent_uuid: "2c40e0aed672465e9c53c9e7e62aaff2" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 33511 } } peers { permanent_uuid: "904e26d82d1e46ff99739a527f3969c8" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 41007 } }
I20260808 14:49:56.145781 30057 leader_election.cc:288] T 61da1a5ffe804381b3dc6b93dd19d4ad P 8fc0d02ecec34e88b5dff67bbe42ab86 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c40e0aed672465e9c53c9e7e62aaff2 (127.26.206.194:33511), 904e26d82d1e46ff99739a527f3969c8 (127.26.206.195:41007)
I20260808 14:49:56.146385 29816 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "61da1a5ffe804381b3dc6b93dd19d4ad" candidate_uuid: "8fc0d02ecec34e88b5dff67bbe42ab86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c40e0aed672465e9c53c9e7e62aaff2" is_pre_election: true
I20260808 14:49:56.146477 29974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "61da1a5ffe804381b3dc6b93dd19d4ad" candidate_uuid: "8fc0d02ecec34e88b5dff67bbe42ab86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "904e26d82d1e46ff99739a527f3969c8" is_pre_election: true
I20260808 14:49:56.146643 29816 raft_consensus.cc:2454] T 61da1a5ffe804381b3dc6b93dd19d4ad P 2c40e0aed672465e9c53c9e7e62aaff2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8fc0d02ecec34e88b5dff67bbe42ab86 in term 0.
I20260808 14:49:56.146792 29974 raft_consensus.cc:2454] T 61da1a5ffe804381b3dc6b93dd19d4ad P 904e26d82d1e46ff99739a527f3969c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8fc0d02ecec34e88b5dff67bbe42ab86 in term 0.
I20260808 14:49:56.147112 29576 leader_election.cc:302] T 61da1a5ffe804381b3dc6b93dd19d4ad P 8fc0d02ecec34e88b5dff67bbe42ab86 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c40e0aed672465e9c53c9e7e62aaff2, 8fc0d02ecec34e88b5dff67bbe42ab86; no voters:
I20260808 14:49:56.147404 30057 raft_consensus.cc:2781] T 61da1a5ffe804381b3dc6b93dd19d4ad P 8fc0d02ecec34e88b5dff67bbe42ab86 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:49:56.147513 30057 raft_consensus.cc:482] T 61da1a5ffe804381b3dc6b93dd19d4ad P 8fc0d02ecec34e88b5dff67bbe42ab86 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:49:56.147671 30057 raft_consensus.cc:3037] T 61da1a5ffe804381b3dc6b93dd19d4ad P 8fc0d02ecec34e88b5dff67bbe42ab86 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:49:56.149786 30057 raft_consensus.cc:504] T 61da1a5ffe804381b3dc6b93dd19d4ad P 8fc0d02ecec34e88b5dff67bbe42ab86 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fc0d02ecec34e88b5dff67bbe42ab86" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 37433 } } peers { permanent_uuid: "2c40e0aed672465e9c53c9e7e62aaff2" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 33511 } } peers { permanent_uuid: "904e26d82d1e46ff99739a527f3969c8" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 41007 } }
I20260808 14:49:56.150313 30057 leader_election.cc:288] T 61da1a5ffe804381b3dc6b93dd19d4ad P 8fc0d02ecec34e88b5dff67bbe42ab86 [CANDIDATE]: Term 1 election: Requested vote from peers 2c40e0aed672465e9c53c9e7e62aaff2 (127.26.206.194:33511), 904e26d82d1e46ff99739a527f3969c8 (127.26.206.195:41007)
I20260808 14:49:56.150684 29816 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "61da1a5ffe804381b3dc6b93dd19d4ad" candidate_uuid: "8fc0d02ecec34e88b5dff67bbe42ab86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c40e0aed672465e9c53c9e7e62aaff2"
I20260808 14:49:56.150727 29974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "61da1a5ffe804381b3dc6b93dd19d4ad" candidate_uuid: "8fc0d02ecec34e88b5dff67bbe42ab86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "904e26d82d1e46ff99739a527f3969c8"
I20260808 14:49:56.150887 29816 raft_consensus.cc:3037] T 61da1a5ffe804381b3dc6b93dd19d4ad P 2c40e0aed672465e9c53c9e7e62aaff2 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:49:56.150928 29974 raft_consensus.cc:3037] T 61da1a5ffe804381b3dc6b93dd19d4ad P 904e26d82d1e46ff99739a527f3969c8 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:49:56.153028 29974 raft_consensus.cc:2454] T 61da1a5ffe804381b3dc6b93dd19d4ad P 904e26d82d1e46ff99739a527f3969c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8fc0d02ecec34e88b5dff67bbe42ab86 in term 1.
I20260808 14:49:56.153261 29816 raft_consensus.cc:2454] T 61da1a5ffe804381b3dc6b93dd19d4ad P 2c40e0aed672465e9c53c9e7e62aaff2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8fc0d02ecec34e88b5dff67bbe42ab86 in term 1.
I20260808 14:49:56.153457 29576 leader_election.cc:302] T 61da1a5ffe804381b3dc6b93dd19d4ad P 8fc0d02ecec34e88b5dff67bbe42ab86 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8fc0d02ecec34e88b5dff67bbe42ab86, 904e26d82d1e46ff99739a527f3969c8; no voters:
I20260808 14:49:56.153712 30057 raft_consensus.cc:2781] T 61da1a5ffe804381b3dc6b93dd19d4ad P 8fc0d02ecec34e88b5dff67bbe42ab86 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:49:56.153882 30057 raft_consensus.cc:686] T 61da1a5ffe804381b3dc6b93dd19d4ad P 8fc0d02ecec34e88b5dff67bbe42ab86 [term 1 LEADER]: Becoming Leader. State: Replica: 8fc0d02ecec34e88b5dff67bbe42ab86, State: Running, Role: LEADER
I20260808 14:49:56.154134 30057 consensus_queue.cc:237] T 61da1a5ffe804381b3dc6b93dd19d4ad P 8fc0d02ecec34e88b5dff67bbe42ab86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fc0d02ecec34e88b5dff67bbe42ab86" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 37433 } } peers { permanent_uuid: "2c40e0aed672465e9c53c9e7e62aaff2" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 33511 } } peers { permanent_uuid: "904e26d82d1e46ff99739a527f3969c8" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 41007 } }
I20260808 14:49:56.155500 30060 tablet_replica.cc:439] T 61da1a5ffe804381b3dc6b93dd19d4ad P 8fc0d02ecec34e88b5dff67bbe42ab86: TxnStatusTablet state changed. Reason: New leader 8fc0d02ecec34e88b5dff67bbe42ab86. Latest consensus state: current_term: 1 leader_uuid: "8fc0d02ecec34e88b5dff67bbe42ab86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fc0d02ecec34e88b5dff67bbe42ab86" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 37433 } } peers { permanent_uuid: "2c40e0aed672465e9c53c9e7e62aaff2" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 33511 } } peers { permanent_uuid: "904e26d82d1e46ff99739a527f3969c8" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 41007 } } }
I20260808 14:49:56.155812 30060 tablet_replica.cc:442] T 61da1a5ffe804381b3dc6b93dd19d4ad P 8fc0d02ecec34e88b5dff67bbe42ab86: This TxnStatusTablet replica's current role is: LEADER
I20260808 14:49:56.156518 30073 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260808 14:49:56.156797 30073 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260808 14:49:56.157030 29475 catalog_manager.cc:5495] T 61da1a5ffe804381b3dc6b93dd19d4ad P 8fc0d02ecec34e88b5dff67bbe42ab86 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8fc0d02ecec34e88b5dff67bbe42ab86 (127.26.206.193). New cstate: current_term: 1 leader_uuid: "8fc0d02ecec34e88b5dff67bbe42ab86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fc0d02ecec34e88b5dff67bbe42ab86" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 37433 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c40e0aed672465e9c53c9e7e62aaff2" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 33511 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "904e26d82d1e46ff99739a527f3969c8" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 41007 } health_report { overall_health: UNKNOWN } } }
I20260808 14:49:56.206959 30067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:56.192292 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.193:37433 (local address 127.0.0.1:49974)
0808 14:49:56.192546 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0808 14:49:56.192568 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 14:49:56.192713 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:49:56.201629 (+ 8916us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:49:56.201634 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:49:56.201647 (+ 13us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 14:49:56.201881 (+ 234us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:56.201893 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:56.203032 (+ 1139us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:56.203041 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:56.204225 (+ 1184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:56.204237 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:56.205126 (+ 889us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:56.205131 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:56.205312 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:56.205367 (+ 55us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 14:49:56.206358 (+ 991us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 14:49:56.206381 (+ 23us) client_negotiation.cc:769] Sending connection context
0808 14:49:56.206489 (+ 108us) client_negotiation.cc:240] Negotiation successful
0808 14:49:56.206647 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":66}
I20260808 14:49:56.207031 30076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:56.192490 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49974 (local address 127.26.206.193:37433)
0808 14:49:56.201230 (+ 8740us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:56.201234 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:56.201250 (+ 16us) server_negotiation.cc:407] Connection header received
0808 14:49:56.201334 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:56.201337 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:56.201417 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:56.201607 (+ 190us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:49:56.202071 (+ 464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:56.202868 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:56.204407 (+ 1539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:56.204963 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:56.205096 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:56.205614 (+ 518us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:49:56.206228 (+ 614us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:49:56.206386 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:56.206534 (+ 148us) server_negotiation.cc:299] Negotiation successful
0808 14:49:56.206620 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":8641,"thread_start_us":8496,"threads_started":1}
I20260808 14:49:56.216215 29816 raft_consensus.cc:1261] T 61da1a5ffe804381b3dc6b93dd19d4ad P 2c40e0aed672465e9c53c9e7e62aaff2 [term 1 FOLLOWER]: Refusing update from remote peer 8fc0d02ecec34e88b5dff67bbe42ab86: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:49:56.216238 29974 raft_consensus.cc:1261] T 61da1a5ffe804381b3dc6b93dd19d4ad P 904e26d82d1e46ff99739a527f3969c8 [term 1 FOLLOWER]: Refusing update from remote peer 8fc0d02ecec34e88b5dff67bbe42ab86: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:49:56.217231 30060 consensus_queue.cc:1035] T 61da1a5ffe804381b3dc6b93dd19d4ad P 8fc0d02ecec34e88b5dff67bbe42ab86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "904e26d82d1e46ff99739a527f3969c8" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 41007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:49:56.217567 30057 consensus_queue.cc:1035] T 61da1a5ffe804381b3dc6b93dd19d4ad P 8fc0d02ecec34e88b5dff67bbe42ab86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c40e0aed672465e9c53c9e7e62aaff2" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 33511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:49:56.226475 30060 consensus_queue.cc:1035] T e13954245a2d442aaaf29aca665cb3bb P 8fc0d02ecec34e88b5dff67bbe42ab86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "904e26d82d1e46ff99739a527f3969c8" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 41007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:49:56.228691 30056 tablet_replica.cc:439] T 61da1a5ffe804381b3dc6b93dd19d4ad P 904e26d82d1e46ff99739a527f3969c8: TxnStatusTablet state changed. Reason: New leader 8fc0d02ecec34e88b5dff67bbe42ab86. Latest consensus state: current_term: 1 leader_uuid: "8fc0d02ecec34e88b5dff67bbe42ab86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fc0d02ecec34e88b5dff67bbe42ab86" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 37433 } } peers { permanent_uuid: "2c40e0aed672465e9c53c9e7e62aaff2" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 33511 } } peers { permanent_uuid: "904e26d82d1e46ff99739a527f3969c8" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 41007 } } }
I20260808 14:49:56.228969 30056 tablet_replica.cc:442] T 61da1a5ffe804381b3dc6b93dd19d4ad P 904e26d82d1e46ff99739a527f3969c8: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 14:49:56.238291 30077 mvcc.cc:205] Tried to move back new op lower bound from 7316277642090868736 to 7316277641849290752. Current Snapshot: MvccSnapshot[applied={T|T < 7316277642090868736}]
I20260808 14:49:56.241837 30054 tablet_replica.cc:439] T 61da1a5ffe804381b3dc6b93dd19d4ad P 2c40e0aed672465e9c53c9e7e62aaff2: TxnStatusTablet state changed. Reason: New leader 8fc0d02ecec34e88b5dff67bbe42ab86. Latest consensus state: current_term: 1 leader_uuid: "8fc0d02ecec34e88b5dff67bbe42ab86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fc0d02ecec34e88b5dff67bbe42ab86" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 37433 } } peers { permanent_uuid: "2c40e0aed672465e9c53c9e7e62aaff2" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 33511 } } peers { permanent_uuid: "904e26d82d1e46ff99739a527f3969c8" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 41007 } } }
I20260808 14:49:56.242102 30054 tablet_replica.cc:442] T 61da1a5ffe804381b3dc6b93dd19d4ad P 2c40e0aed672465e9c53c9e7e62aaff2: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 14:49:56.243800 30056 tablet_replica.cc:439] T 61da1a5ffe804381b3dc6b93dd19d4ad P 904e26d82d1e46ff99739a527f3969c8: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "8fc0d02ecec34e88b5dff67bbe42ab86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fc0d02ecec34e88b5dff67bbe42ab86" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 37433 } } peers { permanent_uuid: "2c40e0aed672465e9c53c9e7e62aaff2" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 33511 } } peers { permanent_uuid: "904e26d82d1e46ff99739a527f3969c8" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 41007 } } }
I20260808 14:49:56.244028 30056 tablet_replica.cc:442] T 61da1a5ffe804381b3dc6b93dd19d4ad P 904e26d82d1e46ff99739a527f3969c8: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 14:49:56.249529 30090 consensus_queue.cc:1035] T e13954245a2d442aaaf29aca665cb3bb P 8fc0d02ecec34e88b5dff67bbe42ab86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c40e0aed672465e9c53c9e7e62aaff2" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 33511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:49:56.252943 30054 tablet_replica.cc:439] T 61da1a5ffe804381b3dc6b93dd19d4ad P 2c40e0aed672465e9c53c9e7e62aaff2: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "8fc0d02ecec34e88b5dff67bbe42ab86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fc0d02ecec34e88b5dff67bbe42ab86" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 37433 } } peers { permanent_uuid: "2c40e0aed672465e9c53c9e7e62aaff2" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 33511 } } peers { permanent_uuid: "904e26d82d1e46ff99739a527f3969c8" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 41007 } } }
I20260808 14:49:56.253269 30054 tablet_replica.cc:442] T 61da1a5ffe804381b3dc6b93dd19d4ad P 2c40e0aed672465e9c53c9e7e62aaff2: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 14:49:56.262393 30087 tablet_replica.cc:439] T 61da1a5ffe804381b3dc6b93dd19d4ad P 8fc0d02ecec34e88b5dff67bbe42ab86: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "8fc0d02ecec34e88b5dff67bbe42ab86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fc0d02ecec34e88b5dff67bbe42ab86" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 37433 } } peers { permanent_uuid: "2c40e0aed672465e9c53c9e7e62aaff2" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 33511 } } peers { permanent_uuid: "904e26d82d1e46ff99739a527f3969c8" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 41007 } } }
I20260808 14:49:56.262737 30087 tablet_replica.cc:442] T 61da1a5ffe804381b3dc6b93dd19d4ad P 8fc0d02ecec34e88b5dff67bbe42ab86: This TxnStatusTablet replica's current role is: LEADER
I20260808 14:49:56.262982 30087 tablet_replica.cc:439] T 61da1a5ffe804381b3dc6b93dd19d4ad P 8fc0d02ecec34e88b5dff67bbe42ab86: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "8fc0d02ecec34e88b5dff67bbe42ab86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fc0d02ecec34e88b5dff67bbe42ab86" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 37433 } } peers { permanent_uuid: "2c40e0aed672465e9c53c9e7e62aaff2" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 33511 } } peers { permanent_uuid: "904e26d82d1e46ff99739a527f3969c8" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 41007 } } }
I20260808 14:49:56.263207 30087 tablet_replica.cc:442] T 61da1a5ffe804381b3dc6b93dd19d4ad P 8fc0d02ecec34e88b5dff67bbe42ab86: This TxnStatusTablet replica's current role is: LEADER
I20260808 14:49:56.274829 30076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:56.267590 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49986 (local address 127.26.206.193:37433)
0808 14:49:56.267761 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:56.267769 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:56.269590 (+ 1821us) server_negotiation.cc:407] Connection header received
0808 14:49:56.269780 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:56.269785 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:56.269882 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:56.269988 (+ 106us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:49:56.270451 (+ 463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:56.271585 (+ 1134us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:56.272933 (+ 1348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:56.273632 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:56.273756 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:56.274132 (+ 376us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:49:56.274266 (+ 134us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:49:56.274356 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:56.274478 (+ 122us) server_negotiation.cc:299] Negotiation successful
0808 14:49:56.274571 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260808 14:49:56.292222 30076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:56.285680 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.193:48037 (local address 127.26.206.193:37433)
0808 14:49:56.285897 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:56.285905 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:56.286600 (+ 695us) server_negotiation.cc:407] Connection header received
0808 14:49:56.286806 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:56.286809 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:56.286888 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:56.286964 (+ 76us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:49:56.287596 (+ 632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:56.288423 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:56.290495 (+ 2072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:56.290960 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:56.291042 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:56.291541 (+ 499us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:49:56.291677 (+ 136us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:49:56.291751 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:56.291919 (+ 168us) server_negotiation.cc:299] Negotiation successful
0808 14:49:56.291975 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260808 14:49:56.292562 30102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:56.285696 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.193:37433 (local address 127.26.206.193:48037)
0808 14:49:56.286496 (+ 800us) negotiation.cc:107] Waiting for socket to connect
0808 14:49:56.286516 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 14:49:56.286662 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:49:56.287015 (+ 353us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:49:56.287020 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:49:56.287034 (+ 14us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 14:49:56.287373 (+ 339us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:56.287397 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:56.288546 (+ 1149us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:56.288552 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:56.290374 (+ 1822us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:56.290389 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:56.291103 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:56.291110 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:56.291273 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:56.291335 (+ 62us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 14:49:56.291779 (+ 444us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 14:49:56.291790 (+ 11us) client_negotiation.cc:769] Sending connection context
0808 14:49:56.291892 (+ 102us) client_negotiation.cc:240] Negotiation successful
0808 14:49:56.292035 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":620,"thread_start_us":457,"threads_started":1}
I20260808 14:49:56.366156 29475 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35188:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:49:56.366451 29475 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35188:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:49:56.369755 29475 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 391255c8e7224cc9864773b0724db188: Sending DeleteTablet for 3 replicas of tablet e13954245a2d442aaaf29aca665cb3bb
I20260808 14:49:56.371006 29786 tablet_service.cc:1514] Processing DeleteTablet for tablet e13954245a2d442aaaf29aca665cb3bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:49:56 UTC) from {username='kudu', principal='kudu/127.26.206.254@KRBTEST.COM'} at 127.0.0.1:55618
I20260808 14:49:56.371028 29632 tablet_service.cc:1514] Processing DeleteTablet for tablet e13954245a2d442aaaf29aca665cb3bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:49:56 UTC) from {username='kudu', principal='kudu/127.26.206.254@KRBTEST.COM'} at 127.0.0.1:49960
I20260808 14:49:56.371843 29952 tablet_service.cc:1514] Processing DeleteTablet for tablet e13954245a2d442aaaf29aca665cb3bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:49:56 UTC) from {username='kudu', principal='kudu/127.26.206.254@KRBTEST.COM'} at 127.0.0.1:58020
I20260808 14:49:56.372107 29475 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35188:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:49:56.372882 29475 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:49:56.376060 30106 tablet_replica.cc:330] T e13954245a2d442aaaf29aca665cb3bb P 904e26d82d1e46ff99739a527f3969c8: stopping tablet replica
I20260808 14:49:56.376713 30106 raft_consensus.cc:2229] T e13954245a2d442aaaf29aca665cb3bb P 904e26d82d1e46ff99739a527f3969c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:49:56.378588 30106 raft_consensus.cc:2258] T e13954245a2d442aaaf29aca665cb3bb P 904e26d82d1e46ff99739a527f3969c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:49:56.381392 29631 tablet_service.cc:1467] Processing CreateTablet for tablet dd8d23a8b8fb4570b4f2576bacc140d0 (DEFAULT_TABLE table=test-table [id=0fd8db859eae4255b10fb5814e5e5f70]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:49:56.381634 29785 tablet_service.cc:1467] Processing CreateTablet for tablet dd8d23a8b8fb4570b4f2576bacc140d0 (DEFAULT_TABLE table=test-table [id=0fd8db859eae4255b10fb5814e5e5f70]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:49:56.381865 29952 tablet_service.cc:1467] Processing CreateTablet for tablet dd8d23a8b8fb4570b4f2576bacc140d0 (DEFAULT_TABLE table=test-table [id=0fd8db859eae4255b10fb5814e5e5f70]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:49:56.382078 29631 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dd8d23a8b8fb4570b4f2576bacc140d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:49:56.382121 29785 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dd8d23a8b8fb4570b4f2576bacc140d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:49:56.382266 29952 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dd8d23a8b8fb4570b4f2576bacc140d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:49:56.390873 30105 tablet_replica.cc:330] T e13954245a2d442aaaf29aca665cb3bb P 2c40e0aed672465e9c53c9e7e62aaff2: stopping tablet replica
I20260808 14:49:56.391325 30105 raft_consensus.cc:2229] T e13954245a2d442aaaf29aca665cb3bb P 2c40e0aed672465e9c53c9e7e62aaff2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:49:56.391858 30105 raft_consensus.cc:2258] T e13954245a2d442aaaf29aca665cb3bb P 2c40e0aed672465e9c53c9e7e62aaff2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:49:56.392513 30109 tablet_bootstrap.cc:492] T dd8d23a8b8fb4570b4f2576bacc140d0 P 2c40e0aed672465e9c53c9e7e62aaff2: Bootstrap starting.
I20260808 14:49:56.394102 30106 ts_tablet_manager.cc:1905] T e13954245a2d442aaaf29aca665cb3bb P 904e26d82d1e46ff99739a527f3969c8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:49:56.394330 30109 tablet_bootstrap.cc:654] T dd8d23a8b8fb4570b4f2576bacc140d0 P 2c40e0aed672465e9c53c9e7e62aaff2: Neither blocks nor log segments found. Creating new log.
I20260808 14:49:56.396903 30105 ts_tablet_manager.cc:1905] T e13954245a2d442aaaf29aca665cb3bb P 2c40e0aed672465e9c53c9e7e62aaff2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:49:56.400493 30104 tablet_replica.cc:330] T e13954245a2d442aaaf29aca665cb3bb P 8fc0d02ecec34e88b5dff67bbe42ab86: stopping tablet replica
I20260808 14:49:56.400964 30104 raft_consensus.cc:2229] T e13954245a2d442aaaf29aca665cb3bb P 8fc0d02ecec34e88b5dff67bbe42ab86 [term 1 LEADER]: Raft consensus shutting down.
I20260808 14:49:56.401662 30104 raft_consensus.cc:2258] T e13954245a2d442aaaf29aca665cb3bb P 8fc0d02ecec34e88b5dff67bbe42ab86 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:49:56.403513 30104 ts_tablet_manager.cc:1905] T e13954245a2d442aaaf29aca665cb3bb P 8fc0d02ecec34e88b5dff67bbe42ab86: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:49:56.405525 30110 tablet_bootstrap.cc:492] T dd8d23a8b8fb4570b4f2576bacc140d0 P 8fc0d02ecec34e88b5dff67bbe42ab86: Bootstrap starting.
I20260808 14:49:56.407729 30110 tablet_bootstrap.cc:654] T dd8d23a8b8fb4570b4f2576bacc140d0 P 8fc0d02ecec34e88b5dff67bbe42ab86: Neither blocks nor log segments found. Creating new log.
I20260808 14:49:56.409152 30108 tablet_bootstrap.cc:492] T dd8d23a8b8fb4570b4f2576bacc140d0 P 904e26d82d1e46ff99739a527f3969c8: Bootstrap starting.
I20260808 14:49:56.410530 30105 ts_tablet_manager.cc:1918] T e13954245a2d442aaaf29aca665cb3bb P 2c40e0aed672465e9c53c9e7e62aaff2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 14:49:56.410722 30106 ts_tablet_manager.cc:1918] T e13954245a2d442aaaf29aca665cb3bb P 904e26d82d1e46ff99739a527f3969c8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 14:49:56.410801 30105 log.cc:1196] T e13954245a2d442aaaf29aca665cb3bb P 2c40e0aed672465e9c53c9e7e62aaff2: Deleting WAL directory at /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200577490656-27451-0/minicluster-data/ts-1/wal/wals/e13954245a2d442aaaf29aca665cb3bb
I20260808 14:49:56.410904 30106 log.cc:1196] T e13954245a2d442aaaf29aca665cb3bb P 904e26d82d1e46ff99739a527f3969c8: Deleting WAL directory at /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200577490656-27451-0/minicluster-data/ts-2/wal/wals/e13954245a2d442aaaf29aca665cb3bb
I20260808 14:49:56.411582 30106 ts_tablet_manager.cc:1939] T e13954245a2d442aaaf29aca665cb3bb P 904e26d82d1e46ff99739a527f3969c8: Deleting consensus metadata
I20260808 14:49:56.411574 30105 ts_tablet_manager.cc:1939] T e13954245a2d442aaaf29aca665cb3bb P 2c40e0aed672465e9c53c9e7e62aaff2: Deleting consensus metadata
I20260808 14:49:56.410884 30109 tablet_bootstrap.cc:492] T dd8d23a8b8fb4570b4f2576bacc140d0 P 2c40e0aed672465e9c53c9e7e62aaff2: No bootstrap required, opened a new log
I20260808 14:49:56.412256 30108 tablet_bootstrap.cc:654] T dd8d23a8b8fb4570b4f2576bacc140d0 P 904e26d82d1e46ff99739a527f3969c8: Neither blocks nor log segments found. Creating new log.
I20260808 14:49:56.412438 30109 ts_tablet_manager.cc:1397] T dd8d23a8b8fb4570b4f2576bacc140d0 P 2c40e0aed672465e9c53c9e7e62aaff2: Time spent bootstrapping tablet: real 0.020s user 0.004s sys 0.000s
I20260808 14:49:56.413434 30109 raft_consensus.cc:348] T dd8d23a8b8fb4570b4f2576bacc140d0 P 2c40e0aed672465e9c53c9e7e62aaff2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fc0d02ecec34e88b5dff67bbe42ab86" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 37433 } } peers { permanent_uuid: "2c40e0aed672465e9c53c9e7e62aaff2" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 33511 } } peers { permanent_uuid: "904e26d82d1e46ff99739a527f3969c8" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 41007 } }
I20260808 14:49:56.413592 29458 catalog_manager.cc:4841] TS 904e26d82d1e46ff99739a527f3969c8 (127.26.206.195:41007): tablet e13954245a2d442aaaf29aca665cb3bb (table test-table [id=64278e433a7f487e959a3d3a4bd44d95]) successfully deleted
I20260808 14:49:56.413890 30109 raft_consensus.cc:374] T dd8d23a8b8fb4570b4f2576bacc140d0 P 2c40e0aed672465e9c53c9e7e62aaff2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:49:56.414057 30109 raft_consensus.cc:729] T dd8d23a8b8fb4570b4f2576bacc140d0 P 2c40e0aed672465e9c53c9e7e62aaff2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c40e0aed672465e9c53c9e7e62aaff2, State: Initialized, Role: FOLLOWER
I20260808 14:49:56.414418 30109 consensus_queue.cc:260] T dd8d23a8b8fb4570b4f2576bacc140d0 P 2c40e0aed672465e9c53c9e7e62aaff2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fc0d02ecec34e88b5dff67bbe42ab86" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 37433 } } peers { permanent_uuid: "2c40e0aed672465e9c53c9e7e62aaff2" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 33511 } } peers { permanent_uuid: "904e26d82d1e46ff99739a527f3969c8" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 41007 } }
I20260808 14:49:56.415117 30110 tablet_bootstrap.cc:492] T dd8d23a8b8fb4570b4f2576bacc140d0 P 8fc0d02ecec34e88b5dff67bbe42ab86: No bootstrap required, opened a new log
I20260808 14:49:56.415107 30109 ts_tablet_manager.cc:1428] T dd8d23a8b8fb4570b4f2576bacc140d0 P 2c40e0aed672465e9c53c9e7e62aaff2: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 14:49:56.415304 30110 ts_tablet_manager.cc:1397] T dd8d23a8b8fb4570b4f2576bacc140d0 P 8fc0d02ecec34e88b5dff67bbe42ab86: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.003s
I20260808 14:49:56.416157 30110 raft_consensus.cc:348] T dd8d23a8b8fb4570b4f2576bacc140d0 P 8fc0d02ecec34e88b5dff67bbe42ab86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fc0d02ecec34e88b5dff67bbe42ab86" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 37433 } } peers { permanent_uuid: "2c40e0aed672465e9c53c9e7e62aaff2" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 33511 } } peers { permanent_uuid: "904e26d82d1e46ff99739a527f3969c8" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 41007 } }
I20260808 14:49:56.416486 29458 catalog_manager.cc:4841] TS 2c40e0aed672465e9c53c9e7e62aaff2 (127.26.206.194:33511): tablet e13954245a2d442aaaf29aca665cb3bb (table test-table [id=64278e433a7f487e959a3d3a4bd44d95]) successfully deleted
I20260808 14:49:56.416714 30110 raft_consensus.cc:374] T dd8d23a8b8fb4570b4f2576bacc140d0 P 8fc0d02ecec34e88b5dff67bbe42ab86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:49:56.416864 30110 raft_consensus.cc:729] T dd8d23a8b8fb4570b4f2576bacc140d0 P 8fc0d02ecec34e88b5dff67bbe42ab86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fc0d02ecec34e88b5dff67bbe42ab86, State: Initialized, Role: FOLLOWER
I20260808 14:49:56.417168 30110 consensus_queue.cc:260] T dd8d23a8b8fb4570b4f2576bacc140d0 P 8fc0d02ecec34e88b5dff67bbe42ab86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fc0d02ecec34e88b5dff67bbe42ab86" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 37433 } } peers { permanent_uuid: "2c40e0aed672465e9c53c9e7e62aaff2" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 33511 } } peers { permanent_uuid: "904e26d82d1e46ff99739a527f3969c8" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 41007 } }
I20260808 14:49:56.418493 30110 ts_tablet_manager.cc:1428] T dd8d23a8b8fb4570b4f2576bacc140d0 P 8fc0d02ecec34e88b5dff67bbe42ab86: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260808 14:49:56.420291 30108 tablet_bootstrap.cc:492] T dd8d23a8b8fb4570b4f2576bacc140d0 P 904e26d82d1e46ff99739a527f3969c8: No bootstrap required, opened a new log
I20260808 14:49:56.420439 30108 ts_tablet_manager.cc:1397] T dd8d23a8b8fb4570b4f2576bacc140d0 P 904e26d82d1e46ff99739a527f3969c8: Time spent bootstrapping tablet: real 0.011s user 0.005s sys 0.000s
I20260808 14:49:56.421180 30108 raft_consensus.cc:348] T dd8d23a8b8fb4570b4f2576bacc140d0 P 904e26d82d1e46ff99739a527f3969c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fc0d02ecec34e88b5dff67bbe42ab86" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 37433 } } peers { permanent_uuid: "2c40e0aed672465e9c53c9e7e62aaff2" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 33511 } } peers { permanent_uuid: "904e26d82d1e46ff99739a527f3969c8" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 41007 } }
I20260808 14:49:56.421432 30108 raft_consensus.cc:374] T dd8d23a8b8fb4570b4f2576bacc140d0 P 904e26d82d1e46ff99739a527f3969c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:49:56.421530 30108 raft_consensus.cc:729] T dd8d23a8b8fb4570b4f2576bacc140d0 P 904e26d82d1e46ff99739a527f3969c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 904e26d82d1e46ff99739a527f3969c8, State: Initialized, Role: FOLLOWER
I20260808 14:49:56.421838 30108 consensus_queue.cc:260] T dd8d23a8b8fb4570b4f2576bacc140d0 P 904e26d82d1e46ff99739a527f3969c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fc0d02ecec34e88b5dff67bbe42ab86" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 37433 } } peers { permanent_uuid: "2c40e0aed672465e9c53c9e7e62aaff2" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 33511 } } peers { permanent_uuid: "904e26d82d1e46ff99739a527f3969c8" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 41007 } }
I20260808 14:49:56.422408 30108 ts_tablet_manager.cc:1428] T dd8d23a8b8fb4570b4f2576bacc140d0 P 904e26d82d1e46ff99739a527f3969c8: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 14:49:56.423529 30104 ts_tablet_manager.cc:1918] T e13954245a2d442aaaf29aca665cb3bb P 8fc0d02ecec34e88b5dff67bbe42ab86: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 14:49:56.423807 30104 log.cc:1196] T e13954245a2d442aaaf29aca665cb3bb P 8fc0d02ecec34e88b5dff67bbe42ab86: Deleting WAL directory at /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200577490656-27451-0/minicluster-data/ts-0/wal/wals/e13954245a2d442aaaf29aca665cb3bb
I20260808 14:49:56.424556 30104 ts_tablet_manager.cc:1939] T e13954245a2d442aaaf29aca665cb3bb P 8fc0d02ecec34e88b5dff67bbe42ab86: Deleting consensus metadata
I20260808 14:49:56.426173 29457 catalog_manager.cc:4841] TS 8fc0d02ecec34e88b5dff67bbe42ab86 (127.26.206.193:37433): tablet e13954245a2d442aaaf29aca665cb3bb (table test-table [id=64278e433a7f487e959a3d3a4bd44d95]) successfully deleted
I20260808 14:49:56.548828 30054 raft_consensus.cc:482] T dd8d23a8b8fb4570b4f2576bacc140d0 P 2c40e0aed672465e9c53c9e7e62aaff2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:49:56.549062 30054 raft_consensus.cc:504] T dd8d23a8b8fb4570b4f2576bacc140d0 P 2c40e0aed672465e9c53c9e7e62aaff2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fc0d02ecec34e88b5dff67bbe42ab86" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 37433 } } peers { permanent_uuid: "2c40e0aed672465e9c53c9e7e62aaff2" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 33511 } } peers { permanent_uuid: "904e26d82d1e46ff99739a527f3969c8" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 41007 } }
I20260808 14:49:56.551131 30054 leader_election.cc:288] T dd8d23a8b8fb4570b4f2576bacc140d0 P 2c40e0aed672465e9c53c9e7e62aaff2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8fc0d02ecec34e88b5dff67bbe42ab86 (127.26.206.193:37433), 904e26d82d1e46ff99739a527f3969c8 (127.26.206.195:41007)
I20260808 14:49:56.571326 30076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:56.551388 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.194:58569 (local address 127.26.206.193:37433)
0808 14:49:56.551600 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:56.551625 (+ 25us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:56.562181 (+ 10556us) server_negotiation.cc:407] Connection header received
0808 14:49:56.562585 (+ 404us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:56.562595 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:56.562716 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:56.562801 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:49:56.564060 (+ 1259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:56.565640 (+ 1580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:56.568563 (+ 2923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:56.570070 (+ 1507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:56.570241 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:56.570308 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:56.570872 (+ 564us) server_negotiation.cc:299] Negotiation successful
0808 14:49:56.571019 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260808 14:49:56.572310 30115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:56.551379 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.193:37433 (local address 127.26.206.194:58569)
0808 14:49:56.562029 (+ 10650us) negotiation.cc:107] Waiting for socket to connect
0808 14:49:56.562057 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0808 14:49:56.562377 (+ 320us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:49:56.563141 (+ 764us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:49:56.563148 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:49:56.563186 (+ 38us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:49:56.563793 (+ 607us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:56.563811 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:56.565891 (+ 2080us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:56.565899 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:56.568406 (+ 2507us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:56.568420 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:56.570425 (+ 2005us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:56.570431 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:56.570616 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:56.570659 (+ 43us) client_negotiation.cc:769] Sending connection context
0808 14:49:56.571758 (+ 1099us) client_negotiation.cc:240] Negotiation successful
0808 14:49:56.571917 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10452,"thread_start_us":10326,"threads_started":1}
I20260808 14:49:56.573299 29657 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dd8d23a8b8fb4570b4f2576bacc140d0" candidate_uuid: "2c40e0aed672465e9c53c9e7e62aaff2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fc0d02ecec34e88b5dff67bbe42ab86" is_pre_election: true
I20260808 14:49:56.573734 29657 raft_consensus.cc:2454] T dd8d23a8b8fb4570b4f2576bacc140d0 P 8fc0d02ecec34e88b5dff67bbe42ab86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c40e0aed672465e9c53c9e7e62aaff2 in term 0.
I20260808 14:49:56.574414 29731 leader_election.cc:302] T dd8d23a8b8fb4570b4f2576bacc140d0 P 2c40e0aed672465e9c53c9e7e62aaff2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c40e0aed672465e9c53c9e7e62aaff2, 8fc0d02ecec34e88b5dff67bbe42ab86; no voters:
I20260808 14:49:56.574899 30054 raft_consensus.cc:2781] T dd8d23a8b8fb4570b4f2576bacc140d0 P 2c40e0aed672465e9c53c9e7e62aaff2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:49:56.575032 30054 raft_consensus.cc:482] T dd8d23a8b8fb4570b4f2576bacc140d0 P 2c40e0aed672465e9c53c9e7e62aaff2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:49:56.575129 30054 raft_consensus.cc:3037] T dd8d23a8b8fb4570b4f2576bacc140d0 P 2c40e0aed672465e9c53c9e7e62aaff2 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:49:56.576525 30116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:56.551678 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.195:41007 (local address 127.26.206.194:38253)
0808 14:49:56.563915 (+ 12237us) negotiation.cc:107] Waiting for socket to connect
0808 14:49:56.563939 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0808 14:49:56.564078 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:49:56.568624 (+ 4546us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:49:56.568628 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:49:56.568657 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:49:56.568975 (+ 318us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:56.568986 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:56.570616 (+ 1630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:56.570621 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:56.572845 (+ 2224us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:56.572860 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:56.575652 (+ 2792us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:56.575658 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:56.575855 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:56.575892 (+ 37us) client_negotiation.cc:769] Sending connection context
0808 14:49:56.575998 (+ 106us) client_negotiation.cc:240] Negotiation successful
0808 14:49:56.576131 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12068,"thread_start_us":12485,"threads_started":1}
I20260808 14:49:56.577399 30117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:56.552059 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.194:38253 (local address 127.26.206.195:41007)
0808 14:49:56.567897 (+ 15838us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:56.567903 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:56.567927 (+ 24us) server_negotiation.cc:407] Connection header received
0808 14:49:56.567992 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:56.567999 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:56.568071 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:56.568161 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:49:56.569236 (+ 1075us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:56.570471 (+ 1235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:56.574224 (+ 3753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:56.575414 (+ 1190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:56.575666 (+ 252us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:56.575744 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:56.576905 (+ 1161us) server_negotiation.cc:299] Negotiation successful
0808 14:49:56.577047 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15684,"thread_start_us":16280,"threads_started":1}
I20260808 14:49:56.578058 29974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dd8d23a8b8fb4570b4f2576bacc140d0" candidate_uuid: "2c40e0aed672465e9c53c9e7e62aaff2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "904e26d82d1e46ff99739a527f3969c8" is_pre_election: true
I20260808 14:49:56.578356 29974 raft_consensus.cc:2454] T dd8d23a8b8fb4570b4f2576bacc140d0 P 904e26d82d1e46ff99739a527f3969c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c40e0aed672465e9c53c9e7e62aaff2 in term 0.
I20260808 14:49:56.579531 30054 raft_consensus.cc:504] T dd8d23a8b8fb4570b4f2576bacc140d0 P 2c40e0aed672465e9c53c9e7e62aaff2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fc0d02ecec34e88b5dff67bbe42ab86" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 37433 } } peers { permanent_uuid: "2c40e0aed672465e9c53c9e7e62aaff2" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 33511 } } peers { permanent_uuid: "904e26d82d1e46ff99739a527f3969c8" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 41007 } }
I20260808 14:49:56.580467 30054 leader_election.cc:288] T dd8d23a8b8fb4570b4f2576bacc140d0 P 2c40e0aed672465e9c53c9e7e62aaff2 [CANDIDATE]: Term 1 election: Requested vote from peers 8fc0d02ecec34e88b5dff67bbe42ab86 (127.26.206.193:37433), 904e26d82d1e46ff99739a527f3969c8 (127.26.206.195:41007)
I20260808 14:49:56.580694 29657 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dd8d23a8b8fb4570b4f2576bacc140d0" candidate_uuid: "2c40e0aed672465e9c53c9e7e62aaff2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fc0d02ecec34e88b5dff67bbe42ab86"
I20260808 14:49:56.580909 29657 raft_consensus.cc:3037] T dd8d23a8b8fb4570b4f2576bacc140d0 P 8fc0d02ecec34e88b5dff67bbe42ab86 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:49:56.580972 29974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dd8d23a8b8fb4570b4f2576bacc140d0" candidate_uuid: "2c40e0aed672465e9c53c9e7e62aaff2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "904e26d82d1e46ff99739a527f3969c8"
I20260808 14:49:56.581172 29974 raft_consensus.cc:3037] T dd8d23a8b8fb4570b4f2576bacc140d0 P 904e26d82d1e46ff99739a527f3969c8 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:49:56.584115 29974 raft_consensus.cc:2454] T dd8d23a8b8fb4570b4f2576bacc140d0 P 904e26d82d1e46ff99739a527f3969c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c40e0aed672465e9c53c9e7e62aaff2 in term 1.
I20260808 14:49:56.584394 29657 raft_consensus.cc:2454] T dd8d23a8b8fb4570b4f2576bacc140d0 P 8fc0d02ecec34e88b5dff67bbe42ab86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c40e0aed672465e9c53c9e7e62aaff2 in term 1.
I20260808 14:49:56.584888 29732 leader_election.cc:302] T dd8d23a8b8fb4570b4f2576bacc140d0 P 2c40e0aed672465e9c53c9e7e62aaff2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c40e0aed672465e9c53c9e7e62aaff2, 904e26d82d1e46ff99739a527f3969c8; no voters:
I20260808 14:49:56.585183 30054 raft_consensus.cc:2781] T dd8d23a8b8fb4570b4f2576bacc140d0 P 2c40e0aed672465e9c53c9e7e62aaff2 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:49:56.585407 30054 raft_consensus.cc:686] T dd8d23a8b8fb4570b4f2576bacc140d0 P 2c40e0aed672465e9c53c9e7e62aaff2 [term 1 LEADER]: Becoming Leader. State: Replica: 2c40e0aed672465e9c53c9e7e62aaff2, State: Running, Role: LEADER
I20260808 14:49:56.585875 30054 consensus_queue.cc:237] T dd8d23a8b8fb4570b4f2576bacc140d0 P 2c40e0aed672465e9c53c9e7e62aaff2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fc0d02ecec34e88b5dff67bbe42ab86" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 37433 } } peers { permanent_uuid: "2c40e0aed672465e9c53c9e7e62aaff2" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 33511 } } peers { permanent_uuid: "904e26d82d1e46ff99739a527f3969c8" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 41007 } }
I20260808 14:49:56.589793 29474 catalog_manager.cc:5495] T dd8d23a8b8fb4570b4f2576bacc140d0 P 2c40e0aed672465e9c53c9e7e62aaff2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2c40e0aed672465e9c53c9e7e62aaff2 (127.26.206.194). New cstate: current_term: 1 leader_uuid: "2c40e0aed672465e9c53c9e7e62aaff2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fc0d02ecec34e88b5dff67bbe42ab86" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 37433 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c40e0aed672465e9c53c9e7e62aaff2" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 33511 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "904e26d82d1e46ff99739a527f3969c8" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 41007 } health_report { overall_health: UNKNOWN } } }
I20260808 14:49:56.646507 30119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:56.640134 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55624 (local address 127.26.206.194:33511)
0808 14:49:56.640793 (+ 659us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:56.640799 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:56.640821 (+ 22us) server_negotiation.cc:407] Connection header received
0808 14:49:56.640911 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:56.640916 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:56.641012 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:56.641171 (+ 159us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:49:56.641536 (+ 365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:56.642689 (+ 1153us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:56.643998 (+ 1309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:56.644541 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:56.644661 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:56.645105 (+ 444us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:49:56.645846 (+ 741us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:49:56.645986 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:56.646078 (+ 92us) server_negotiation.cc:299] Negotiation successful
0808 14:49:56.646157 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":526,"thread_start_us":392,"threads_started":1}
I20260808 14:49:56.662947 30076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:56.656504 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.194:50573 (local address 127.26.206.193:37433)
0808 14:49:56.656713 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:56.656722 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:56.657296 (+ 574us) server_negotiation.cc:407] Connection header received
0808 14:49:56.657475 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:56.657479 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:56.657548 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:56.657624 (+ 76us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:49:56.658186 (+ 562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:56.658932 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:56.660970 (+ 2038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:56.661611 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:56.661701 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:56.662269 (+ 568us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:49:56.662387 (+ 118us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:49:56.662452 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:56.662644 (+ 192us) server_negotiation.cc:299] Negotiation successful
0808 14:49:56.662723 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260808 14:49:56.663118 30122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:56.656483 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.193:37433 (local address 127.26.206.194:50573)
0808 14:49:56.657188 (+ 705us) negotiation.cc:107] Waiting for socket to connect
0808 14:49:56.657207 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 14:49:56.657350 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:49:56.657666 (+ 316us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:49:56.657671 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:49:56.657703 (+ 32us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 14:49:56.658048 (+ 345us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:56.658060 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:56.659069 (+ 1009us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:56.659075 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:56.660841 (+ 1766us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:56.660858 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:56.661792 (+ 934us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:56.661799 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:56.661984 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:56.662051 (+ 67us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 14:49:56.662485 (+ 434us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 14:49:56.662498 (+ 13us) client_negotiation.cc:769] Sending connection context
0808 14:49:56.662591 (+ 93us) client_negotiation.cc:240] Negotiation successful
0808 14:49:56.662725 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":513,"thread_start_us":328,"threads_started":1}
I20260808 14:49:56.672019 29657 raft_consensus.cc:1261] T dd8d23a8b8fb4570b4f2576bacc140d0 P 8fc0d02ecec34e88b5dff67bbe42ab86 [term 1 FOLLOWER]: Refusing update from remote peer 2c40e0aed672465e9c53c9e7e62aaff2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:49:56.672711 29974 raft_consensus.cc:1261] T dd8d23a8b8fb4570b4f2576bacc140d0 P 904e26d82d1e46ff99739a527f3969c8 [term 1 FOLLOWER]: Refusing update from remote peer 2c40e0aed672465e9c53c9e7e62aaff2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:49:56.672890 30095 consensus_queue.cc:1035] T dd8d23a8b8fb4570b4f2576bacc140d0 P 2c40e0aed672465e9c53c9e7e62aaff2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fc0d02ecec34e88b5dff67bbe42ab86" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 37433 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:49:56.673347 30054 consensus_queue.cc:1035] T dd8d23a8b8fb4570b4f2576bacc140d0 P 2c40e0aed672465e9c53c9e7e62aaff2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "904e26d82d1e46ff99739a527f3969c8" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 41007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:49:56.679693 30079 mvcc.cc:205] Tried to move back new op lower bound from 7316277643961311232 to 7316277643619655680. Current Snapshot: MvccSnapshot[applied={T|T < 7316277643961311232}]
I20260808 14:49:56.703027 30119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:56.697305 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.193:38101 (local address 127.26.206.194:33511)
0808 14:49:56.697495 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:56.697501 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:56.697518 (+ 17us) server_negotiation.cc:407] Connection header received
0808 14:49:56.697580 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:56.697585 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:56.697664 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:56.697753 (+ 89us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:49:56.698248 (+ 495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:56.699290 (+ 1042us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:56.701024 (+ 1734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:56.701606 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:56.701752 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:56.702359 (+ 607us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:49:56.702456 (+ 97us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:49:56.702560 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:56.702677 (+ 117us) server_negotiation.cc:299] Negotiation successful
0808 14:49:56.702751 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260808 14:49:56.703110 30102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:56.696920 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.194:33511 (local address 127.26.206.193:38101)
0808 14:49:56.697136 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0808 14:49:56.697159 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 14:49:56.697286 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:49:56.697938 (+ 652us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:49:56.697943 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:49:56.697963 (+ 20us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 14:49:56.698112 (+ 149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:56.698119 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:56.699425 (+ 1306us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:56.699431 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:56.700885 (+ 1454us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:56.700897 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:56.701761 (+ 864us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:56.701768 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:56.701986 (+ 218us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:56.702042 (+ 56us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 14:49:56.702565 (+ 523us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 14:49:56.702578 (+ 13us) client_negotiation.cc:769] Sending connection context
0808 14:49:56.702659 (+ 81us) client_negotiation.cc:240] Negotiation successful
0808 14:49:56.702807 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":60}
W20260808 14:49:56.704270 30079 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260808 14:49:58.327646 29474 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35188:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:49:58.327886 29474 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35188:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:49:58.331959 29474 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 391255c8e7224cc9864773b0724db188: Sending DeleteTablet for 3 replicas of tablet dd8d23a8b8fb4570b4f2576bacc140d0
I20260808 14:49:58.332724 29631 tablet_service.cc:1514] Processing DeleteTablet for tablet dd8d23a8b8fb4570b4f2576bacc140d0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:49:58 UTC) from {username='kudu', principal='kudu/127.26.206.254@KRBTEST.COM'} at 127.0.0.1:49960
I20260808 14:49:58.332882 29785 tablet_service.cc:1514] Processing DeleteTablet for tablet dd8d23a8b8fb4570b4f2576bacc140d0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:49:58 UTC) from {username='kudu', principal='kudu/127.26.206.254@KRBTEST.COM'} at 127.0.0.1:55618
I20260808 14:49:58.333009 29952 tablet_service.cc:1514] Processing DeleteTablet for tablet dd8d23a8b8fb4570b4f2576bacc140d0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:49:58 UTC) from {username='kudu', principal='kudu/127.26.206.254@KRBTEST.COM'} at 127.0.0.1:58020
I20260808 14:49:58.343746 30152 tablet_replica.cc:330] T dd8d23a8b8fb4570b4f2576bacc140d0 P 8fc0d02ecec34e88b5dff67bbe42ab86: stopping tablet replica
I20260808 14:49:58.344132 30152 raft_consensus.cc:2229] T dd8d23a8b8fb4570b4f2576bacc140d0 P 8fc0d02ecec34e88b5dff67bbe42ab86 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:49:58.344455 30152 raft_consensus.cc:2258] T dd8d23a8b8fb4570b4f2576bacc140d0 P 8fc0d02ecec34e88b5dff67bbe42ab86 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:49:58.345654 30152 ts_tablet_manager.cc:1905] T dd8d23a8b8fb4570b4f2576bacc140d0 P 8fc0d02ecec34e88b5dff67bbe42ab86: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:49:58.348026 30153 tablet_replica.cc:330] T dd8d23a8b8fb4570b4f2576bacc140d0 P 2c40e0aed672465e9c53c9e7e62aaff2: stopping tablet replica
I20260808 14:49:58.348306 30153 raft_consensus.cc:2229] T dd8d23a8b8fb4570b4f2576bacc140d0 P 2c40e0aed672465e9c53c9e7e62aaff2 [term 1 LEADER]: Raft consensus shutting down.
I20260808 14:49:58.348376 30154 tablet_replica.cc:330] T dd8d23a8b8fb4570b4f2576bacc140d0 P 904e26d82d1e46ff99739a527f3969c8: stopping tablet replica
I20260808 14:49:58.348757 30154 raft_consensus.cc:2229] T dd8d23a8b8fb4570b4f2576bacc140d0 P 904e26d82d1e46ff99739a527f3969c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:49:58.349069 30154 raft_consensus.cc:2258] T dd8d23a8b8fb4570b4f2576bacc140d0 P 904e26d82d1e46ff99739a527f3969c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:49:58.349126 30153 raft_consensus.cc:2258] T dd8d23a8b8fb4570b4f2576bacc140d0 P 2c40e0aed672465e9c53c9e7e62aaff2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:49:58.350123 30153 ts_tablet_manager.cc:1905] T dd8d23a8b8fb4570b4f2576bacc140d0 P 2c40e0aed672465e9c53c9e7e62aaff2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:49:58.350328 30154 ts_tablet_manager.cc:1905] T dd8d23a8b8fb4570b4f2576bacc140d0 P 904e26d82d1e46ff99739a527f3969c8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:49:58.353611 30152 ts_tablet_manager.cc:1918] T dd8d23a8b8fb4570b4f2576bacc140d0 P 8fc0d02ecec34e88b5dff67bbe42ab86: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 14:49:58.353796 30152 log.cc:1196] T dd8d23a8b8fb4570b4f2576bacc140d0 P 8fc0d02ecec34e88b5dff67bbe42ab86: Deleting WAL directory at /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200577490656-27451-0/minicluster-data/ts-0/wal/wals/dd8d23a8b8fb4570b4f2576bacc140d0
I20260808 14:49:58.354288 30152 ts_tablet_manager.cc:1939] T dd8d23a8b8fb4570b4f2576bacc140d0 P 8fc0d02ecec34e88b5dff67bbe42ab86: Deleting consensus metadata
I20260808 14:49:58.355533 29457 catalog_manager.cc:4841] TS 8fc0d02ecec34e88b5dff67bbe42ab86 (127.26.206.193:37433): tablet dd8d23a8b8fb4570b4f2576bacc140d0 (table test-table [id=0fd8db859eae4255b10fb5814e5e5f70]) successfully deleted
I20260808 14:49:58.356810 30153 ts_tablet_manager.cc:1918] T dd8d23a8b8fb4570b4f2576bacc140d0 P 2c40e0aed672465e9c53c9e7e62aaff2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 14:49:58.356810 30154 ts_tablet_manager.cc:1918] T dd8d23a8b8fb4570b4f2576bacc140d0 P 904e26d82d1e46ff99739a527f3969c8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 14:49:58.356947 30154 log.cc:1196] T dd8d23a8b8fb4570b4f2576bacc140d0 P 904e26d82d1e46ff99739a527f3969c8: Deleting WAL directory at /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200577490656-27451-0/minicluster-data/ts-2/wal/wals/dd8d23a8b8fb4570b4f2576bacc140d0
I20260808 14:49:58.356961 30153 log.cc:1196] T dd8d23a8b8fb4570b4f2576bacc140d0 P 2c40e0aed672465e9c53c9e7e62aaff2: Deleting WAL directory at /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200577490656-27451-0/minicluster-data/ts-1/wal/wals/dd8d23a8b8fb4570b4f2576bacc140d0
I20260808 14:49:58.357442 30153 ts_tablet_manager.cc:1939] T dd8d23a8b8fb4570b4f2576bacc140d0 P 2c40e0aed672465e9c53c9e7e62aaff2: Deleting consensus metadata
I20260808 14:49:58.357467 30154 ts_tablet_manager.cc:1939] T dd8d23a8b8fb4570b4f2576bacc140d0 P 904e26d82d1e46ff99739a527f3969c8: Deleting consensus metadata
I20260808 14:49:58.358527 29458 catalog_manager.cc:4841] TS 904e26d82d1e46ff99739a527f3969c8 (127.26.206.195:41007): tablet dd8d23a8b8fb4570b4f2576bacc140d0 (table test-table [id=0fd8db859eae4255b10fb5814e5e5f70]) successfully deleted
I20260808 14:49:58.359066 29458 catalog_manager.cc:4841] TS 2c40e0aed672465e9c53c9e7e62aaff2 (127.26.206.194:33511): tablet dd8d23a8b8fb4570b4f2576bacc140d0 (table test-table [id=0fd8db859eae4255b10fb5814e5e5f70]) successfully deleted
Aug 08 14:49:58 dist-test-slave-6k22 krb5kdc[29423](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200598, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 14:49:58 dist-test-slave-6k22 krb5kdc[29423](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200598, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.26.206.254@KRBTEST.COM
I20260808 14:49:58.395237 30163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:58.382233 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35208 (local address 127.26.206.254:42107)
0808 14:49:58.382767 (+ 534us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:58.382772 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:58.382797 (+ 25us) server_negotiation.cc:407] Connection header received
0808 14:49:58.382955 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:58.382959 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:58.383017 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:58.383108 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:58.384390 (+ 1282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:58.385197 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:58.386384 (+ 1187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:58.386804 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:58.386900 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:58.390706 (+ 3806us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:49:58.390711 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:49:58.390714 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:49:58.390743 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:49:58.393200 (+ 2457us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:58.393747 (+ 547us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:58.393750 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:58.393753 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:58.393873 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:58.394163 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:58.394165 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:58.394167 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:58.394423 (+ 256us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:49:58.394605 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:58.394822 (+ 217us) server_negotiation.cc:299] Negotiation successful
0808 14:49:58.394985 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":429,"thread_start_us":279,"threads_started":1}
I20260808 14:49:58.398873 29474 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35208:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:49:58.399482 29474 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:49:58.405845 29631 tablet_service.cc:1467] Processing CreateTablet for tablet 66d572ba505a42c4a7126c318685f724 (DEFAULT_TABLE table=test-table [id=5e4bd62d355d46b6aed7f2add767cae0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:49:58.405907 29785 tablet_service.cc:1467] Processing CreateTablet for tablet 66d572ba505a42c4a7126c318685f724 (DEFAULT_TABLE table=test-table [id=5e4bd62d355d46b6aed7f2add767cae0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:49:58.406388 29631 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 66d572ba505a42c4a7126c318685f724. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:49:58.406399 29785 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 66d572ba505a42c4a7126c318685f724. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:49:58.406741 29952 tablet_service.cc:1467] Processing CreateTablet for tablet 66d572ba505a42c4a7126c318685f724 (DEFAULT_TABLE table=test-table [id=5e4bd62d355d46b6aed7f2add767cae0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:49:58.407166 29952 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 66d572ba505a42c4a7126c318685f724. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:49:58.412362 30164 tablet_bootstrap.cc:492] T 66d572ba505a42c4a7126c318685f724 P 8fc0d02ecec34e88b5dff67bbe42ab86: Bootstrap starting.
I20260808 14:49:58.413753 30165 tablet_bootstrap.cc:492] T 66d572ba505a42c4a7126c318685f724 P 2c40e0aed672465e9c53c9e7e62aaff2: Bootstrap starting.
I20260808 14:49:58.414327 30164 tablet_bootstrap.cc:654] T 66d572ba505a42c4a7126c318685f724 P 8fc0d02ecec34e88b5dff67bbe42ab86: Neither blocks nor log segments found. Creating new log.
I20260808 14:49:58.415735 30165 tablet_bootstrap.cc:654] T 66d572ba505a42c4a7126c318685f724 P 2c40e0aed672465e9c53c9e7e62aaff2: Neither blocks nor log segments found. Creating new log.
I20260808 14:49:58.416035 30166 tablet_bootstrap.cc:492] T 66d572ba505a42c4a7126c318685f724 P 904e26d82d1e46ff99739a527f3969c8: Bootstrap starting.
I20260808 14:49:58.416905 30164 tablet_bootstrap.cc:492] T 66d572ba505a42c4a7126c318685f724 P 8fc0d02ecec34e88b5dff67bbe42ab86: No bootstrap required, opened a new log
I20260808 14:49:58.417062 30164 ts_tablet_manager.cc:1397] T 66d572ba505a42c4a7126c318685f724 P 8fc0d02ecec34e88b5dff67bbe42ab86: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260808 14:49:58.417940 30164 raft_consensus.cc:348] T 66d572ba505a42c4a7126c318685f724 P 8fc0d02ecec34e88b5dff67bbe42ab86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fc0d02ecec34e88b5dff67bbe42ab86" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 37433 } } peers { permanent_uuid: "2c40e0aed672465e9c53c9e7e62aaff2" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 33511 } } peers { permanent_uuid: "904e26d82d1e46ff99739a527f3969c8" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 41007 } }
I20260808 14:49:58.418164 30165 tablet_bootstrap.cc:492] T 66d572ba505a42c4a7126c318685f724 P 2c40e0aed672465e9c53c9e7e62aaff2: No bootstrap required, opened a new log
I20260808 14:49:58.418220 30164 raft_consensus.cc:374] T 66d572ba505a42c4a7126c318685f724 P 8fc0d02ecec34e88b5dff67bbe42ab86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:49:58.418310 30165 ts_tablet_manager.cc:1397] T 66d572ba505a42c4a7126c318685f724 P 2c40e0aed672465e9c53c9e7e62aaff2: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.002s
I20260808 14:49:58.418315 30164 raft_consensus.cc:729] T 66d572ba505a42c4a7126c318685f724 P 8fc0d02ecec34e88b5dff67bbe42ab86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fc0d02ecec34e88b5dff67bbe42ab86, State: Initialized, Role: FOLLOWER
I20260808 14:49:58.418689 30166 tablet_bootstrap.cc:654] T 66d572ba505a42c4a7126c318685f724 P 904e26d82d1e46ff99739a527f3969c8: Neither blocks nor log segments found. Creating new log.
I20260808 14:49:58.418561 30164 consensus_queue.cc:260] T 66d572ba505a42c4a7126c318685f724 P 8fc0d02ecec34e88b5dff67bbe42ab86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fc0d02ecec34e88b5dff67bbe42ab86" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 37433 } } peers { permanent_uuid: "2c40e0aed672465e9c53c9e7e62aaff2" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 33511 } } peers { permanent_uuid: "904e26d82d1e46ff99739a527f3969c8" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 41007 } }
I20260808 14:49:58.419196 30164 ts_tablet_manager.cc:1428] T 66d572ba505a42c4a7126c318685f724 P 8fc0d02ecec34e88b5dff67bbe42ab86: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260808 14:49:58.419071 30165 raft_consensus.cc:348] T 66d572ba505a42c4a7126c318685f724 P 2c40e0aed672465e9c53c9e7e62aaff2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fc0d02ecec34e88b5dff67bbe42ab86" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 37433 } } peers { permanent_uuid: "2c40e0aed672465e9c53c9e7e62aaff2" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 33511 } } peers { permanent_uuid: "904e26d82d1e46ff99739a527f3969c8" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 41007 } }
I20260808 14:49:58.419291 30165 raft_consensus.cc:374] T 66d572ba505a42c4a7126c318685f724 P 2c40e0aed672465e9c53c9e7e62aaff2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:49:58.419387 30165 raft_consensus.cc:729] T 66d572ba505a42c4a7126c318685f724 P 2c40e0aed672465e9c53c9e7e62aaff2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c40e0aed672465e9c53c9e7e62aaff2, State: Initialized, Role: FOLLOWER
I20260808 14:49:58.419713 30165 consensus_queue.cc:260] T 66d572ba505a42c4a7126c318685f724 P 2c40e0aed672465e9c53c9e7e62aaff2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fc0d02ecec34e88b5dff67bbe42ab86" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 37433 } } peers { permanent_uuid: "2c40e0aed672465e9c53c9e7e62aaff2" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 33511 } } peers { permanent_uuid: "904e26d82d1e46ff99739a527f3969c8" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 41007 } }
I20260808 14:49:58.420367 30165 ts_tablet_manager.cc:1428] T 66d572ba505a42c4a7126c318685f724 P 2c40e0aed672465e9c53c9e7e62aaff2: Time spent starting tablet: real 0.002s user 0.002s sys 0.001s
I20260808 14:49:58.421160 30166 tablet_bootstrap.cc:492] T 66d572ba505a42c4a7126c318685f724 P 904e26d82d1e46ff99739a527f3969c8: No bootstrap required, opened a new log
I20260808 14:49:58.421345 30166 ts_tablet_manager.cc:1397] T 66d572ba505a42c4a7126c318685f724 P 904e26d82d1e46ff99739a527f3969c8: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.003s
I20260808 14:49:58.422196 30166 raft_consensus.cc:348] T 66d572ba505a42c4a7126c318685f724 P 904e26d82d1e46ff99739a527f3969c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fc0d02ecec34e88b5dff67bbe42ab86" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 37433 } } peers { permanent_uuid: "2c40e0aed672465e9c53c9e7e62aaff2" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 33511 } } peers { permanent_uuid: "904e26d82d1e46ff99739a527f3969c8" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 41007 } }
I20260808 14:49:58.422436 30166 raft_consensus.cc:374] T 66d572ba505a42c4a7126c318685f724 P 904e26d82d1e46ff99739a527f3969c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:49:58.422616 30166 raft_consensus.cc:729] T 66d572ba505a42c4a7126c318685f724 P 904e26d82d1e46ff99739a527f3969c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 904e26d82d1e46ff99739a527f3969c8, State: Initialized, Role: FOLLOWER
I20260808 14:49:58.422906 30166 consensus_queue.cc:260] T 66d572ba505a42c4a7126c318685f724 P 904e26d82d1e46ff99739a527f3969c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fc0d02ecec34e88b5dff67bbe42ab86" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 37433 } } peers { permanent_uuid: "2c40e0aed672465e9c53c9e7e62aaff2" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 33511 } } peers { permanent_uuid: "904e26d82d1e46ff99739a527f3969c8" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 41007 } }
I20260808 14:49:58.424121 30166 ts_tablet_manager.cc:1428] T 66d572ba505a42c4a7126c318685f724 P 904e26d82d1e46ff99739a527f3969c8: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260808 14:49:58.650774 30145 raft_consensus.cc:482] T 66d572ba505a42c4a7126c318685f724 P 2c40e0aed672465e9c53c9e7e62aaff2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:49:58.651059 30145 raft_consensus.cc:504] T 66d572ba505a42c4a7126c318685f724 P 2c40e0aed672465e9c53c9e7e62aaff2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fc0d02ecec34e88b5dff67bbe42ab86" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 37433 } } peers { permanent_uuid: "2c40e0aed672465e9c53c9e7e62aaff2" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 33511 } } peers { permanent_uuid: "904e26d82d1e46ff99739a527f3969c8" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 41007 } }
I20260808 14:49:58.651958 30145 leader_election.cc:288] T 66d572ba505a42c4a7126c318685f724 P 2c40e0aed672465e9c53c9e7e62aaff2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8fc0d02ecec34e88b5dff67bbe42ab86 (127.26.206.193:37433), 904e26d82d1e46ff99739a527f3969c8 (127.26.206.195:41007)
I20260808 14:49:58.652571 29657 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66d572ba505a42c4a7126c318685f724" candidate_uuid: "2c40e0aed672465e9c53c9e7e62aaff2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fc0d02ecec34e88b5dff67bbe42ab86" is_pre_election: true
I20260808 14:49:58.652877 29657 raft_consensus.cc:2454] T 66d572ba505a42c4a7126c318685f724 P 8fc0d02ecec34e88b5dff67bbe42ab86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c40e0aed672465e9c53c9e7e62aaff2 in term 0.
I20260808 14:49:58.653334 29974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66d572ba505a42c4a7126c318685f724" candidate_uuid: "2c40e0aed672465e9c53c9e7e62aaff2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "904e26d82d1e46ff99739a527f3969c8" is_pre_election: true
I20260808 14:49:58.653467 29731 leader_election.cc:302] T 66d572ba505a42c4a7126c318685f724 P 2c40e0aed672465e9c53c9e7e62aaff2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c40e0aed672465e9c53c9e7e62aaff2, 8fc0d02ecec34e88b5dff67bbe42ab86; no voters:
I20260808 14:49:58.653652 29974 raft_consensus.cc:2454] T 66d572ba505a42c4a7126c318685f724 P 904e26d82d1e46ff99739a527f3969c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c40e0aed672465e9c53c9e7e62aaff2 in term 0.
I20260808 14:49:58.653815 30145 raft_consensus.cc:2781] T 66d572ba505a42c4a7126c318685f724 P 2c40e0aed672465e9c53c9e7e62aaff2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:49:58.653934 30145 raft_consensus.cc:482] T 66d572ba505a42c4a7126c318685f724 P 2c40e0aed672465e9c53c9e7e62aaff2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:49:58.654032 30145 raft_consensus.cc:3037] T 66d572ba505a42c4a7126c318685f724 P 2c40e0aed672465e9c53c9e7e62aaff2 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:49:58.656270 30145 raft_consensus.cc:504] T 66d572ba505a42c4a7126c318685f724 P 2c40e0aed672465e9c53c9e7e62aaff2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fc0d02ecec34e88b5dff67bbe42ab86" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 37433 } } peers { permanent_uuid: "2c40e0aed672465e9c53c9e7e62aaff2" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 33511 } } peers { permanent_uuid: "904e26d82d1e46ff99739a527f3969c8" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 41007 } }
I20260808 14:49:58.656786 30145 leader_election.cc:288] T 66d572ba505a42c4a7126c318685f724 P 2c40e0aed672465e9c53c9e7e62aaff2 [CANDIDATE]: Term 1 election: Requested vote from peers 8fc0d02ecec34e88b5dff67bbe42ab86 (127.26.206.193:37433), 904e26d82d1e46ff99739a527f3969c8 (127.26.206.195:41007)
I20260808 14:49:58.657289 29974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66d572ba505a42c4a7126c318685f724" candidate_uuid: "2c40e0aed672465e9c53c9e7e62aaff2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "904e26d82d1e46ff99739a527f3969c8"
I20260808 14:49:58.657320 29657 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66d572ba505a42c4a7126c318685f724" candidate_uuid: "2c40e0aed672465e9c53c9e7e62aaff2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fc0d02ecec34e88b5dff67bbe42ab86"
I20260808 14:49:58.657506 29657 raft_consensus.cc:3037] T 66d572ba505a42c4a7126c318685f724 P 8fc0d02ecec34e88b5dff67bbe42ab86 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:49:58.657516 29974 raft_consensus.cc:3037] T 66d572ba505a42c4a7126c318685f724 P 904e26d82d1e46ff99739a527f3969c8 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:49:58.660568 29974 raft_consensus.cc:2454] T 66d572ba505a42c4a7126c318685f724 P 904e26d82d1e46ff99739a527f3969c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c40e0aed672465e9c53c9e7e62aaff2 in term 1.
I20260808 14:49:58.660585 29657 raft_consensus.cc:2454] T 66d572ba505a42c4a7126c318685f724 P 8fc0d02ecec34e88b5dff67bbe42ab86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c40e0aed672465e9c53c9e7e62aaff2 in term 1.
I20260808 14:49:58.661022 29731 leader_election.cc:302] T 66d572ba505a42c4a7126c318685f724 P 2c40e0aed672465e9c53c9e7e62aaff2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 2c40e0aed672465e9c53c9e7e62aaff2, 8fc0d02ecec34e88b5dff67bbe42ab86, 904e26d82d1e46ff99739a527f3969c8; no voters:
I20260808 14:49:58.661341 30145 raft_consensus.cc:2781] T 66d572ba505a42c4a7126c318685f724 P 2c40e0aed672465e9c53c9e7e62aaff2 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:49:58.661492 30145 raft_consensus.cc:686] T 66d572ba505a42c4a7126c318685f724 P 2c40e0aed672465e9c53c9e7e62aaff2 [term 1 LEADER]: Becoming Leader. State: Replica: 2c40e0aed672465e9c53c9e7e62aaff2, State: Running, Role: LEADER
I20260808 14:49:58.661788 30145 consensus_queue.cc:237] T 66d572ba505a42c4a7126c318685f724 P 2c40e0aed672465e9c53c9e7e62aaff2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fc0d02ecec34e88b5dff67bbe42ab86" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 37433 } } peers { permanent_uuid: "2c40e0aed672465e9c53c9e7e62aaff2" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 33511 } } peers { permanent_uuid: "904e26d82d1e46ff99739a527f3969c8" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 41007 } }
I20260808 14:49:58.664624 29475 catalog_manager.cc:5495] T 66d572ba505a42c4a7126c318685f724 P 2c40e0aed672465e9c53c9e7e62aaff2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2c40e0aed672465e9c53c9e7e62aaff2 (127.26.206.194). New cstate: current_term: 1 leader_uuid: "2c40e0aed672465e9c53c9e7e62aaff2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fc0d02ecec34e88b5dff67bbe42ab86" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 37433 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c40e0aed672465e9c53c9e7e62aaff2" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 33511 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "904e26d82d1e46ff99739a527f3969c8" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 41007 } health_report { overall_health: UNKNOWN } } }
I20260808 14:49:58.720706 30175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:58.715455 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53232 (local address 127.26.206.194:33511)
0808 14:49:58.716086 (+ 631us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:58.716090 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:58.716108 (+ 18us) server_negotiation.cc:407] Connection header received
0808 14:49:58.716158 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:58.716161 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:58.716219 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:58.716329 (+ 110us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:49:58.716752 (+ 423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:58.717516 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:58.718852 (+ 1336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:58.719287 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:58.719435 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:58.719929 (+ 494us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:49:58.720044 (+ 115us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:49:58.720145 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:58.720306 (+ 161us) server_negotiation.cc:299] Negotiation successful
0808 14:49:58.720384 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":479,"thread_start_us":340,"threads_started":1}
I20260808 14:49:58.729579 29974 raft_consensus.cc:1261] T 66d572ba505a42c4a7126c318685f724 P 904e26d82d1e46ff99739a527f3969c8 [term 1 FOLLOWER]: Refusing update from remote peer 2c40e0aed672465e9c53c9e7e62aaff2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:49:58.729849 29657 raft_consensus.cc:1261] T 66d572ba505a42c4a7126c318685f724 P 8fc0d02ecec34e88b5dff67bbe42ab86 [term 1 FOLLOWER]: Refusing update from remote peer 2c40e0aed672465e9c53c9e7e62aaff2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:49:58.730175 30145 consensus_queue.cc:1035] T 66d572ba505a42c4a7126c318685f724 P 2c40e0aed672465e9c53c9e7e62aaff2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "904e26d82d1e46ff99739a527f3969c8" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 41007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:49:58.730470 30141 consensus_queue.cc:1035] T 66d572ba505a42c4a7126c318685f724 P 2c40e0aed672465e9c53c9e7e62aaff2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fc0d02ecec34e88b5dff67bbe42ab86" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 37433 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:49:58.736780 30133 mvcc.cc:205] Tried to move back new op lower bound from 7316277652390412288 to 7316277652121051136. Current Snapshot: MvccSnapshot[applied={T|T < 7316277652390412288}]
I20260808 14:49:58.772704 29474 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35208:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:49:58.772943 29474 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35208:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:49:58.775709 29474 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 391255c8e7224cc9864773b0724db188: Sending DeleteTablet for 3 replicas of tablet 66d572ba505a42c4a7126c318685f724
I20260808 14:49:58.776453 29631 tablet_service.cc:1514] Processing DeleteTablet for tablet 66d572ba505a42c4a7126c318685f724 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:49:58 UTC) from {username='kudu', principal='kudu/127.26.206.254@KRBTEST.COM'} at 127.0.0.1:49960
I20260808 14:49:58.776490 29785 tablet_service.cc:1514] Processing DeleteTablet for tablet 66d572ba505a42c4a7126c318685f724 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:49:58 UTC) from {username='kudu', principal='kudu/127.26.206.254@KRBTEST.COM'} at 127.0.0.1:55618
I20260808 14:49:58.776628 29952 tablet_service.cc:1514] Processing DeleteTablet for tablet 66d572ba505a42c4a7126c318685f724 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:49:58 UTC) from {username='kudu', principal='kudu/127.26.206.254@KRBTEST.COM'} at 127.0.0.1:58020
I20260808 14:49:58.776734 30152 tablet_replica.cc:330] T 66d572ba505a42c4a7126c318685f724 P 8fc0d02ecec34e88b5dff67bbe42ab86: stopping tablet replica
I20260808 14:49:58.776742 30153 tablet_replica.cc:330] T 66d572ba505a42c4a7126c318685f724 P 2c40e0aed672465e9c53c9e7e62aaff2: stopping tablet replica
I20260808 14:49:58.776934 30154 tablet_replica.cc:330] T 66d572ba505a42c4a7126c318685f724 P 904e26d82d1e46ff99739a527f3969c8: stopping tablet replica
I20260808 14:49:58.776942 30152 raft_consensus.cc:2229] T 66d572ba505a42c4a7126c318685f724 P 8fc0d02ecec34e88b5dff67bbe42ab86 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:49:58.776950 30153 raft_consensus.cc:2229] T 66d572ba505a42c4a7126c318685f724 P 2c40e0aed672465e9c53c9e7e62aaff2 [term 1 LEADER]: Raft consensus shutting down.
I20260808 14:49:58.777113 30152 raft_consensus.cc:2258] T 66d572ba505a42c4a7126c318685f724 P 8fc0d02ecec34e88b5dff67bbe42ab86 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:49:58.777114 30154 raft_consensus.cc:2229] T 66d572ba505a42c4a7126c318685f724 P 904e26d82d1e46ff99739a527f3969c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:49:58.777283 30154 raft_consensus.cc:2258] T 66d572ba505a42c4a7126c318685f724 P 904e26d82d1e46ff99739a527f3969c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:49:58.777307 30153 raft_consensus.cc:2258] T 66d572ba505a42c4a7126c318685f724 P 2c40e0aed672465e9c53c9e7e62aaff2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:49:58.778270 30152 ts_tablet_manager.cc:1905] T 66d572ba505a42c4a7126c318685f724 P 8fc0d02ecec34e88b5dff67bbe42ab86: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:49:58.778580 30154 ts_tablet_manager.cc:1905] T 66d572ba505a42c4a7126c318685f724 P 904e26d82d1e46ff99739a527f3969c8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:49:58.778621 30153 ts_tablet_manager.cc:1905] T 66d572ba505a42c4a7126c318685f724 P 2c40e0aed672465e9c53c9e7e62aaff2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:49:58.777845 29474 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35208:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:49:58.780422 29474 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:49:58.785029 30153 ts_tablet_manager.cc:1918] T 66d572ba505a42c4a7126c318685f724 P 2c40e0aed672465e9c53c9e7e62aaff2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 14:49:58.785095 30152 ts_tablet_manager.cc:1918] T 66d572ba505a42c4a7126c318685f724 P 8fc0d02ecec34e88b5dff67bbe42ab86: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 14:49:58.785095 30154 ts_tablet_manager.cc:1918] T 66d572ba505a42c4a7126c318685f724 P 904e26d82d1e46ff99739a527f3969c8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 14:49:58.785203 30153 log.cc:1196] T 66d572ba505a42c4a7126c318685f724 P 2c40e0aed672465e9c53c9e7e62aaff2: Deleting WAL directory at /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200577490656-27451-0/minicluster-data/ts-1/wal/wals/66d572ba505a42c4a7126c318685f724
I20260808 14:49:58.785252 30154 log.cc:1196] T 66d572ba505a42c4a7126c318685f724 P 904e26d82d1e46ff99739a527f3969c8: Deleting WAL directory at /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200577490656-27451-0/minicluster-data/ts-2/wal/wals/66d572ba505a42c4a7126c318685f724
I20260808 14:49:58.785252 30152 log.cc:1196] T 66d572ba505a42c4a7126c318685f724 P 8fc0d02ecec34e88b5dff67bbe42ab86: Deleting WAL directory at /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200577490656-27451-0/minicluster-data/ts-0/wal/wals/66d572ba505a42c4a7126c318685f724
I20260808 14:49:58.785636 30153 ts_tablet_manager.cc:1939] T 66d572ba505a42c4a7126c318685f724 P 2c40e0aed672465e9c53c9e7e62aaff2: Deleting consensus metadata
I20260808 14:49:58.785689 30152 ts_tablet_manager.cc:1939] T 66d572ba505a42c4a7126c318685f724 P 8fc0d02ecec34e88b5dff67bbe42ab86: Deleting consensus metadata
I20260808 14:49:58.785735 30154 ts_tablet_manager.cc:1939] T 66d572ba505a42c4a7126c318685f724 P 904e26d82d1e46ff99739a527f3969c8: Deleting consensus metadata
I20260808 14:49:58.786640 29458 catalog_manager.cc:4841] TS 904e26d82d1e46ff99739a527f3969c8 (127.26.206.195:41007): tablet 66d572ba505a42c4a7126c318685f724 (table test-table [id=5e4bd62d355d46b6aed7f2add767cae0]) successfully deleted
I20260808 14:49:58.786851 29458 catalog_manager.cc:4841] TS 2c40e0aed672465e9c53c9e7e62aaff2 (127.26.206.194:33511): tablet 66d572ba505a42c4a7126c318685f724 (table test-table [id=5e4bd62d355d46b6aed7f2add767cae0]) successfully deleted
I20260808 14:49:58.787134 29457 catalog_manager.cc:4841] TS 8fc0d02ecec34e88b5dff67bbe42ab86 (127.26.206.193:37433): tablet 66d572ba505a42c4a7126c318685f724 (table test-table [id=5e4bd62d355d46b6aed7f2add767cae0]) successfully deleted
I20260808 14:49:58.789319 29631 tablet_service.cc:1467] Processing CreateTablet for tablet 24ed3a37eba04ff3b43506a00869ca60 (DEFAULT_TABLE table=test-table [id=6bfcb2a6ea444d4aa8e62aec06cea410]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:49:58.789547 29785 tablet_service.cc:1467] Processing CreateTablet for tablet 24ed3a37eba04ff3b43506a00869ca60 (DEFAULT_TABLE table=test-table [id=6bfcb2a6ea444d4aa8e62aec06cea410]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:49:58.789750 29631 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 24ed3a37eba04ff3b43506a00869ca60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:49:58.789872 29785 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 24ed3a37eba04ff3b43506a00869ca60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:49:58.794397 30164 tablet_bootstrap.cc:492] T 24ed3a37eba04ff3b43506a00869ca60 P 8fc0d02ecec34e88b5dff67bbe42ab86: Bootstrap starting.
I20260808 14:49:58.794734 29952 tablet_service.cc:1467] Processing CreateTablet for tablet 24ed3a37eba04ff3b43506a00869ca60 (DEFAULT_TABLE table=test-table [id=6bfcb2a6ea444d4aa8e62aec06cea410]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:49:58.795145 29952 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 24ed3a37eba04ff3b43506a00869ca60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:49:58.795758 30165 tablet_bootstrap.cc:492] T 24ed3a37eba04ff3b43506a00869ca60 P 2c40e0aed672465e9c53c9e7e62aaff2: Bootstrap starting.
I20260808 14:49:58.796083 30164 tablet_bootstrap.cc:654] T 24ed3a37eba04ff3b43506a00869ca60 P 8fc0d02ecec34e88b5dff67bbe42ab86: Neither blocks nor log segments found. Creating new log.
I20260808 14:49:58.797034 30165 tablet_bootstrap.cc:654] T 24ed3a37eba04ff3b43506a00869ca60 P 2c40e0aed672465e9c53c9e7e62aaff2: Neither blocks nor log segments found. Creating new log.
I20260808 14:49:58.798698 30165 tablet_bootstrap.cc:492] T 24ed3a37eba04ff3b43506a00869ca60 P 2c40e0aed672465e9c53c9e7e62aaff2: No bootstrap required, opened a new log
I20260808 14:49:58.798887 30165 ts_tablet_manager.cc:1397] T 24ed3a37eba04ff3b43506a00869ca60 P 2c40e0aed672465e9c53c9e7e62aaff2: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.001s
I20260808 14:49:58.799458 30165 raft_consensus.cc:348] T 24ed3a37eba04ff3b43506a00869ca60 P 2c40e0aed672465e9c53c9e7e62aaff2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fc0d02ecec34e88b5dff67bbe42ab86" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 37433 } } peers { permanent_uuid: "2c40e0aed672465e9c53c9e7e62aaff2" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 33511 } } peers { permanent_uuid: "904e26d82d1e46ff99739a527f3969c8" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 41007 } }
I20260808 14:49:58.799741 30165 raft_consensus.cc:374] T 24ed3a37eba04ff3b43506a00869ca60 P 2c40e0aed672465e9c53c9e7e62aaff2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:49:58.799830 30165 raft_consensus.cc:729] T 24ed3a37eba04ff3b43506a00869ca60 P 2c40e0aed672465e9c53c9e7e62aaff2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c40e0aed672465e9c53c9e7e62aaff2, State: Initialized, Role: FOLLOWER
I20260808 14:49:58.800076 30165 consensus_queue.cc:260] T 24ed3a37eba04ff3b43506a00869ca60 P 2c40e0aed672465e9c53c9e7e62aaff2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fc0d02ecec34e88b5dff67bbe42ab86" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 37433 } } peers { permanent_uuid: "2c40e0aed672465e9c53c9e7e62aaff2" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 33511 } } peers { permanent_uuid: "904e26d82d1e46ff99739a527f3969c8" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 41007 } }
I20260808 14:49:58.800581 30165 ts_tablet_manager.cc:1428] T 24ed3a37eba04ff3b43506a00869ca60 P 2c40e0aed672465e9c53c9e7e62aaff2: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 14:49:58.803385 30166 tablet_bootstrap.cc:492] T 24ed3a37eba04ff3b43506a00869ca60 P 904e26d82d1e46ff99739a527f3969c8: Bootstrap starting.
I20260808 14:49:58.804725 30164 tablet_bootstrap.cc:492] T 24ed3a37eba04ff3b43506a00869ca60 P 8fc0d02ecec34e88b5dff67bbe42ab86: No bootstrap required, opened a new log
I20260808 14:49:58.804908 30164 ts_tablet_manager.cc:1397] T 24ed3a37eba04ff3b43506a00869ca60 P 8fc0d02ecec34e88b5dff67bbe42ab86: Time spent bootstrapping tablet: real 0.011s user 0.001s sys 0.008s
I20260808 14:49:58.805096 30166 tablet_bootstrap.cc:654] T 24ed3a37eba04ff3b43506a00869ca60 P 904e26d82d1e46ff99739a527f3969c8: Neither blocks nor log segments found. Creating new log.
I20260808 14:49:58.805583 30164 raft_consensus.cc:348] T 24ed3a37eba04ff3b43506a00869ca60 P 8fc0d02ecec34e88b5dff67bbe42ab86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fc0d02ecec34e88b5dff67bbe42ab86" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 37433 } } peers { permanent_uuid: "2c40e0aed672465e9c53c9e7e62aaff2" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 33511 } } peers { permanent_uuid: "904e26d82d1e46ff99739a527f3969c8" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 41007 } }
I20260808 14:49:58.805841 30164 raft_consensus.cc:374] T 24ed3a37eba04ff3b43506a00869ca60 P 8fc0d02ecec34e88b5dff67bbe42ab86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:49:58.805962 30164 raft_consensus.cc:729] T 24ed3a37eba04ff3b43506a00869ca60 P 8fc0d02ecec34e88b5dff67bbe42ab86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fc0d02ecec34e88b5dff67bbe42ab86, State: Initialized, Role: FOLLOWER
I20260808 14:49:58.806226 30164 consensus_queue.cc:260] T 24ed3a37eba04ff3b43506a00869ca60 P 8fc0d02ecec34e88b5dff67bbe42ab86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fc0d02ecec34e88b5dff67bbe42ab86" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 37433 } } peers { permanent_uuid: "2c40e0aed672465e9c53c9e7e62aaff2" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 33511 } } peers { permanent_uuid: "904e26d82d1e46ff99739a527f3969c8" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 41007 } }
I20260808 14:49:58.806788 30164 ts_tablet_manager.cc:1428] T 24ed3a37eba04ff3b43506a00869ca60 P 8fc0d02ecec34e88b5dff67bbe42ab86: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260808 14:49:58.808315 30166 tablet_bootstrap.cc:492] T 24ed3a37eba04ff3b43506a00869ca60 P 904e26d82d1e46ff99739a527f3969c8: No bootstrap required, opened a new log
I20260808 14:49:58.808434 30166 ts_tablet_manager.cc:1397] T 24ed3a37eba04ff3b43506a00869ca60 P 904e26d82d1e46ff99739a527f3969c8: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260808 14:49:58.808921 30166 raft_consensus.cc:348] T 24ed3a37eba04ff3b43506a00869ca60 P 904e26d82d1e46ff99739a527f3969c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fc0d02ecec34e88b5dff67bbe42ab86" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 37433 } } peers { permanent_uuid: "2c40e0aed672465e9c53c9e7e62aaff2" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 33511 } } peers { permanent_uuid: "904e26d82d1e46ff99739a527f3969c8" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 41007 } }
I20260808 14:49:58.809096 30166 raft_consensus.cc:374] T 24ed3a37eba04ff3b43506a00869ca60 P 904e26d82d1e46ff99739a527f3969c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:49:58.809206 30166 raft_consensus.cc:729] T 24ed3a37eba04ff3b43506a00869ca60 P 904e26d82d1e46ff99739a527f3969c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 904e26d82d1e46ff99739a527f3969c8, State: Initialized, Role: FOLLOWER
I20260808 14:49:58.809435 30166 consensus_queue.cc:260] T 24ed3a37eba04ff3b43506a00869ca60 P 904e26d82d1e46ff99739a527f3969c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fc0d02ecec34e88b5dff67bbe42ab86" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 37433 } } peers { permanent_uuid: "2c40e0aed672465e9c53c9e7e62aaff2" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 33511 } } peers { permanent_uuid: "904e26d82d1e46ff99739a527f3969c8" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 41007 } }
I20260808 14:49:58.810051 30166 ts_tablet_manager.cc:1428] T 24ed3a37eba04ff3b43506a00869ca60 P 904e26d82d1e46ff99739a527f3969c8: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260808 14:49:58.862794 30095 raft_consensus.cc:482] T 24ed3a37eba04ff3b43506a00869ca60 P 2c40e0aed672465e9c53c9e7e62aaff2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:49:58.863040 30095 raft_consensus.cc:504] T 24ed3a37eba04ff3b43506a00869ca60 P 2c40e0aed672465e9c53c9e7e62aaff2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fc0d02ecec34e88b5dff67bbe42ab86" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 37433 } } peers { permanent_uuid: "2c40e0aed672465e9c53c9e7e62aaff2" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 33511 } } peers { permanent_uuid: "904e26d82d1e46ff99739a527f3969c8" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 41007 } }
I20260808 14:49:58.863776 30095 leader_election.cc:288] T 24ed3a37eba04ff3b43506a00869ca60 P 2c40e0aed672465e9c53c9e7e62aaff2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8fc0d02ecec34e88b5dff67bbe42ab86 (127.26.206.193:37433), 904e26d82d1e46ff99739a527f3969c8 (127.26.206.195:41007)
I20260808 14:49:58.864324 29657 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "24ed3a37eba04ff3b43506a00869ca60" candidate_uuid: "2c40e0aed672465e9c53c9e7e62aaff2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fc0d02ecec34e88b5dff67bbe42ab86" is_pre_election: true
I20260808 14:49:58.864336 29974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "24ed3a37eba04ff3b43506a00869ca60" candidate_uuid: "2c40e0aed672465e9c53c9e7e62aaff2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "904e26d82d1e46ff99739a527f3969c8" is_pre_election: true
I20260808 14:49:58.864564 29657 raft_consensus.cc:2454] T 24ed3a37eba04ff3b43506a00869ca60 P 8fc0d02ecec34e88b5dff67bbe42ab86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c40e0aed672465e9c53c9e7e62aaff2 in term 0.
I20260808 14:49:58.864615 29974 raft_consensus.cc:2454] T 24ed3a37eba04ff3b43506a00869ca60 P 904e26d82d1e46ff99739a527f3969c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c40e0aed672465e9c53c9e7e62aaff2 in term 0.
I20260808 14:49:58.865006 29731 leader_election.cc:302] T 24ed3a37eba04ff3b43506a00869ca60 P 2c40e0aed672465e9c53c9e7e62aaff2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c40e0aed672465e9c53c9e7e62aaff2, 8fc0d02ecec34e88b5dff67bbe42ab86; no voters:
I20260808 14:49:58.865331 30095 raft_consensus.cc:2781] T 24ed3a37eba04ff3b43506a00869ca60 P 2c40e0aed672465e9c53c9e7e62aaff2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:49:58.865443 30095 raft_consensus.cc:482] T 24ed3a37eba04ff3b43506a00869ca60 P 2c40e0aed672465e9c53c9e7e62aaff2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:49:58.865573 30095 raft_consensus.cc:3037] T 24ed3a37eba04ff3b43506a00869ca60 P 2c40e0aed672465e9c53c9e7e62aaff2 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:49:58.867702 30095 raft_consensus.cc:504] T 24ed3a37eba04ff3b43506a00869ca60 P 2c40e0aed672465e9c53c9e7e62aaff2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fc0d02ecec34e88b5dff67bbe42ab86" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 37433 } } peers { permanent_uuid: "2c40e0aed672465e9c53c9e7e62aaff2" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 33511 } } peers { permanent_uuid: "904e26d82d1e46ff99739a527f3969c8" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 41007 } }
I20260808 14:49:58.868230 30095 leader_election.cc:288] T 24ed3a37eba04ff3b43506a00869ca60 P 2c40e0aed672465e9c53c9e7e62aaff2 [CANDIDATE]: Term 1 election: Requested vote from peers 8fc0d02ecec34e88b5dff67bbe42ab86 (127.26.206.193:37433), 904e26d82d1e46ff99739a527f3969c8 (127.26.206.195:41007)
I20260808 14:49:58.868698 29974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "24ed3a37eba04ff3b43506a00869ca60" candidate_uuid: "2c40e0aed672465e9c53c9e7e62aaff2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "904e26d82d1e46ff99739a527f3969c8"
I20260808 14:49:58.868724 29657 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "24ed3a37eba04ff3b43506a00869ca60" candidate_uuid: "2c40e0aed672465e9c53c9e7e62aaff2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fc0d02ecec34e88b5dff67bbe42ab86"
I20260808 14:49:58.868917 29657 raft_consensus.cc:3037] T 24ed3a37eba04ff3b43506a00869ca60 P 8fc0d02ecec34e88b5dff67bbe42ab86 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:49:58.868929 29974 raft_consensus.cc:3037] T 24ed3a37eba04ff3b43506a00869ca60 P 904e26d82d1e46ff99739a527f3969c8 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:49:58.870909 29657 raft_consensus.cc:2454] T 24ed3a37eba04ff3b43506a00869ca60 P 8fc0d02ecec34e88b5dff67bbe42ab86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c40e0aed672465e9c53c9e7e62aaff2 in term 1.
I20260808 14:49:58.870993 29974 raft_consensus.cc:2454] T 24ed3a37eba04ff3b43506a00869ca60 P 904e26d82d1e46ff99739a527f3969c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c40e0aed672465e9c53c9e7e62aaff2 in term 1.
I20260808 14:49:58.871376 29731 leader_election.cc:302] T 24ed3a37eba04ff3b43506a00869ca60 P 2c40e0aed672465e9c53c9e7e62aaff2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c40e0aed672465e9c53c9e7e62aaff2, 8fc0d02ecec34e88b5dff67bbe42ab86; no voters:
I20260808 14:49:58.871699 30095 raft_consensus.cc:2781] T 24ed3a37eba04ff3b43506a00869ca60 P 2c40e0aed672465e9c53c9e7e62aaff2 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:49:58.871877 30095 raft_consensus.cc:686] T 24ed3a37eba04ff3b43506a00869ca60 P 2c40e0aed672465e9c53c9e7e62aaff2 [term 1 LEADER]: Becoming Leader. State: Replica: 2c40e0aed672465e9c53c9e7e62aaff2, State: Running, Role: LEADER
I20260808 14:49:58.872146 30095 consensus_queue.cc:237] T 24ed3a37eba04ff3b43506a00869ca60 P 2c40e0aed672465e9c53c9e7e62aaff2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fc0d02ecec34e88b5dff67bbe42ab86" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 37433 } } peers { permanent_uuid: "2c40e0aed672465e9c53c9e7e62aaff2" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 33511 } } peers { permanent_uuid: "904e26d82d1e46ff99739a527f3969c8" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 41007 } }
I20260808 14:49:58.874612 29474 catalog_manager.cc:5495] T 24ed3a37eba04ff3b43506a00869ca60 P 2c40e0aed672465e9c53c9e7e62aaff2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2c40e0aed672465e9c53c9e7e62aaff2 (127.26.206.194). New cstate: current_term: 1 leader_uuid: "2c40e0aed672465e9c53c9e7e62aaff2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fc0d02ecec34e88b5dff67bbe42ab86" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 37433 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c40e0aed672465e9c53c9e7e62aaff2" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 33511 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "904e26d82d1e46ff99739a527f3969c8" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 41007 } health_report { overall_health: UNKNOWN } } }
I20260808 14:49:58.911597 29973 raft_consensus.cc:1261] T 24ed3a37eba04ff3b43506a00869ca60 P 904e26d82d1e46ff99739a527f3969c8 [term 1 FOLLOWER]: Refusing update from remote peer 2c40e0aed672465e9c53c9e7e62aaff2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:49:58.911785 29657 raft_consensus.cc:1261] T 24ed3a37eba04ff3b43506a00869ca60 P 8fc0d02ecec34e88b5dff67bbe42ab86 [term 1 FOLLOWER]: Refusing update from remote peer 2c40e0aed672465e9c53c9e7e62aaff2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:49:58.912146 30095 consensus_queue.cc:1035] T 24ed3a37eba04ff3b43506a00869ca60 P 2c40e0aed672465e9c53c9e7e62aaff2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "904e26d82d1e46ff99739a527f3969c8" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 41007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:49:58.912386 30141 consensus_queue.cc:1035] T 24ed3a37eba04ff3b43506a00869ca60 P 2c40e0aed672465e9c53c9e7e62aaff2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fc0d02ecec34e88b5dff67bbe42ab86" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 37433 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260808 14:49:58.930684 30134 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260808 14:50:00.508562 29474 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35208:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:50:00.508809 29474 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35208:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:50:00.512878 29474 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 391255c8e7224cc9864773b0724db188: Sending DeleteTablet for 3 replicas of tablet 24ed3a37eba04ff3b43506a00869ca60
I20260808 14:50:00.513612 29631 tablet_service.cc:1514] Processing DeleteTablet for tablet 24ed3a37eba04ff3b43506a00869ca60 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:50:00 UTC) from {username='kudu', principal='kudu/127.26.206.254@KRBTEST.COM'} at 127.0.0.1:49960
I20260808 14:50:00.513725 29785 tablet_service.cc:1514] Processing DeleteTablet for tablet 24ed3a37eba04ff3b43506a00869ca60 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:50:00 UTC) from {username='kudu', principal='kudu/127.26.206.254@KRBTEST.COM'} at 127.0.0.1:55618
I20260808 14:50:00.513823 29952 tablet_service.cc:1514] Processing DeleteTablet for tablet 24ed3a37eba04ff3b43506a00869ca60 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:50:00 UTC) from {username='kudu', principal='kudu/127.26.206.254@KRBTEST.COM'} at 127.0.0.1:58020
I20260808 14:50:00.514567 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 29553
I20260808 14:50:00.531471 30211 tablet_replica.cc:330] T 24ed3a37eba04ff3b43506a00869ca60 P 904e26d82d1e46ff99739a527f3969c8: stopping tablet replica
I20260808 14:50:00.531823 30211 raft_consensus.cc:2229] T 24ed3a37eba04ff3b43506a00869ca60 P 904e26d82d1e46ff99739a527f3969c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:50:00.532173 30211 raft_consensus.cc:2258] T 24ed3a37eba04ff3b43506a00869ca60 P 904e26d82d1e46ff99739a527f3969c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:50:00.534078 30211 ts_tablet_manager.cc:1905] T 24ed3a37eba04ff3b43506a00869ca60 P 904e26d82d1e46ff99739a527f3969c8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:50:00.536465 30209 tablet_replica.cc:330] T 24ed3a37eba04ff3b43506a00869ca60 P 8fc0d02ecec34e88b5dff67bbe42ab86: stopping tablet replica
I20260808 14:50:00.536741 30209 raft_consensus.cc:2229] T 24ed3a37eba04ff3b43506a00869ca60 P 8fc0d02ecec34e88b5dff67bbe42ab86 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:50:00.537060 30209 raft_consensus.cc:2258] T 24ed3a37eba04ff3b43506a00869ca60 P 8fc0d02ecec34e88b5dff67bbe42ab86 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:50:00.538196 30209 ts_tablet_manager.cc:1905] T 24ed3a37eba04ff3b43506a00869ca60 P 8fc0d02ecec34e88b5dff67bbe42ab86: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:50:00.541370 30211 ts_tablet_manager.cc:1918] T 24ed3a37eba04ff3b43506a00869ca60 P 904e26d82d1e46ff99739a527f3969c8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 14:50:00.541550 30211 log.cc:1196] T 24ed3a37eba04ff3b43506a00869ca60 P 904e26d82d1e46ff99739a527f3969c8: Deleting WAL directory at /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200577490656-27451-0/minicluster-data/ts-2/wal/wals/24ed3a37eba04ff3b43506a00869ca60
I20260808 14:50:00.541816 30210 tablet_replica.cc:330] T 24ed3a37eba04ff3b43506a00869ca60 P 2c40e0aed672465e9c53c9e7e62aaff2: stopping tablet replica
I20260808 14:50:00.542039 30210 raft_consensus.cc:2229] T 24ed3a37eba04ff3b43506a00869ca60 P 2c40e0aed672465e9c53c9e7e62aaff2 [term 1 LEADER]: Raft consensus shutting down.
I20260808 14:50:00.542095 30211 ts_tablet_manager.cc:1939] T 24ed3a37eba04ff3b43506a00869ca60 P 904e26d82d1e46ff99739a527f3969c8: Deleting consensus metadata
I20260808 14:50:00.542448 30210 raft_consensus.cc:2258] T 24ed3a37eba04ff3b43506a00869ca60 P 2c40e0aed672465e9c53c9e7e62aaff2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:50:00.543248 29458 catalog_manager.cc:4841] TS 904e26d82d1e46ff99739a527f3969c8 (127.26.206.195:41007): tablet 24ed3a37eba04ff3b43506a00869ca60 (table test-table [id=6bfcb2a6ea444d4aa8e62aec06cea410]) successfully deleted
I20260808 14:50:00.543318 30210 ts_tablet_manager.cc:1905] T 24ed3a37eba04ff3b43506a00869ca60 P 2c40e0aed672465e9c53c9e7e62aaff2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:50:00.544766 30209 ts_tablet_manager.cc:1918] T 24ed3a37eba04ff3b43506a00869ca60 P 8fc0d02ecec34e88b5dff67bbe42ab86: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 14:50:00.544919 30209 log.cc:1196] T 24ed3a37eba04ff3b43506a00869ca60 P 8fc0d02ecec34e88b5dff67bbe42ab86: Deleting WAL directory at /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200577490656-27451-0/minicluster-data/ts-0/wal/wals/24ed3a37eba04ff3b43506a00869ca60
I20260808 14:50:00.545399 30209 ts_tablet_manager.cc:1939] T 24ed3a37eba04ff3b43506a00869ca60 P 8fc0d02ecec34e88b5dff67bbe42ab86: Deleting consensus metadata
I20260808 14:50:00.546510 29457 catalog_manager.cc:4841] TS 8fc0d02ecec34e88b5dff67bbe42ab86 (127.26.206.193:37433): tablet 24ed3a37eba04ff3b43506a00869ca60 (table test-table [id=6bfcb2a6ea444d4aa8e62aec06cea410]) successfully deleted
Aug 08 14:50:00 dist-test-slave-6k22 krb5kdc[29423](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200598, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.26.206.193@KRBTEST.COM
I20260808 14:50:00.550701 30210 ts_tablet_manager.cc:1918] T 24ed3a37eba04ff3b43506a00869ca60 P 2c40e0aed672465e9c53c9e7e62aaff2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 14:50:00.550871 30210 log.cc:1196] T 24ed3a37eba04ff3b43506a00869ca60 P 2c40e0aed672465e9c53c9e7e62aaff2: Deleting WAL directory at /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200577490656-27451-0/minicluster-data/ts-1/wal/wals/24ed3a37eba04ff3b43506a00869ca60
I20260808 14:50:00.551412 30210 ts_tablet_manager.cc:1939] T 24ed3a37eba04ff3b43506a00869ca60 P 2c40e0aed672465e9c53c9e7e62aaff2: Deleting consensus metadata
I20260808 14:50:00.552593 29458 catalog_manager.cc:4841] TS 2c40e0aed672465e9c53c9e7e62aaff2 (127.26.206.194:33511): tablet 24ed3a37eba04ff3b43506a00869ca60 (table test-table [id=6bfcb2a6ea444d4aa8e62aec06cea410]) successfully deleted
I20260808 14:50:00.556563 30214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:00.516216 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56540 (local address 127.26.206.193:37433)
0808 14:50:00.516876 (+ 660us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:00.516885 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:00.528369 (+ 11484us) server_negotiation.cc:407] Connection header received
0808 14:50:00.528452 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:00.528461 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:00.528578 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:00.528697 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:00.532520 (+ 3823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:00.534139 (+ 1619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:00.538677 (+ 4538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:00.539679 (+ 1002us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:00.539811 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:00.550106 (+ 10295us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:50:00.550124 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:50:00.550144 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:50:00.550182 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:50:00.553808 (+ 3626us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:00.554591 (+ 783us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:00.554598 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:00.554600 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:00.554725 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:00.555089 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:00.555092 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:00.555094 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:00.555467 (+ 373us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:50:00.555754 (+ 287us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:00.556063 (+ 309us) server_negotiation.cc:299] Negotiation successful
0808 14:50:00.556235 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":476,"thread_start_us":301,"threads_started":1}
W20260808 14:50:00.557260 29699 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:56540
W20260808 14:50:00.557930 27451 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 29553: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 14:50:00.558118 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 29553
I20260808 14:50:00.595322 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 29712
Aug 08 14:50:00 dist-test-slave-6k22 krb5kdc[29423](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200598, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.26.206.194@KRBTEST.COM
I20260808 14:50:00.610581 30215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:00.596104 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53238 (local address 127.26.206.194:33511)
0808 14:50:00.596656 (+ 552us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:00.596660 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:00.596674 (+ 14us) server_negotiation.cc:407] Connection header received
0808 14:50:00.596725 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:00.596729 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:00.596789 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:00.596910 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:00.598188 (+ 1278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:00.598963 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:00.600363 (+ 1400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:00.600764 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:00.600906 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:00.605077 (+ 4171us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:50:00.605095 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:50:00.605120 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:50:00.605153 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:50:00.607936 (+ 2783us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:00.608567 (+ 631us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:00.608574 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:00.608576 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:00.608695 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:00.609072 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:00.609077 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:00.609080 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:00.609437 (+ 357us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:50:00.609760 (+ 323us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:00.610034 (+ 274us) server_negotiation.cc:299] Negotiation successful
0808 14:50:00.610269 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":432,"thread_start_us":261,"threads_started":1}
W20260808 14:50:00.611269 29864 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:53238
W20260808 14:50:00.611914 27451 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 29712: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 14:50:00.612119 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 29712
I20260808 14:50:00.638242 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 29875
Aug 08 14:50:00 dist-test-slave-6k22 krb5kdc[29423](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200598, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.26.206.195@KRBTEST.COM
I20260808 14:50:00.653914 30217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:00.639091 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51604 (local address 127.26.206.195:41007)
0808 14:50:00.639713 (+ 622us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:00.639718 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:00.639734 (+ 16us) server_negotiation.cc:407] Connection header received
0808 14:50:00.639794 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:00.639798 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:00.639856 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:00.639977 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:00.641295 (+ 1318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:00.642104 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:00.643345 (+ 1241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:00.643829 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:00.643970 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:00.648891 (+ 4921us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:50:00.648921 (+ 30us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:50:00.648937 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:50:00.648971 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:50:00.651741 (+ 2770us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:00.652314 (+ 573us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:00.652321 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:00.652323 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:00.652439 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:00.652743 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:00.652746 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:00.652748 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:00.653093 (+ 345us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:50:00.653301 (+ 208us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:00.653490 (+ 189us) server_negotiation.cc:299] Negotiation successful
0808 14:50:00.653652 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":438,"thread_start_us":258,"threads_started":1}
W20260808 14:50:00.654630 30020 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51604
W20260808 14:50:00.655256 27451 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 29875: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 14:50:00.655378 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 29875
I20260808 14:50:00.675391 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 29437
I20260808 14:50:00.676570 29520 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:50:00.794256 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 29437
2026-08-08T14:50:00Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (8695 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200577490656-27451-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:50:00 dist-test-slave-6k22 krb5kdc[30222](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:50:00 dist-test-slave-6k22 krb5kdc[30222](info): set up 2 sockets
Aug 08 14:50:00 dist-test-slave-6k22 krb5kdc[30222](info): commencing operation
krb5kdc: starting...
W20260808 14:50:01.958132 27451 mini_kdc.cc:121] Time spent starting KDC: real 1.116s user 0.005s sys 0.017s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200577490656-27451-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200577490656-27451-0/krb5kdc/test-user.keytab.
Aug 08 14:50:02 dist-test-slave-6k22 krb5kdc[30222](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200602, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:50:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:50:02Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.206.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.206.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.206.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.254.keytab.
Entry for principal kudu/127.26.206.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.254.keytab.
I20260808 14:50:02.158959 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200577490656-27451-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200577490656-27451-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200577490656-27451-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.206.254:45569
--webserver_interface=127.26.206.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.254.keytab
--principal=kudu/127.26.206.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.206.212:45099
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.206.254:45569
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:50:02.484808 30236 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:50:02.485149 30236 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:50:02.485316 30236 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:50:02.492427 30236 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:50:02.492601 30236 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:50:02.492712 30236 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:50:02.492838 30236 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:50:02.492933 30236 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:50:02.502373 30236 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:45099
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200577490656-27451-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200577490656-27451-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.206.254:45569
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.254.keytab
--principal=kudu/127.26.206.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.206.254:45569
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.206.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200577490656-27451-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:50:02.504096 30236 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:50:02.505375 30236 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:50:02.517530 30245 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:50:02.517483 30243 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:50:02.517570 30247 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:50:02.518105 30236 server_base.cc:1034] running on GCE node
I20260808 14:50:02.518967 30236 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:50:02.520351 30236 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:50:02.521582 30236 hybrid_clock.cc:648] HybridClock initialized: now 1786200602521540 us; error 55 us; skew 500 ppm
I20260808 14:50:02.521919 30236 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:50:02 dist-test-slave-6k22 krb5kdc[30222](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200602, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:50:02.524904 30236 init.cc:377] Logged in from keytab as kudu/127.26.206.254@KRBTEST.COM (short username kudu)
I20260808 14:50:02.526229 30236 webserver.cc:460] Webserver started at http://127.26.206.254:33427/ using document root <none> and password file <none>
I20260808 14:50:02.526878 30236 fs_manager.cc:359] Metadata directory not provided
I20260808 14:50:02.526976 30236 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:50:02.527220 30236 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:50:02.530076 30236 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200577490656-27451-0/minicluster-data/master-0/data/instance:
uuid: "218559212bb846269f8fbe3c83685112"
format_stamp: "Formatted at 2026-08-08 14:50:02 on dist-test-slave-6k22"
server_key: "77e77ce0dbcc0b4991f2043c1b0fc101"
server_key_iv: "e00c6e38a4089de3bbe930d24b617c8b"
server_key_version: "encryptionkey@0"
I20260808 14:50:02.530786 30236 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200577490656-27451-0/minicluster-data/master-0/wal/instance:
uuid: "218559212bb846269f8fbe3c83685112"
format_stamp: "Formatted at 2026-08-08 14:50:02 on dist-test-slave-6k22"
server_key: "77e77ce0dbcc0b4991f2043c1b0fc101"
server_key_iv: "e00c6e38a4089de3bbe930d24b617c8b"
server_key_version: "encryptionkey@0"
I20260808 14:50:02.535894 30236 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260808 14:50:02.539219 30258 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:50:02.540547 30236 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 14:50:02.540725 30236 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200577490656-27451-0/minicluster-data/master-0/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200577490656-27451-0/minicluster-data/master-0/wal
uuid: "218559212bb846269f8fbe3c83685112"
format_stamp: "Formatted at 2026-08-08 14:50:02 on dist-test-slave-6k22"
server_key: "77e77ce0dbcc0b4991f2043c1b0fc101"
server_key_iv: "e00c6e38a4089de3bbe930d24b617c8b"
server_key_version: "encryptionkey@0"
I20260808 14:50:02.540930 30236 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200577490656-27451-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200577490656-27451-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200577490656-27451-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:50:02.572683 30236 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:50:02.576665 30236 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:50:02.576967 30236 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:50:02.595430 30236 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.254:45569
I20260808 14:50:02.595454 30311 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.254:45569 every 8 connection(s)
I20260808 14:50:02.596825 30236 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
I20260808 14:50:02.600430 30312 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:50:02.606977 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 30236
I20260808 14:50:02.607204 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200577490656-27451-0/minicluster-data/master-0/wal/instance
I20260808 14:50:02.608145 27451 external_mini_cluster.cc:1428] Setting key 5dcd56caf1e62163bbd82e163125eb2b
I20260808 14:50:02.611871 30312 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 218559212bb846269f8fbe3c83685112: Bootstrap starting.
I20260808 14:50:02.615482 30312 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 218559212bb846269f8fbe3c83685112: Neither blocks nor log segments found. Creating new log.
I20260808 14:50:02.616557 30312 log.cc:824] T 00000000000000000000000000000000 P 218559212bb846269f8fbe3c83685112: Log is configured to *not* fsync() on all Append() calls
I20260808 14:50:02.619555 30312 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 218559212bb846269f8fbe3c83685112: No bootstrap required, opened a new log
Aug 08 14:50:02 dist-test-slave-6k22 krb5kdc[30222](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200602, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.206.254@KRBTEST.COM
I20260808 14:50:02.628327 30312 raft_consensus.cc:348] T 00000000000000000000000000000000 P 218559212bb846269f8fbe3c83685112 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "218559212bb846269f8fbe3c83685112" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 45569 } }
I20260808 14:50:02.628692 30312 raft_consensus.cc:374] T 00000000000000000000000000000000 P 218559212bb846269f8fbe3c83685112 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:50:02.628834 30312 raft_consensus.cc:729] T 00000000000000000000000000000000 P 218559212bb846269f8fbe3c83685112 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218559212bb846269f8fbe3c83685112, State: Initialized, Role: FOLLOWER
I20260808 14:50:02.629462 30312 consensus_queue.cc:260] T 00000000000000000000000000000000 P 218559212bb846269f8fbe3c83685112 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "218559212bb846269f8fbe3c83685112" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 45569 } }
I20260808 14:50:02.629707 30312 raft_consensus.cc:388] T 00000000000000000000000000000000 P 218559212bb846269f8fbe3c83685112 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:50:02.629874 30312 raft_consensus.cc:482] T 00000000000000000000000000000000 P 218559212bb846269f8fbe3c83685112 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:50:02.630131 30312 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 218559212bb846269f8fbe3c83685112 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:50:02.631577 30315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:02.610204 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39122 (local address 127.26.206.254:45569)
0808 14:50:02.610982 (+ 778us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:02.610993 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:02.611031 (+ 38us) server_negotiation.cc:407] Connection header received
0808 14:50:02.612748 (+ 1717us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:02.612769 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:02.613124 (+ 355us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:02.613470 (+ 346us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:02.615234 (+ 1764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:02.616712 (+ 1478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:02.618293 (+ 1581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:02.618925 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:02.619050 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:02.623865 (+ 4815us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:50:02.623872 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:50:02.623885 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:50:02.623916 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:50:02.626981 (+ 3065us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:02.627772 (+ 791us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:02.627778 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:02.627784 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:02.627938 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:02.628341 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:02.628345 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:02.628350 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:02.628966 (+ 616us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:50:02.629327 (+ 361us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:02.629663 (+ 336us) server_negotiation.cc:299] Negotiation successful
0808 14:50:02.630122 (+ 459us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":588,"thread_start_us":384,"threads_started":1}
I20260808 14:50:02.633487 30312 raft_consensus.cc:504] T 00000000000000000000000000000000 P 218559212bb846269f8fbe3c83685112 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "218559212bb846269f8fbe3c83685112" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 45569 } }
I20260808 14:50:02.634024 30312 leader_election.cc:302] T 00000000000000000000000000000000 P 218559212bb846269f8fbe3c83685112 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 218559212bb846269f8fbe3c83685112; no voters:
I20260808 14:50:02.634691 30312 leader_election.cc:288] T 00000000000000000000000000000000 P 218559212bb846269f8fbe3c83685112 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:50:02.634822 30317 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 218559212bb846269f8fbe3c83685112 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:50:02.635499 30317 raft_consensus.cc:686] T 00000000000000000000000000000000 P 218559212bb846269f8fbe3c83685112 [term 1 LEADER]: Becoming Leader. State: Replica: 218559212bb846269f8fbe3c83685112, State: Running, Role: LEADER
I20260808 14:50:02.636087 30317 consensus_queue.cc:237] T 00000000000000000000000000000000 P 218559212bb846269f8fbe3c83685112 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "218559212bb846269f8fbe3c83685112" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 45569 } }
I20260808 14:50:02.636878 30312 sys_catalog.cc:564] T 00000000000000000000000000000000 P 218559212bb846269f8fbe3c83685112 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:50:02.639030 30319 sys_catalog.cc:455] T 00000000000000000000000000000000 P 218559212bb846269f8fbe3c83685112 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 218559212bb846269f8fbe3c83685112. Latest consensus state: current_term: 1 leader_uuid: "218559212bb846269f8fbe3c83685112" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "218559212bb846269f8fbe3c83685112" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 45569 } } }
I20260808 14:50:02.639232 30318 sys_catalog.cc:455] T 00000000000000000000000000000000 P 218559212bb846269f8fbe3c83685112 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "218559212bb846269f8fbe3c83685112" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "218559212bb846269f8fbe3c83685112" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 45569 } } }
I20260808 14:50:02.639636 30319 sys_catalog.cc:458] T 00000000000000000000000000000000 P 218559212bb846269f8fbe3c83685112 [sys.catalog]: This master's current role is: LEADER
I20260808 14:50:02.639678 30318 sys_catalog.cc:458] T 00000000000000000000000000000000 P 218559212bb846269f8fbe3c83685112 [sys.catalog]: This master's current role is: LEADER
I20260808 14:50:02.651660 30323 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:50:02.655802 30323 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:50:02.663209 30323 catalog_manager.cc:1347] Generated new cluster ID: 6b9a8a0382e343ce8bd2381515359c42
I20260808 14:50:02.663355 30323 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:50:02.672027 30323 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:50:02.673355 30323 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:50:02.682574 30323 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 218559212bb846269f8fbe3c83685112: Generated new TSK 0
I20260808 14:50:02.683389 30323 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.206.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.206.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.206.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.193.keytab.
Entry for principal kudu/127.26.206.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.193.keytab.
I20260808 14:50:02.739830 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200577490656-27451-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200577490656-27451-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200577490656-27451-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200577490656-27451-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.206.193:0
--local_ip_for_outbound_sockets=127.26.206.193
--webserver_interface=127.26.206.193
--webserver_port=0
--tserver_master_addrs=127.26.206.254:45569
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.193.keytab
--principal=kudu/127.26.206.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.206.212:45099
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:50:03.071166 30341 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:50:03.071449 30341 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:50:03.071692 30341 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:50:03.079107 30341 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:50:03.079221 30341 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:50:03.079490 30341 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.206.193
I20260808 14:50:03.089620 30341 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:45099
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200577490656-27451-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200577490656-27451-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.193.keytab
--principal=kudu/127.26.206.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.206.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200577490656-27451-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.206.193
--webserver_port=0
--tserver_master_addrs=127.26.206.254:45569
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.206.193
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200577490656-27451-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:50:03.090909 30341 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:50:03.092361 30341 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:50:03.105428 30346 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:50:03.105458 30349 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:50:03.105821 30347 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:50:03.106873 30341 server_base.cc:1034] running on GCE node
I20260808 14:50:03.107518 30341 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:50:03.108572 30341 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:50:03.109799 30341 hybrid_clock.cc:648] HybridClock initialized: now 1786200603109736 us; error 55 us; skew 500 ppm
I20260808 14:50:03.110137 30341 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:50:03 dist-test-slave-6k22 krb5kdc[30222](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200603, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:50:03.113536 30341 init.cc:377] Logged in from keytab as kudu/127.26.206.193@KRBTEST.COM (short username kudu)
I20260808 14:50:03.115080 30341 webserver.cc:460] Webserver started at http://127.26.206.193:37653/ using document root <none> and password file <none>
I20260808 14:50:03.115836 30341 fs_manager.cc:359] Metadata directory not provided
I20260808 14:50:03.115963 30341 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:50:03.116283 30341 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:50:03.119107 30341 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200577490656-27451-0/minicluster-data/ts-0/data/instance:
uuid: "2bc7b5097a9c49f0844f8a7c65095d13"
format_stamp: "Formatted at 2026-08-08 14:50:03 on dist-test-slave-6k22"
server_key: "420b8fb0c9b52582b6d2ba1119251dce"
server_key_iv: "a23645b328765b31218ff414e1c047ee"
server_key_version: "encryptionkey@0"
I20260808 14:50:03.119925 30341 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200577490656-27451-0/minicluster-data/ts-0/wal/instance:
uuid: "2bc7b5097a9c49f0844f8a7c65095d13"
format_stamp: "Formatted at 2026-08-08 14:50:03 on dist-test-slave-6k22"
server_key: "420b8fb0c9b52582b6d2ba1119251dce"
server_key_iv: "a23645b328765b31218ff414e1c047ee"
server_key_version: "encryptionkey@0"
I20260808 14:50:03.124660 30341 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.002s
I20260808 14:50:03.127915 30358 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:50:03.129057 30341 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260808 14:50:03.129209 30341 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200577490656-27451-0/minicluster-data/ts-0/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200577490656-27451-0/minicluster-data/ts-0/wal
uuid: "2bc7b5097a9c49f0844f8a7c65095d13"
format_stamp: "Formatted at 2026-08-08 14:50:03 on dist-test-slave-6k22"
server_key: "420b8fb0c9b52582b6d2ba1119251dce"
server_key_iv: "a23645b328765b31218ff414e1c047ee"
server_key_version: "encryptionkey@0"
I20260808 14:50:03.129388 30341 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200577490656-27451-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200577490656-27451-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200577490656-27451-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:50:03.170257 30341 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:50:03.174678 30341 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:50:03.174981 30341 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:50:03.175946 30341 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:50:03.177275 30341 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:50:03.177346 30341 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:50:03.177515 30341 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:50:03.177577 30341 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:50:03.210541 30341 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.193:43525
I20260808 14:50:03.210628 30482 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.193:43525 every 8 connection(s)
I20260808 14:50:03.211921 30341 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200577490656-27451-0/minicluster-data/ts-0/data/info.pb
I20260808 14:50:03.221863 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 30341
I20260808 14:50:03.222079 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200577490656-27451-0/minicluster-data/ts-0/wal/instance
I20260808 14:50:03.222910 27451 external_mini_cluster.cc:1428] Setting key 6821a59ae39f0fa89cf8903b330f37e4
Aug 08 14:50:03 dist-test-slave-6k22 krb5kdc[30222](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200603, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.193@KRBTEST.COM for kudu/127.26.206.254@KRBTEST.COM
I20260808 14:50:03.233355 30485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:03.214379 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.193:51177 (local address 127.26.206.254:45569)
0808 14:50:03.214896 (+ 517us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:03.214903 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:03.215768 (+ 865us) server_negotiation.cc:407] Connection header received
0808 14:50:03.217512 (+ 1744us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:03.217516 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:03.217598 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:03.217692 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:03.219152 (+ 1460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:03.220172 (+ 1020us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:03.221773 (+ 1601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:03.222446 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:03.222592 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:03.226322 (+ 3730us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:50:03.226331 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:50:03.226338 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:50:03.226400 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:50:03.230192 (+ 3792us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:03.230906 (+ 714us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:03.230913 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:03.230919 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:03.231072 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:03.231479 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:03.231485 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:03.231491 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:03.231927 (+ 436us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:50:03.232080 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:03.232737 (+ 657us) server_negotiation.cc:299] Negotiation successful
0808 14:50:03.232990 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":373,"thread_start_us":248,"threads_started":1}
I20260808 14:50:03.234690 30487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:03.214890 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:45569 (local address 127.26.206.193:51177)
0808 14:50:03.215607 (+ 717us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:03.215658 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0808 14:50:03.217276 (+ 1618us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:50:03.217877 (+ 601us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:50:03.217884 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:50:03.218410 (+ 526us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:50:03.218964 (+ 554us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:03.218980 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:03.220345 (+ 1365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:03.220348 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:03.221573 (+ 1225us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:03.221584 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:03.222662 (+ 1078us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:03.222667 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:03.222863 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:03.223693 (+ 830us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:50:03.223733 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:50:03.226094 (+ 2361us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:50:03.230335 (+ 4241us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:50:03.230341 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:50:03.230352 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:50:03.230786 (+ 434us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:50:03.231180 (+ 394us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:50:03.231183 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:50:03.231185 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:50:03.231371 (+ 186us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:50:03.232073 (+ 702us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:50:03.232078 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:50:03.232368 (+ 290us) client_negotiation.cc:769] Sending connection context
0808 14:50:03.232626 (+ 258us) client_negotiation.cc:240] Negotiation successful
0808 14:50:03.233182 (+ 556us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":461,"thread_start_us":270,"threads_started":1}
I20260808 14:50:03.237748 30483 heartbeater.cc:347] Connected to a master server at 127.26.206.254:45569
I20260808 14:50:03.238047 30483 heartbeater.cc:464] Registering TS with master...
I20260808 14:50:03.238876 30483 heartbeater.cc:511] Master 127.26.206.254:45569 requested a full tablet report, sending...
I20260808 14:50:03.240985 30275 ts_manager.cc:194] Registered new tserver with Master: 2bc7b5097a9c49f0844f8a7c65095d13 (127.26.206.193:43525)
I20260808 14:50:03.242412 30275 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.206.193@KRBTEST.COM'} at 127.26.206.193:51177
WARNING: no policy specified for kudu/127.26.206.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.206.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.206.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.194.keytab.
Entry for principal kudu/127.26.206.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.194.keytab.
I20260808 14:50:03.272516 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200577490656-27451-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200577490656-27451-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200577490656-27451-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200577490656-27451-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.206.194:0
--local_ip_for_outbound_sockets=127.26.206.194
--webserver_interface=127.26.206.194
--webserver_port=0
--tserver_master_addrs=127.26.206.254:45569
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.194.keytab
--principal=kudu/127.26.206.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.206.212:45099
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:50:03.595237 30491 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:50:03.595515 30491 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:50:03.595742 30491 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:50:03.602882 30491 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:50:03.602977 30491 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:50:03.603144 30491 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.206.194
I20260808 14:50:03.612529 30491 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:45099
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200577490656-27451-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200577490656-27451-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.194.keytab
--principal=kudu/127.26.206.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.206.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200577490656-27451-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.206.194
--webserver_port=0
--tserver_master_addrs=127.26.206.254:45569
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.206.194
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200577490656-27451-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:50:03.613687 30491 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:50:03.614913 30491 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:50:03.627864 30500 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:50:03.627944 30497 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:50:03.628001 30496 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:50:03.629149 30491 server_base.cc:1034] running on GCE node
I20260808 14:50:03.629704 30491 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:50:03.630723 30491 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:50:03.631925 30491 hybrid_clock.cc:648] HybridClock initialized: now 1786200603631881 us; error 44 us; skew 500 ppm
I20260808 14:50:03.632247 30491 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:50:03 dist-test-slave-6k22 krb5kdc[30222](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200603, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:50:03.635398 30491 init.cc:377] Logged in from keytab as kudu/127.26.206.194@KRBTEST.COM (short username kudu)
I20260808 14:50:03.636914 30491 webserver.cc:460] Webserver started at http://127.26.206.194:35095/ using document root <none> and password file <none>
I20260808 14:50:03.637593 30491 fs_manager.cc:359] Metadata directory not provided
I20260808 14:50:03.637735 30491 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:50:03.638089 30491 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:50:03.641083 30491 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200577490656-27451-0/minicluster-data/ts-1/data/instance:
uuid: "198cf8376dea4b839df0dd434bd1e28d"
format_stamp: "Formatted at 2026-08-08 14:50:03 on dist-test-slave-6k22"
server_key: "8fc7962764815c2cc71b7b84b084c719"
server_key_iv: "d0326894ccee96081c737cfd54245c43"
server_key_version: "encryptionkey@0"
I20260808 14:50:03.641881 30491 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200577490656-27451-0/minicluster-data/ts-1/wal/instance:
uuid: "198cf8376dea4b839df0dd434bd1e28d"
format_stamp: "Formatted at 2026-08-08 14:50:03 on dist-test-slave-6k22"
server_key: "8fc7962764815c2cc71b7b84b084c719"
server_key_iv: "d0326894ccee96081c737cfd54245c43"
server_key_version: "encryptionkey@0"
I20260808 14:50:03.647018 30491 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260808 14:50:03.650796 30508 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:50:03.652185 30491 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 14:50:03.652366 30491 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200577490656-27451-0/minicluster-data/ts-1/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200577490656-27451-0/minicluster-data/ts-1/wal
uuid: "198cf8376dea4b839df0dd434bd1e28d"
format_stamp: "Formatted at 2026-08-08 14:50:03 on dist-test-slave-6k22"
server_key: "8fc7962764815c2cc71b7b84b084c719"
server_key_iv: "d0326894ccee96081c737cfd54245c43"
server_key_version: "encryptionkey@0"
I20260808 14:50:03.652590 30491 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200577490656-27451-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200577490656-27451-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200577490656-27451-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:50:03.672384 30491 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:50:03.676352 30491 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:50:03.676647 30491 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:50:03.677610 30491 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:50:03.678965 30491 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:50:03.679069 30491 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:50:03.679220 30491 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:50:03.679294 30491 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:50:03.712474 30491 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.194:37409
I20260808 14:50:03.712524 30638 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.194:37409 every 8 connection(s)
I20260808 14:50:03.713749 30491 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200577490656-27451-0/minicluster-data/ts-1/data/info.pb
I20260808 14:50:03.721827 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 30491
I20260808 14:50:03.722033 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200577490656-27451-0/minicluster-data/ts-1/wal/instance
I20260808 14:50:03.722484 27451 external_mini_cluster.cc:1428] Setting key a5edbc0d4eab7606ed3151ae9aaeed33
Aug 08 14:50:03 dist-test-slave-6k22 krb5kdc[30222](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200603, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.194@KRBTEST.COM for kudu/127.26.206.254@KRBTEST.COM
I20260808 14:50:03.734021 30485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:03.716333 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.194:34667 (local address 127.26.206.254:45569)
0808 14:50:03.716506 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:03.716511 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:03.717555 (+ 1044us) server_negotiation.cc:407] Connection header received
0808 14:50:03.719366 (+ 1811us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:03.719372 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:03.719467 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:03.719597 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:03.721062 (+ 1465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:03.721814 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:03.723640 (+ 1826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:03.724117 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:03.724254 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:03.728367 (+ 4113us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:50:03.728372 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:50:03.728376 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:50:03.728407 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:50:03.730900 (+ 2493us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:03.731647 (+ 747us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:03.731657 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:03.731660 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:03.731783 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:03.732249 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:03.732253 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:03.732255 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:03.732533 (+ 278us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:50:03.732697 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:03.733455 (+ 758us) server_negotiation.cc:299] Negotiation successful
0808 14:50:03.733683 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260808 14:50:03.734988 30641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:03.716700 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:45569 (local address 127.26.206.194:34667)
0808 14:50:03.717388 (+ 688us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:03.717429 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 14:50:03.719094 (+ 1665us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:50:03.719838 (+ 744us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:50:03.719845 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:50:03.720346 (+ 501us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:50:03.720887 (+ 541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:03.720904 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:03.721978 (+ 1074us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:03.721984 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:03.723451 (+ 1467us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:03.723464 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:03.724362 (+ 898us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:03.724369 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:03.724676 (+ 307us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:03.725412 (+ 736us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:50:03.725449 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:50:03.728140 (+ 2691us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:50:03.731048 (+ 2908us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:50:03.731056 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:50:03.731071 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:50:03.731497 (+ 426us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:50:03.731912 (+ 415us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:50:03.731935 (+ 23us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:50:03.731938 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:50:03.732118 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:50:03.732674 (+ 556us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:50:03.732682 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:50:03.733032 (+ 350us) client_negotiation.cc:769] Sending connection context
0808 14:50:03.733343 (+ 311us) client_negotiation.cc:240] Negotiation successful
0808 14:50:03.733854 (+ 511us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":464,"thread_start_us":263,"threads_started":1}
I20260808 14:50:03.736428 30639 heartbeater.cc:347] Connected to a master server at 127.26.206.254:45569
I20260808 14:50:03.736754 30639 heartbeater.cc:464] Registering TS with master...
I20260808 14:50:03.737625 30639 heartbeater.cc:511] Master 127.26.206.254:45569 requested a full tablet report, sending...
I20260808 14:50:03.739328 30275 ts_manager.cc:194] Registered new tserver with Master: 198cf8376dea4b839df0dd434bd1e28d (127.26.206.194:37409)
I20260808 14:50:03.740656 30275 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.206.194@KRBTEST.COM'} at 127.26.206.194:34667
WARNING: no policy specified for kudu/127.26.206.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.206.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.206.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.195.keytab.
Entry for principal kudu/127.26.206.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.195.keytab.
I20260808 14:50:03.772787 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200577490656-27451-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200577490656-27451-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200577490656-27451-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200577490656-27451-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.206.195:0
--local_ip_for_outbound_sockets=127.26.206.195
--webserver_interface=127.26.206.195
--webserver_port=0
--tserver_master_addrs=127.26.206.254:45569
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.195.keytab
--principal=kudu/127.26.206.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.206.212:45099
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:50:04.094229 30644 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:50:04.094502 30644 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:50:04.094682 30644 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:50:04.101918 30644 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:50:04.102041 30644 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:50:04.102212 30644 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.206.195
I20260808 14:50:04.111666 30644 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:45099
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200577490656-27451-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200577490656-27451-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.195.keytab
--principal=kudu/127.26.206.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.206.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200577490656-27451-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.206.195
--webserver_port=0
--tserver_master_addrs=127.26.206.254:45569
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.206.195
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200577490656-27451-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:50:04.112958 30644 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:50:04.114220 30644 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:50:04.127274 30649 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:50:04.127333 30652 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:50:04.127391 30650 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:50:04.128082 30644 server_base.cc:1034] running on GCE node
I20260808 14:50:04.128638 30644 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:50:04.129438 30644 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:50:04.130683 30644 hybrid_clock.cc:648] HybridClock initialized: now 1786200604130643 us; error 69 us; skew 500 ppm
I20260808 14:50:04.130986 30644 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:50:04 dist-test-slave-6k22 krb5kdc[30222](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200604, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:50:04.134249 30644 init.cc:377] Logged in from keytab as kudu/127.26.206.195@KRBTEST.COM (short username kudu)
I20260808 14:50:04.135651 30644 webserver.cc:460] Webserver started at http://127.26.206.195:35041/ using document root <none> and password file <none>
I20260808 14:50:04.136401 30644 fs_manager.cc:359] Metadata directory not provided
I20260808 14:50:04.136533 30644 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:50:04.136932 30644 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:50:04.140044 30644 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200577490656-27451-0/minicluster-data/ts-2/data/instance:
uuid: "42bcd33c902e43088621baf7f0334a77"
format_stamp: "Formatted at 2026-08-08 14:50:04 on dist-test-slave-6k22"
server_key: "fc2f9c1cc34829871e5a640d997e4bda"
server_key_iv: "85062ebce038616776813ba01c040651"
server_key_version: "encryptionkey@0"
I20260808 14:50:04.140846 30644 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200577490656-27451-0/minicluster-data/ts-2/wal/instance:
uuid: "42bcd33c902e43088621baf7f0334a77"
format_stamp: "Formatted at 2026-08-08 14:50:04 on dist-test-slave-6k22"
server_key: "fc2f9c1cc34829871e5a640d997e4bda"
server_key_iv: "85062ebce038616776813ba01c040651"
server_key_version: "encryptionkey@0"
I20260808 14:50:04.145934 30644 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260808 14:50:04.149415 30661 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:50:04.150717 30644 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 14:50:04.150892 30644 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200577490656-27451-0/minicluster-data/ts-2/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200577490656-27451-0/minicluster-data/ts-2/wal
uuid: "42bcd33c902e43088621baf7f0334a77"
format_stamp: "Formatted at 2026-08-08 14:50:04 on dist-test-slave-6k22"
server_key: "fc2f9c1cc34829871e5a640d997e4bda"
server_key_iv: "85062ebce038616776813ba01c040651"
server_key_version: "encryptionkey@0"
I20260808 14:50:04.151083 30644 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200577490656-27451-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200577490656-27451-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200577490656-27451-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:50:04.181434 30644 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:50:04.185456 30644 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:50:04.185701 30644 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:50:04.186568 30644 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:50:04.187924 30644 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:50:04.188001 30644 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:50:04.188084 30644 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:50:04.188133 30644 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:50:04.221820 30644 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.195:44397
I20260808 14:50:04.221911 30788 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.195:44397 every 8 connection(s)
I20260808 14:50:04.223076 30644 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200577490656-27451-0/minicluster-data/ts-2/data/info.pb
I20260808 14:50:04.231797 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 30644
I20260808 14:50:04.231967 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200577490656-27451-0/minicluster-data/ts-2/wal/instance
I20260808 14:50:04.232507 27451 external_mini_cluster.cc:1428] Setting key d605b636e96203ad34704e27b35461f0
Aug 08 14:50:04 dist-test-slave-6k22 krb5kdc[30222](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200604, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.195@KRBTEST.COM for kudu/127.26.206.254@KRBTEST.COM
I20260808 14:50:04.243959 30485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:04.225687 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.195:33609 (local address 127.26.206.254:45569)
0808 14:50:04.225882 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:04.225887 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:04.226939 (+ 1052us) server_negotiation.cc:407] Connection header received
0808 14:50:04.228816 (+ 1877us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:04.228822 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:04.228925 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:04.229071 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:04.230573 (+ 1502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:04.231382 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:04.233242 (+ 1860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:04.233853 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:04.233995 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:04.237688 (+ 3693us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:50:04.237698 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:50:04.237704 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:50:04.237745 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:50:04.241315 (+ 3570us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:04.241968 (+ 653us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:04.241972 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:04.241974 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:04.242100 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:04.242439 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:04.242442 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:04.242443 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:04.242684 (+ 241us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:50:04.242796 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:04.243408 (+ 612us) server_negotiation.cc:299] Negotiation successful
0808 14:50:04.243661 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260808 14:50:04.244956 30791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:04.226050 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:45569 (local address 127.26.206.195:33609)
0808 14:50:04.226778 (+ 728us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:04.226819 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 14:50:04.228532 (+ 1713us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:50:04.229300 (+ 768us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:50:04.229307 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:50:04.229816 (+ 509us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:50:04.230394 (+ 578us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:04.230410 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:04.231540 (+ 1130us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:04.231547 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:04.233061 (+ 1514us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:04.233077 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:04.234061 (+ 984us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:04.234066 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:04.234304 (+ 238us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:04.235034 (+ 730us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:50:04.235063 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:50:04.237464 (+ 2401us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:50:04.241431 (+ 3967us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:50:04.241438 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:50:04.241448 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:50:04.241859 (+ 411us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:50:04.242171 (+ 312us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:50:04.242174 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:50:04.242176 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:50:04.242341 (+ 165us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:50:04.242791 (+ 450us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:50:04.242796 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:50:04.243081 (+ 285us) client_negotiation.cc:769] Sending connection context
0808 14:50:04.243301 (+ 220us) client_negotiation.cc:240] Negotiation successful
0808 14:50:04.243757 (+ 456us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":481,"thread_start_us":266,"threads_started":1}
I20260808 14:50:04.245378 30483 heartbeater.cc:503] Master 127.26.206.254:45569 was elected leader, sending a full tablet report...
I20260808 14:50:04.246647 30789 heartbeater.cc:347] Connected to a master server at 127.26.206.254:45569
I20260808 14:50:04.247143 30789 heartbeater.cc:464] Registering TS with master...
I20260808 14:50:04.248132 30789 heartbeater.cc:511] Master 127.26.206.254:45569 requested a full tablet report, sending...
I20260808 14:50:04.249790 30274 ts_manager.cc:194] Registered new tserver with Master: 42bcd33c902e43088621baf7f0334a77 (127.26.206.195:44397)
I20260808 14:50:04.250609 30274 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.206.195@KRBTEST.COM'} at 127.26.206.195:33609
I20260808 14:50:04.260283 27451 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260808 14:50:04.298346 30485 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:50:04.295278 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39138 (local address 127.26.206.254:45569)
0808 14:50:04.295620 (+ 342us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:04.295631 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:04.296190 (+ 559us) server_negotiation.cc:407] Connection header received
0808 14:50:04.296428 (+ 238us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:04.296433 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:04.296507 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:04.296619 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:04.298019 (+ 1400us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39138: BlockingRecv error: recv got EOF from 127.0.0.1:39138 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
I20260808 14:50:04.301878 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 30341
W20260808 14:50:04.304586 27451 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 30341: Not authorized: Client connection negotiation failed: client connection to 127.26.206.193:43525: server requires authentication, but client does not have Kerberos credentials available
I20260808 14:50:04.304857 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 30341
I20260808 14:50:04.325819 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 30491
W20260808 14:50:04.328302 27451 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 30491: Not authorized: Client connection negotiation failed: client connection to 127.26.206.194:37409: server requires authentication, but client does not have Kerberos credentials available
I20260808 14:50:04.328446 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 30491
I20260808 14:50:04.346948 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 30644
W20260808 14:50:04.349946 27451 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 30644: Not authorized: Client connection negotiation failed: client connection to 127.26.206.195:44397: server requires authentication, but client does not have Kerberos credentials available
I20260808 14:50:04.350119 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 30644
I20260808 14:50:04.367869 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 30236
I20260808 14:50:04.369232 30307 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:50:04.471886 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 30236
2026-08-08T14:50:04Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (3675 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786200577490656-27451-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:50:04 dist-test-slave-6k22 krb5kdc[30807](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:50:04 dist-test-slave-6k22 krb5kdc[30807](info): set up 2 sockets
Aug 08 14:50:04 dist-test-slave-6k22 krb5kdc[30807](info): commencing operation
krb5kdc: starting...
W20260808 14:50:05.618810 27451 mini_kdc.cc:121] Time spent starting KDC: real 1.101s user 0.001s sys 0.022s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786200577490656-27451-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786200577490656-27451-0/krb5kdc/test-user.keytab.
Aug 08 14:50:05 dist-test-slave-6k22 krb5kdc[30807](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200605, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:50:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:50:05Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.206.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.206.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.206.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.254.keytab.
Entry for principal kudu/127.26.206.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.254.keytab.
I20260808 14:50:05.827527 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786200577490656-27451-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786200577490656-27451-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786200577490656-27451-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.206.254:40779
--webserver_interface=127.26.206.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.254.keytab
--principal=kudu/127.26.206.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.206.212:37357
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.206.254:40779
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:50:06.149370 30823 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:50:06.149729 30823 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:50:06.149955 30823 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:50:06.157121 30823 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:50:06.157269 30823 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:50:06.157384 30823 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:50:06.157498 30823 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:50:06.157582 30823 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:50:06.167171 30823 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:37357
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786200577490656-27451-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786200577490656-27451-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.206.254:40779
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.254.keytab
--principal=kudu/127.26.206.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.206.254:40779
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.206.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786200577490656-27451-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:50:06.168567 30823 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:50:06.169965 30823 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:50:06.184623 30828 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:50:06.184618 30829 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:50:06.185405 30831 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:50:06.185786 30823 server_base.cc:1034] running on GCE node
I20260808 14:50:06.186628 30823 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:50:06.188139 30823 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:50:06.189378 30823 hybrid_clock.cc:648] HybridClock initialized: now 1786200606189335 us; error 38 us; skew 500 ppm
I20260808 14:50:06.189749 30823 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:50:06 dist-test-slave-6k22 krb5kdc[30807](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200606, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:50:06.199155 30823 init.cc:377] Logged in from keytab as kudu/127.26.206.254@KRBTEST.COM (short username kudu)
I20260808 14:50:06.200673 30823 webserver.cc:460] Webserver started at http://127.26.206.254:44461/ using document root <none> and password file <none>
I20260808 14:50:06.201354 30823 fs_manager.cc:359] Metadata directory not provided
I20260808 14:50:06.201493 30823 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:50:06.201838 30823 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:50:06.204891 30823 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786200577490656-27451-0/minicluster-data/master-0/data/instance:
uuid: "e15f5e03397145569c5518b409991036"
format_stamp: "Formatted at 2026-08-08 14:50:06 on dist-test-slave-6k22"
server_key: "71fbfaf9472909213c71184c96558c3f"
server_key_iv: "39a7b7828de3db733c4db0c94a8879b5"
server_key_version: "encryptionkey@0"
I20260808 14:50:06.205700 30823 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786200577490656-27451-0/minicluster-data/master-0/wal/instance:
uuid: "e15f5e03397145569c5518b409991036"
format_stamp: "Formatted at 2026-08-08 14:50:06 on dist-test-slave-6k22"
server_key: "71fbfaf9472909213c71184c96558c3f"
server_key_iv: "39a7b7828de3db733c4db0c94a8879b5"
server_key_version: "encryptionkey@0"
I20260808 14:50:06.210680 30823 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260808 14:50:06.214051 30840 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:50:06.215320 30823 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 14:50:06.215494 30823 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786200577490656-27451-0/minicluster-data/master-0/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786200577490656-27451-0/minicluster-data/master-0/wal
uuid: "e15f5e03397145569c5518b409991036"
format_stamp: "Formatted at 2026-08-08 14:50:06 on dist-test-slave-6k22"
server_key: "71fbfaf9472909213c71184c96558c3f"
server_key_iv: "39a7b7828de3db733c4db0c94a8879b5"
server_key_version: "encryptionkey@0"
I20260808 14:50:06.215742 30823 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786200577490656-27451-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786200577490656-27451-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786200577490656-27451-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:50:06.233582 30823 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:50:06.237702 30823 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:50:06.237988 30823 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:50:06.258311 30823 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.254:40779
I20260808 14:50:06.258975 30895 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.254:40779 every 8 connection(s)
I20260808 14:50:06.260178 30823 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
I20260808 14:50:06.263911 30896 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:50:06.267518 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 30823
I20260808 14:50:06.267843 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786200577490656-27451-0/minicluster-data/master-0/wal/instance
I20260808 14:50:06.268772 27451 external_mini_cluster.cc:1428] Setting key 5bd1d0d36d03230b165b3266bc7fa615
I20260808 14:50:06.277601 30896 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e15f5e03397145569c5518b409991036: Bootstrap starting.
I20260808 14:50:06.281749 30896 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e15f5e03397145569c5518b409991036: Neither blocks nor log segments found. Creating new log.
I20260808 14:50:06.283186 30896 log.cc:824] T 00000000000000000000000000000000 P e15f5e03397145569c5518b409991036: Log is configured to *not* fsync() on all Append() calls
Aug 08 14:50:06 dist-test-slave-6k22 krb5kdc[30807](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200605, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.206.254@KRBTEST.COM
I20260808 14:50:06.286381 30896 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e15f5e03397145569c5518b409991036: No bootstrap required, opened a new log
I20260808 14:50:06.292650 30899 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:06.270711 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36844 (local address 127.26.206.254:40779)
0808 14:50:06.271482 (+ 771us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:06.271493 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:06.271544 (+ 51us) server_negotiation.cc:407] Connection header received
0808 14:50:06.273214 (+ 1670us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:06.273233 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:06.273600 (+ 367us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:06.273912 (+ 312us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:06.275898 (+ 1986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:06.277170 (+ 1272us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:06.278996 (+ 1826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:06.279733 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:06.279874 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:06.285284 (+ 5410us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:50:06.285293 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:50:06.285307 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:50:06.285346 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:50:06.288544 (+ 3198us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:06.289401 (+ 857us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:06.289410 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:06.289416 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:06.289582 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:06.290017 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:06.290021 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:06.290022 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:06.290546 (+ 524us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:50:06.290755 (+ 209us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:06.291249 (+ 494us) server_negotiation.cc:299] Negotiation successful
0808 14:50:06.291621 (+ 372us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":567,"thread_start_us":380,"threads_started":1}
I20260808 14:50:06.297253 27451 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:50:06.297142 30896 raft_consensus.cc:348] T 00000000000000000000000000000000 P e15f5e03397145569c5518b409991036 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e15f5e03397145569c5518b409991036" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 40779 } }
I20260808 14:50:06.297603 30896 raft_consensus.cc:374] T 00000000000000000000000000000000 P e15f5e03397145569c5518b409991036 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:50:06.297717 30896 raft_consensus.cc:729] T 00000000000000000000000000000000 P e15f5e03397145569c5518b409991036 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e15f5e03397145569c5518b409991036, State: Initialized, Role: FOLLOWER
I20260808 14:50:06.298372 30896 consensus_queue.cc:260] T 00000000000000000000000000000000 P e15f5e03397145569c5518b409991036 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e15f5e03397145569c5518b409991036" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 40779 } }
I20260808 14:50:06.298696 30896 raft_consensus.cc:388] T 00000000000000000000000000000000 P e15f5e03397145569c5518b409991036 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:50:06.298843 30896 raft_consensus.cc:482] T 00000000000000000000000000000000 P e15f5e03397145569c5518b409991036 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:50:06.299005 30896 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e15f5e03397145569c5518b409991036 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:50:06.302757 30896 raft_consensus.cc:504] T 00000000000000000000000000000000 P e15f5e03397145569c5518b409991036 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e15f5e03397145569c5518b409991036" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 40779 } }
I20260808 14:50:06.303373 30896 leader_election.cc:302] T 00000000000000000000000000000000 P e15f5e03397145569c5518b409991036 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e15f5e03397145569c5518b409991036; no voters:
I20260808 14:50:06.304178 30896 leader_election.cc:288] T 00000000000000000000000000000000 P e15f5e03397145569c5518b409991036 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:50:06.304272 30903 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e15f5e03397145569c5518b409991036 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:50:06.306663 30896 sys_catalog.cc:564] T 00000000000000000000000000000000 P e15f5e03397145569c5518b409991036 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:50:06.308089 30903 raft_consensus.cc:686] T 00000000000000000000000000000000 P e15f5e03397145569c5518b409991036 [term 1 LEADER]: Becoming Leader. State: Replica: e15f5e03397145569c5518b409991036, State: Running, Role: LEADER
I20260808 14:50:06.308815 30903 consensus_queue.cc:237] T 00000000000000000000000000000000 P e15f5e03397145569c5518b409991036 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e15f5e03397145569c5518b409991036" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 40779 } }
I20260808 14:50:06.311817 30905 sys_catalog.cc:455] T 00000000000000000000000000000000 P e15f5e03397145569c5518b409991036 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e15f5e03397145569c5518b409991036" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e15f5e03397145569c5518b409991036" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 40779 } } }
I20260808 14:50:06.312201 30905 sys_catalog.cc:458] T 00000000000000000000000000000000 P e15f5e03397145569c5518b409991036 [sys.catalog]: This master's current role is: LEADER
I20260808 14:50:06.312695 30906 sys_catalog.cc:455] T 00000000000000000000000000000000 P e15f5e03397145569c5518b409991036 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e15f5e03397145569c5518b409991036. Latest consensus state: current_term: 1 leader_uuid: "e15f5e03397145569c5518b409991036" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e15f5e03397145569c5518b409991036" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 40779 } } }
I20260808 14:50:06.312961 30906 sys_catalog.cc:458] T 00000000000000000000000000000000 P e15f5e03397145569c5518b409991036 [sys.catalog]: This master's current role is: LEADER
I20260808 14:50:06.320885 30915 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:50:06.326066 30915 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:50:06.348062 30915 catalog_manager.cc:1347] Generated new cluster ID: 67d467732ca74109924b171db9714853
I20260808 14:50:06.348191 30915 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:50:06.371994 30899 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:06.363123 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36848 (local address 127.26.206.254:40779)
0808 14:50:06.363324 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:06.363333 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:06.363361 (+ 28us) server_negotiation.cc:407] Connection header received
0808 14:50:06.363431 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:06.363437 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:06.363537 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:06.363748 (+ 211us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:06.364896 (+ 1148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:06.366039 (+ 1143us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:06.367825 (+ 1786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:06.368534 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:06.368691 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:06.369917 (+ 1226us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:50:06.369926 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:50:06.369930 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:50:06.371019 (+ 1089us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:50:06.371111 (+ 92us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:50:06.371151 (+ 40us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:50:06.371280 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:06.371429 (+ 149us) server_negotiation.cc:299] Negotiation successful
0808 14:50:06.371542 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260808 14:50:06.379184 30915 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:50:06.380530 30915 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:50:06.393452 30915 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e15f5e03397145569c5518b409991036: Generated new TSK 0
I20260808 14:50:06.394233 30915 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:50:06.412822 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 30823
I20260808 14:50:06.413986 30890 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:50:06.509017 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 30823
2026-08-08T14:50:06Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (2030 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200577490656-27451-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:50:06 dist-test-slave-6k22 krb5kdc[30934](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:50:06 dist-test-slave-6k22 krb5kdc[30934](info): set up 2 sockets
Aug 08 14:50:06 dist-test-slave-6k22 krb5kdc[30934](info): commencing operation
krb5kdc: starting...
W20260808 14:50:07.650300 27451 mini_kdc.cc:121] Time spent starting KDC: real 1.102s user 0.002s sys 0.023s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200577490656-27451-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200577490656-27451-0/krb5kdc/test-user.keytab.
Aug 08 14:50:07 dist-test-slave-6k22 krb5kdc[30934](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200607, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:50:07Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:50:07Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.206.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.206.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.206.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.254.keytab.
Entry for principal kudu/127.26.206.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.254.keytab.
I20260808 14:50:07.858633 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200577490656-27451-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200577490656-27451-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200577490656-27451-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.206.254:39129
--webserver_interface=127.26.206.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.254.keytab
--principal=kudu/127.26.206.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.206.212:42337
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.206.254:39129
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:50:08.196816 30951 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:50:08.197153 30951 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:50:08.197317 30951 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:50:08.204487 30951 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:50:08.204622 30951 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:50:08.204741 30951 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:50:08.204843 30951 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:50:08.204932 30951 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:50:08.214459 30951 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:42337
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200577490656-27451-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200577490656-27451-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.206.254:39129
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.254.keytab
--principal=kudu/127.26.206.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.206.254:39129
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.206.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200577490656-27451-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:50:08.215813 30951 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:50:08.217113 30951 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:50:08.228494 30962 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:50:08.228592 30957 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:50:08.228562 30959 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:50:08.229530 30951 server_base.cc:1034] running on GCE node
I20260808 14:50:08.230347 30951 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:50:08.231714 30951 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:50:08.232909 30951 hybrid_clock.cc:648] HybridClock initialized: now 1786200608232854 us; error 46 us; skew 500 ppm
I20260808 14:50:08.233254 30951 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:50:08 dist-test-slave-6k22 krb5kdc[30934](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200608, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:50:08.236366 30951 init.cc:377] Logged in from keytab as kudu/127.26.206.254@KRBTEST.COM (short username kudu)
I20260808 14:50:08.237859 30951 webserver.cc:460] Webserver started at http://127.26.206.254:42559/ using document root <none> and password file <none>
I20260808 14:50:08.238520 30951 fs_manager.cc:359] Metadata directory not provided
I20260808 14:50:08.238656 30951 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:50:08.238976 30951 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:50:08.241878 30951 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200577490656-27451-0/minicluster-data/master-0/data/instance:
uuid: "b3c5ba85f5944654a47ede43d8dc9873"
format_stamp: "Formatted at 2026-08-08 14:50:08 on dist-test-slave-6k22"
server_key: "5461984390cf5bae8f2a628d2abcd6ab"
server_key_iv: "8c4e84f19178a77a39fd8f1f72668b86"
server_key_version: "encryptionkey@0"
I20260808 14:50:08.242616 30951 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200577490656-27451-0/minicluster-data/master-0/wal/instance:
uuid: "b3c5ba85f5944654a47ede43d8dc9873"
format_stamp: "Formatted at 2026-08-08 14:50:08 on dist-test-slave-6k22"
server_key: "5461984390cf5bae8f2a628d2abcd6ab"
server_key_iv: "8c4e84f19178a77a39fd8f1f72668b86"
server_key_version: "encryptionkey@0"
I20260808 14:50:08.247733 30951 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.002s
I20260808 14:50:08.251055 30970 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:50:08.252331 30951 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 14:50:08.252511 30951 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200577490656-27451-0/minicluster-data/master-0/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200577490656-27451-0/minicluster-data/master-0/wal
uuid: "b3c5ba85f5944654a47ede43d8dc9873"
format_stamp: "Formatted at 2026-08-08 14:50:08 on dist-test-slave-6k22"
server_key: "5461984390cf5bae8f2a628d2abcd6ab"
server_key_iv: "8c4e84f19178a77a39fd8f1f72668b86"
server_key_version: "encryptionkey@0"
I20260808 14:50:08.252664 30951 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200577490656-27451-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200577490656-27451-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200577490656-27451-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:50:08.269881 30951 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:50:08.273984 30951 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:50:08.274271 30951 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:50:08.292347 30951 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.254:39129
I20260808 14:50:08.292384 31030 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.254:39129 every 8 connection(s)
I20260808 14:50:08.293664 30951 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
I20260808 14:50:08.297158 31031 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:50:08.297850 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 30951
I20260808 14:50:08.298100 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200577490656-27451-0/minicluster-data/master-0/wal/instance
I20260808 14:50:08.298961 27451 external_mini_cluster.cc:1428] Setting key 7e4bb269bae57184a50048a70096fc81
I20260808 14:50:08.311105 31031 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b3c5ba85f5944654a47ede43d8dc9873: Bootstrap starting.
Aug 08 14:50:08 dist-test-slave-6k22 krb5kdc[30934](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200607, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.206.254@KRBTEST.COM
I20260808 14:50:08.314720 31031 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b3c5ba85f5944654a47ede43d8dc9873: Neither blocks nor log segments found. Creating new log.
I20260808 14:50:08.315814 31031 log.cc:824] T 00000000000000000000000000000000 P b3c5ba85f5944654a47ede43d8dc9873: Log is configured to *not* fsync() on all Append() calls
I20260808 14:50:08.318914 31031 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b3c5ba85f5944654a47ede43d8dc9873: No bootstrap required, opened a new log
I20260808 14:50:08.322464 31035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:08.301027 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48116 (local address 127.26.206.254:39129)
0808 14:50:08.301766 (+ 739us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:08.301780 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:08.301822 (+ 42us) server_negotiation.cc:407] Connection header received
0808 14:50:08.303542 (+ 1720us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:08.303614 (+ 72us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:08.303987 (+ 373us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:08.304304 (+ 317us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:08.305984 (+ 1680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:08.307235 (+ 1251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:08.309020 (+ 1785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:08.309639 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:08.309754 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:08.314378 (+ 4624us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:50:08.314386 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:50:08.314400 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:50:08.314434 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:50:08.318085 (+ 3651us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:08.318734 (+ 649us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:08.318742 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:08.318750 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:08.318993 (+ 243us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:08.319344 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:08.319351 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:08.319360 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:08.320054 (+ 694us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:50:08.320363 (+ 309us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:08.320696 (+ 333us) server_negotiation.cc:299] Negotiation successful
0808 14:50:08.321140 (+ 444us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":549,"thread_start_us":366,"threads_started":1}
I20260808 14:50:08.328019 31031 raft_consensus.cc:348] T 00000000000000000000000000000000 P b3c5ba85f5944654a47ede43d8dc9873 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3c5ba85f5944654a47ede43d8dc9873" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 39129 } }
I20260808 14:50:08.328434 31031 raft_consensus.cc:374] T 00000000000000000000000000000000 P b3c5ba85f5944654a47ede43d8dc9873 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:50:08.328572 31031 raft_consensus.cc:729] T 00000000000000000000000000000000 P b3c5ba85f5944654a47ede43d8dc9873 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3c5ba85f5944654a47ede43d8dc9873, State: Initialized, Role: FOLLOWER
I20260808 14:50:08.329154 31031 consensus_queue.cc:260] T 00000000000000000000000000000000 P b3c5ba85f5944654a47ede43d8dc9873 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3c5ba85f5944654a47ede43d8dc9873" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 39129 } }
I20260808 14:50:08.329401 31031 raft_consensus.cc:388] T 00000000000000000000000000000000 P b3c5ba85f5944654a47ede43d8dc9873 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:50:08.329541 31031 raft_consensus.cc:482] T 00000000000000000000000000000000 P b3c5ba85f5944654a47ede43d8dc9873 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:50:08.329706 31031 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b3c5ba85f5944654a47ede43d8dc9873 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:50:08.331882 31031 raft_consensus.cc:504] T 00000000000000000000000000000000 P b3c5ba85f5944654a47ede43d8dc9873 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3c5ba85f5944654a47ede43d8dc9873" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 39129 } }
I20260808 14:50:08.332350 31031 leader_election.cc:302] T 00000000000000000000000000000000 P b3c5ba85f5944654a47ede43d8dc9873 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b3c5ba85f5944654a47ede43d8dc9873; no voters:
I20260808 14:50:08.332947 31031 leader_election.cc:288] T 00000000000000000000000000000000 P b3c5ba85f5944654a47ede43d8dc9873 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:50:08.333091 31037 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b3c5ba85f5944654a47ede43d8dc9873 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:50:08.333827 31037 raft_consensus.cc:686] T 00000000000000000000000000000000 P b3c5ba85f5944654a47ede43d8dc9873 [term 1 LEADER]: Becoming Leader. State: Replica: b3c5ba85f5944654a47ede43d8dc9873, State: Running, Role: LEADER
I20260808 14:50:08.334344 31037 consensus_queue.cc:237] T 00000000000000000000000000000000 P b3c5ba85f5944654a47ede43d8dc9873 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3c5ba85f5944654a47ede43d8dc9873" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 39129 } }
I20260808 14:50:08.334990 31031 sys_catalog.cc:564] T 00000000000000000000000000000000 P b3c5ba85f5944654a47ede43d8dc9873 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:50:08.336992 31039 sys_catalog.cc:455] T 00000000000000000000000000000000 P b3c5ba85f5944654a47ede43d8dc9873 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b3c5ba85f5944654a47ede43d8dc9873" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3c5ba85f5944654a47ede43d8dc9873" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 39129 } } }
I20260808 14:50:08.337397 31039 sys_catalog.cc:458] T 00000000000000000000000000000000 P b3c5ba85f5944654a47ede43d8dc9873 [sys.catalog]: This master's current role is: LEADER
I20260808 14:50:08.337330 31041 sys_catalog.cc:455] T 00000000000000000000000000000000 P b3c5ba85f5944654a47ede43d8dc9873 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b3c5ba85f5944654a47ede43d8dc9873. Latest consensus state: current_term: 1 leader_uuid: "b3c5ba85f5944654a47ede43d8dc9873" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3c5ba85f5944654a47ede43d8dc9873" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 39129 } } }
I20260808 14:50:08.337836 31041 sys_catalog.cc:458] T 00000000000000000000000000000000 P b3c5ba85f5944654a47ede43d8dc9873 [sys.catalog]: This master's current role is: LEADER
I20260808 14:50:08.339198 31045 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:50:08.345182 31045 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:50:08.353448 31045 catalog_manager.cc:1347] Generated new cluster ID: f0a59a4de4384784a026d8c1a5495153
I20260808 14:50:08.353544 31045 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:50:08.370518 31045 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:50:08.371848 31045 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:50:08.387519 31045 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b3c5ba85f5944654a47ede43d8dc9873: Generated new TSK 0
I20260808 14:50:08.388445 31045 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.206.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.206.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.206.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.193.keytab.
Entry for principal kudu/127.26.206.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.193.keytab.
I20260808 14:50:08.449406 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200577490656-27451-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200577490656-27451-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200577490656-27451-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200577490656-27451-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.206.193:0
--local_ip_for_outbound_sockets=127.26.206.193
--webserver_interface=127.26.206.193
--webserver_port=0
--tserver_master_addrs=127.26.206.254:39129
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.193.keytab
--principal=kudu/127.26.206.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.206.212:42337
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:50:08.805953 31061 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:50:08.806212 31061 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:50:08.806324 31061 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:50:08.813410 31061 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:50:08.813509 31061 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:50:08.813619 31061 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.206.193
I20260808 14:50:08.824106 31061 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:42337
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200577490656-27451-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200577490656-27451-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.193.keytab
--principal=kudu/127.26.206.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.206.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200577490656-27451-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.206.193
--webserver_port=0
--tserver_master_addrs=127.26.206.254:39129
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.206.193
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200577490656-27451-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:50:08.825443 31061 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:50:08.826803 31061 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:50:08.840063 31068 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:50:08.840116 31069 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:50:08.840189 31071 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:50:08.841202 31061 server_base.cc:1034] running on GCE node
I20260808 14:50:08.841887 31061 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:50:08.842831 31061 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:50:08.844043 31061 hybrid_clock.cc:648] HybridClock initialized: now 1786200608843984 us; error 29 us; skew 500 ppm
I20260808 14:50:08.844385 31061 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:50:08 dist-test-slave-6k22 krb5kdc[30934](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200608, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:50:08.847699 31061 init.cc:377] Logged in from keytab as kudu/127.26.206.193@KRBTEST.COM (short username kudu)
I20260808 14:50:08.849037 31061 webserver.cc:460] Webserver started at http://127.26.206.193:46881/ using document root <none> and password file <none>
I20260808 14:50:08.849669 31061 fs_manager.cc:359] Metadata directory not provided
I20260808 14:50:08.849772 31061 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:50:08.850023 31061 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:50:08.853052 31061 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200577490656-27451-0/minicluster-data/ts-0/data/instance:
uuid: "7b9cba0205fd4079bc303b49428b12d9"
format_stamp: "Formatted at 2026-08-08 14:50:08 on dist-test-slave-6k22"
server_key: "b9459ab872d7cbbc9ab04cc492240654"
server_key_iv: "b1ac05b0c518358218fc9573420526b8"
server_key_version: "encryptionkey@0"
I20260808 14:50:08.853773 31061 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200577490656-27451-0/minicluster-data/ts-0/wal/instance:
uuid: "7b9cba0205fd4079bc303b49428b12d9"
format_stamp: "Formatted at 2026-08-08 14:50:08 on dist-test-slave-6k22"
server_key: "b9459ab872d7cbbc9ab04cc492240654"
server_key_iv: "b1ac05b0c518358218fc9573420526b8"
server_key_version: "encryptionkey@0"
I20260808 14:50:08.858911 31061 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260808 14:50:08.862259 31078 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:50:08.863548 31061 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260808 14:50:08.863767 31061 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200577490656-27451-0/minicluster-data/ts-0/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200577490656-27451-0/minicluster-data/ts-0/wal
uuid: "7b9cba0205fd4079bc303b49428b12d9"
format_stamp: "Formatted at 2026-08-08 14:50:08 on dist-test-slave-6k22"
server_key: "b9459ab872d7cbbc9ab04cc492240654"
server_key_iv: "b1ac05b0c518358218fc9573420526b8"
server_key_version: "encryptionkey@0"
I20260808 14:50:08.863935 31061 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200577490656-27451-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200577490656-27451-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200577490656-27451-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:50:08.884158 31061 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:50:08.888620 31061 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:50:08.888868 31061 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:50:08.889777 31061 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:50:08.891043 31061 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:50:08.891156 31061 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:50:08.891330 31061 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:50:08.891407 31061 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:50:08.925015 31061 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.193:38611
I20260808 14:50:08.925057 31206 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.193:38611 every 8 connection(s)
I20260808 14:50:08.926291 31061 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200577490656-27451-0/minicluster-data/ts-0/data/info.pb
I20260808 14:50:08.934463 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 31061
I20260808 14:50:08.934743 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200577490656-27451-0/minicluster-data/ts-0/wal/instance
I20260808 14:50:08.935500 27451 external_mini_cluster.cc:1428] Setting key 936fb09258fde196b09a66eeb80e2c7e
Aug 08 14:50:08 dist-test-slave-6k22 krb5kdc[30934](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200608, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.193@KRBTEST.COM for kudu/127.26.206.254@KRBTEST.COM
I20260808 14:50:08.947294 31209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:08.928985 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.193:50491 (local address 127.26.206.254:39129)
0808 14:50:08.929445 (+ 460us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:08.929449 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:08.930386 (+ 937us) server_negotiation.cc:407] Connection header received
0808 14:50:08.932119 (+ 1733us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:08.932123 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:08.932187 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:08.932291 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:08.933675 (+ 1384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:08.934407 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:08.936528 (+ 2121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:08.936920 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:08.937059 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:08.941105 (+ 4046us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:50:08.941110 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:50:08.941113 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:50:08.941144 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:50:08.943869 (+ 2725us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:08.944797 (+ 928us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:08.944800 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:08.944802 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:08.944911 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:08.945396 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:08.945399 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:08.945401 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:08.945715 (+ 314us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:50:08.945869 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:08.946558 (+ 689us) server_negotiation.cc:299] Negotiation successful
0808 14:50:08.946815 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":354,"thread_start_us":242,"threads_started":1}
I20260808 14:50:08.947868 31210 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:08.929533 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:39129 (local address 127.26.206.193:50491)
0808 14:50:08.930213 (+ 680us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:08.930251 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 14:50:08.931873 (+ 1622us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:50:08.932498 (+ 625us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:50:08.932506 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:50:08.932984 (+ 478us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:50:08.933530 (+ 546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:08.933546 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:08.934570 (+ 1024us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:08.934579 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:08.936348 (+ 1769us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:08.936360 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:08.937152 (+ 792us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:08.937161 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:08.937423 (+ 262us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:08.938137 (+ 714us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:50:08.938162 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:50:08.940899 (+ 2737us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:50:08.944016 (+ 3117us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:50:08.944027 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:50:08.944045 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:50:08.944679 (+ 634us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:50:08.945015 (+ 336us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:50:08.945022 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:50:08.945028 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:50:08.945282 (+ 254us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:50:08.945844 (+ 562us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:50:08.945850 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:50:08.946137 (+ 287us) client_negotiation.cc:769] Sending connection context
0808 14:50:08.946367 (+ 230us) client_negotiation.cc:240] Negotiation successful
0808 14:50:08.946749 (+ 382us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":458,"thread_start_us":260,"threads_started":1}
I20260808 14:50:08.949474 31207 heartbeater.cc:347] Connected to a master server at 127.26.206.254:39129
I20260808 14:50:08.949816 31207 heartbeater.cc:464] Registering TS with master...
I20260808 14:50:08.950757 31207 heartbeater.cc:511] Master 127.26.206.254:39129 requested a full tablet report, sending...
I20260808 14:50:08.952965 30991 ts_manager.cc:194] Registered new tserver with Master: 7b9cba0205fd4079bc303b49428b12d9 (127.26.206.193:38611)
I20260808 14:50:08.954389 30991 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.206.193@KRBTEST.COM'} at 127.26.206.193:50491
WARNING: no policy specified for kudu/127.26.206.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.206.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.206.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.194.keytab.
Entry for principal kudu/127.26.206.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.194.keytab.
I20260808 14:50:08.987244 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200577490656-27451-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200577490656-27451-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200577490656-27451-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200577490656-27451-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.206.194:0
--local_ip_for_outbound_sockets=127.26.206.194
--webserver_interface=127.26.206.194
--webserver_port=0
--tserver_master_addrs=127.26.206.254:39129
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.194.keytab
--principal=kudu/127.26.206.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.206.212:42337
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:50:09.318754 31213 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:50:09.319031 31213 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:50:09.319213 31213 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:50:09.326714 31213 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:50:09.326831 31213 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:50:09.327080 31213 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.206.194
I20260808 14:50:09.337508 31213 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:42337
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200577490656-27451-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200577490656-27451-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.194.keytab
--principal=kudu/127.26.206.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.206.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200577490656-27451-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.206.194
--webserver_port=0
--tserver_master_addrs=127.26.206.254:39129
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.206.194
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200577490656-27451-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:50:09.338922 31213 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:50:09.340477 31213 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:50:09.355461 31223 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:50:09.355505 31221 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:50:09.355429 31219 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:50:09.356763 31213 server_base.cc:1034] running on GCE node
I20260808 14:50:09.357411 31213 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:50:09.358433 31213 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:50:09.359655 31213 hybrid_clock.cc:648] HybridClock initialized: now 1786200609359586 us; error 54 us; skew 500 ppm
I20260808 14:50:09.359985 31213 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:50:09 dist-test-slave-6k22 krb5kdc[30934](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200609, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:50:09.363179 31213 init.cc:377] Logged in from keytab as kudu/127.26.206.194@KRBTEST.COM (short username kudu)
I20260808 14:50:09.364866 31213 webserver.cc:460] Webserver started at http://127.26.206.194:45415/ using document root <none> and password file <none>
I20260808 14:50:09.365554 31213 fs_manager.cc:359] Metadata directory not provided
I20260808 14:50:09.365716 31213 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:50:09.366050 31213 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:50:09.369397 31213 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200577490656-27451-0/minicluster-data/ts-1/data/instance:
uuid: "5569a7af97a14b3689de9018eef70758"
format_stamp: "Formatted at 2026-08-08 14:50:09 on dist-test-slave-6k22"
server_key: "058f476d291f36298dfbbf856eb10951"
server_key_iv: "518a31fd420d50e2ff754a502e080be7"
server_key_version: "encryptionkey@0"
I20260808 14:50:09.370267 31213 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200577490656-27451-0/minicluster-data/ts-1/wal/instance:
uuid: "5569a7af97a14b3689de9018eef70758"
format_stamp: "Formatted at 2026-08-08 14:50:09 on dist-test-slave-6k22"
server_key: "058f476d291f36298dfbbf856eb10951"
server_key_iv: "518a31fd420d50e2ff754a502e080be7"
server_key_version: "encryptionkey@0"
I20260808 14:50:09.375547 31213 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.003s
I20260808 14:50:09.379359 31230 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:50:09.381084 31213 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 14:50:09.381271 31213 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200577490656-27451-0/minicluster-data/ts-1/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200577490656-27451-0/minicluster-data/ts-1/wal
uuid: "5569a7af97a14b3689de9018eef70758"
format_stamp: "Formatted at 2026-08-08 14:50:09 on dist-test-slave-6k22"
server_key: "058f476d291f36298dfbbf856eb10951"
server_key_iv: "518a31fd420d50e2ff754a502e080be7"
server_key_version: "encryptionkey@0"
I20260808 14:50:09.381482 31213 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200577490656-27451-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200577490656-27451-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200577490656-27451-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:50:09.394085 31213 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:50:09.398244 31213 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:50:09.398576 31213 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:50:09.399518 31213 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:50:09.400858 31213 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:50:09.400959 31213 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:50:09.401095 31213 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:50:09.401175 31213 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:50:09.434561 31213 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.194:39569
I20260808 14:50:09.434617 31357 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.194:39569 every 8 connection(s)
I20260808 14:50:09.435997 31213 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200577490656-27451-0/minicluster-data/ts-1/data/info.pb
I20260808 14:50:09.438621 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 31213
I20260808 14:50:09.438854 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200577490656-27451-0/minicluster-data/ts-1/wal/instance
I20260808 14:50:09.439602 27451 external_mini_cluster.cc:1428] Setting key 2fa56d4703351c03a7d195af449b237b
Aug 08 14:50:09 dist-test-slave-6k22 krb5kdc[30934](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200609, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.194@KRBTEST.COM for kudu/127.26.206.254@KRBTEST.COM
I20260808 14:50:09.458422 31209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:09.438939 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.194:44459 (local address 127.26.206.254:39129)
0808 14:50:09.439104 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:09.439109 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:09.440812 (+ 1703us) server_negotiation.cc:407] Connection header received
0808 14:50:09.442826 (+ 2014us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:09.442832 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:09.442924 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:09.443030 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:09.444538 (+ 1508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:09.445234 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:09.446718 (+ 1484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:09.447381 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:09.447504 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:09.451416 (+ 3912us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:50:09.451425 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:50:09.451433 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:50:09.451477 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:50:09.455149 (+ 3672us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:09.455903 (+ 754us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:09.455911 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:09.455917 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:09.456077 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:09.456476 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:09.456483 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:09.456489 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:09.456867 (+ 378us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:50:09.457048 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:09.457655 (+ 607us) server_negotiation.cc:299] Negotiation successful
0808 14:50:09.457912 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260808 14:50:09.459023 31360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:09.439719 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:39129 (local address 127.26.206.194:44459)
0808 14:50:09.440626 (+ 907us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:09.440668 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 14:50:09.442562 (+ 1894us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:50:09.443255 (+ 693us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:50:09.443263 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:50:09.443833 (+ 570us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:50:09.444374 (+ 541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:09.444391 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:09.445385 (+ 994us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:09.445389 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:09.446569 (+ 1180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:09.446580 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:09.447639 (+ 1059us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:09.447650 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:09.447995 (+ 345us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:09.448750 (+ 755us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:50:09.448797 (+ 47us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:50:09.451149 (+ 2352us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:50:09.455288 (+ 4139us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:50:09.455294 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:50:09.455304 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:50:09.455767 (+ 463us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:50:09.456188 (+ 421us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:50:09.456192 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:50:09.456194 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:50:09.456365 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:50:09.456996 (+ 631us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:50:09.457001 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:50:09.457276 (+ 275us) client_negotiation.cc:769] Sending connection context
0808 14:50:09.457489 (+ 213us) client_negotiation.cc:240] Negotiation successful
0808 14:50:09.457983 (+ 494us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":556,"thread_start_us":303,"threads_started":1}
I20260808 14:50:09.460400 31358 heartbeater.cc:347] Connected to a master server at 127.26.206.254:39129
I20260808 14:50:09.460690 31358 heartbeater.cc:464] Registering TS with master...
I20260808 14:50:09.461373 31358 heartbeater.cc:511] Master 127.26.206.254:39129 requested a full tablet report, sending...
I20260808 14:50:09.462752 30991 ts_manager.cc:194] Registered new tserver with Master: 5569a7af97a14b3689de9018eef70758 (127.26.206.194:39569)
WARNING: no policy specified for kudu/127.26.206.195@KRBTEST.COM; defaulting to no policy
I20260808 14:50:09.463632 30991 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.206.194@KRBTEST.COM'} at 127.26.206.194:44459
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.206.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.206.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.195.keytab.
Entry for principal kudu/127.26.206.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.195.keytab.
I20260808 14:50:09.490562 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200577490656-27451-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200577490656-27451-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200577490656-27451-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200577490656-27451-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.206.195:0
--local_ip_for_outbound_sockets=127.26.206.195
--webserver_interface=127.26.206.195
--webserver_port=0
--tserver_master_addrs=127.26.206.254:39129
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.195.keytab
--principal=kudu/127.26.206.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.206.212:42337
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:50:09.813601 31364 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:50:09.813862 31364 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:50:09.813954 31364 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:50:09.820983 31364 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:50:09.821086 31364 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:50:09.821197 31364 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.206.195
I20260808 14:50:09.830806 31364 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:42337
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200577490656-27451-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200577490656-27451-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.195.keytab
--principal=kudu/127.26.206.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.206.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200577490656-27451-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.206.195
--webserver_port=0
--tserver_master_addrs=127.26.206.254:39129
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.206.195
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200577490656-27451-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:50:09.832082 31364 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:50:09.833307 31364 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:50:09.846396 31369 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:50:09.846426 31372 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:50:09.846395 31370 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:50:09.847102 31364 server_base.cc:1034] running on GCE node
I20260808 14:50:09.847751 31364 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:50:09.848634 31364 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:50:09.849840 31364 hybrid_clock.cc:648] HybridClock initialized: now 1786200609849788 us; error 53 us; skew 500 ppm
I20260808 14:50:09.850139 31364 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:50:09 dist-test-slave-6k22 krb5kdc[30934](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200609, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:50:09.853263 31364 init.cc:377] Logged in from keytab as kudu/127.26.206.195@KRBTEST.COM (short username kudu)
I20260808 14:50:09.854599 31364 webserver.cc:460] Webserver started at http://127.26.206.195:42619/ using document root <none> and password file <none>
I20260808 14:50:09.855214 31364 fs_manager.cc:359] Metadata directory not provided
I20260808 14:50:09.855312 31364 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:50:09.855598 31364 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:50:09.858585 31364 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200577490656-27451-0/minicluster-data/ts-2/data/instance:
uuid: "d7bf9c1e00f442d29a6ac99b6f14914e"
format_stamp: "Formatted at 2026-08-08 14:50:09 on dist-test-slave-6k22"
server_key: "9bb38ecd4daa13de256db80fc5767bb6"
server_key_iv: "d23bf8d4612fbec96870f6f2c795dfe5"
server_key_version: "encryptionkey@0"
I20260808 14:50:09.859304 31364 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200577490656-27451-0/minicluster-data/ts-2/wal/instance:
uuid: "d7bf9c1e00f442d29a6ac99b6f14914e"
format_stamp: "Formatted at 2026-08-08 14:50:09 on dist-test-slave-6k22"
server_key: "9bb38ecd4daa13de256db80fc5767bb6"
server_key_iv: "d23bf8d4612fbec96870f6f2c795dfe5"
server_key_version: "encryptionkey@0"
I20260808 14:50:09.864357 31364 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.001s
I20260808 14:50:09.867817 31379 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:50:09.869088 31364 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260808 14:50:09.869239 31364 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200577490656-27451-0/minicluster-data/ts-2/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200577490656-27451-0/minicluster-data/ts-2/wal
uuid: "d7bf9c1e00f442d29a6ac99b6f14914e"
format_stamp: "Formatted at 2026-08-08 14:50:09 on dist-test-slave-6k22"
server_key: "9bb38ecd4daa13de256db80fc5767bb6"
server_key_iv: "d23bf8d4612fbec96870f6f2c795dfe5"
server_key_version: "encryptionkey@0"
I20260808 14:50:09.869443 31364 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200577490656-27451-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200577490656-27451-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200577490656-27451-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:50:09.885012 31364 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:50:09.889230 31364 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:50:09.889519 31364 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:50:09.890450 31364 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:50:09.891767 31364 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:50:09.891904 31364 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:50:09.892058 31364 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:50:09.892127 31364 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:50:09.925695 31364 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.195:41375
I20260808 14:50:09.925799 31505 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.195:41375 every 8 connection(s)
I20260808 14:50:09.926977 31364 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200577490656-27451-0/minicluster-data/ts-2/data/info.pb
I20260808 14:50:09.930725 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 31364
I20260808 14:50:09.930966 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200577490656-27451-0/minicluster-data/ts-2/wal/instance
I20260808 14:50:09.931468 27451 external_mini_cluster.cc:1428] Setting key b199a4e7678039f40f479225ef5c519c
Aug 08 14:50:09 dist-test-slave-6k22 krb5kdc[30934](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200609, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.195@KRBTEST.COM for kudu/127.26.206.254@KRBTEST.COM
I20260808 14:50:09.947625 31209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:09.929834 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.195:46837 (local address 127.26.206.254:39129)
0808 14:50:09.930060 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:09.930067 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:09.931272 (+ 1205us) server_negotiation.cc:407] Connection header received
0808 14:50:09.933389 (+ 2117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:09.933395 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:09.933503 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:09.933603 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:09.935510 (+ 1907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:09.936446 (+ 936us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:09.938034 (+ 1588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:09.938457 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:09.938557 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:09.941961 (+ 3404us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:50:09.941966 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:50:09.941969 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:50:09.942002 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:50:09.944465 (+ 2463us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:09.945132 (+ 667us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:09.945137 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:09.945139 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:09.945292 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:09.945793 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:09.945798 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:09.945801 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:09.946178 (+ 377us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:50:09.946344 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:09.947172 (+ 828us) server_negotiation.cc:299] Negotiation successful
0808 14:50:09.947331 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260808 14:50:09.948565 31508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:09.930246 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:39129 (local address 127.26.206.195:46837)
0808 14:50:09.931075 (+ 829us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:09.931126 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0808 14:50:09.933075 (+ 1949us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:50:09.933892 (+ 817us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:50:09.933904 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:50:09.934718 (+ 814us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:50:09.935339 (+ 621us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:09.935356 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:09.936594 (+ 1238us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:09.936598 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:09.937892 (+ 1294us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:09.937904 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:09.938638 (+ 734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:09.938643 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:09.938836 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:09.939434 (+ 598us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:50:09.939456 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:50:09.941779 (+ 2323us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:50:09.944598 (+ 2819us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:50:09.944604 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:50:09.944615 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:50:09.945010 (+ 395us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:50:09.945402 (+ 392us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:50:09.945406 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:50:09.945408 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:50:09.945653 (+ 245us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:50:09.946331 (+ 678us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:50:09.946337 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:50:09.946762 (+ 425us) client_negotiation.cc:769] Sending connection context
0808 14:50:09.947060 (+ 298us) client_negotiation.cc:240] Negotiation successful
0808 14:50:09.947436 (+ 376us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":556,"thread_start_us":359,"threads_started":1}
I20260808 14:50:09.949928 31506 heartbeater.cc:347] Connected to a master server at 127.26.206.254:39129
I20260808 14:50:09.950186 31506 heartbeater.cc:464] Registering TS with master...
I20260808 14:50:09.950861 31506 heartbeater.cc:511] Master 127.26.206.254:39129 requested a full tablet report, sending...
I20260808 14:50:09.952224 30991 ts_manager.cc:194] Registered new tserver with Master: d7bf9c1e00f442d29a6ac99b6f14914e (127.26.206.195:41375)
I20260808 14:50:09.953092 30991 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.206.195@KRBTEST.COM'} at 127.26.206.195:46837
I20260808 14:50:09.958120 31207 heartbeater.cc:503] Master 127.26.206.254:39129 was elected leader, sending a full tablet report...
I20260808 14:50:09.959074 27451 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 08 14:50:09 dist-test-slave-6k22 krb5kdc[30934](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200609, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 08 14:50:10 dist-test-slave-6k22 krb5kdc[30934](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200609, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.26.206.254@KRBTEST.COM
I20260808 14:50:10.012791 31209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:09.999094 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57912 (local address 127.26.206.254:39129)
0808 14:50:09.999269 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:09.999274 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:09.999802 (+ 528us) server_negotiation.cc:407] Connection header received
0808 14:50:09.999982 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:09.999986 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:10.000051 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:10.000135 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:10.001522 (+ 1387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:10.002243 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:10.003415 (+ 1172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:10.003885 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:10.003983 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:10.007795 (+ 3812us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:50:10.007799 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:50:10.007803 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:50:10.007835 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:50:10.010433 (+ 2598us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:10.010978 (+ 545us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:10.010981 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:10.010984 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:10.011119 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:10.011474 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:10.011477 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:10.011479 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:10.011853 (+ 374us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:50:10.012042 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:10.012280 (+ 238us) server_negotiation.cc:299] Negotiation successful
0808 14:50:10.012440 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
W20260808 14:50:10.013329 30991 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:57912
I20260808 14:50:10.015031 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 31061
Aug 08 14:50:10 dist-test-slave-6k22 krb5kdc[30934](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200609, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.26.206.193@KRBTEST.COM
I20260808 14:50:10.030581 31518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:10.016079 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41662 (local address 127.26.206.193:38611)
0808 14:50:10.016722 (+ 643us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:10.016729 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:10.016755 (+ 26us) server_negotiation.cc:407] Connection header received
0808 14:50:10.016811 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:10.016817 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:10.017029 (+ 212us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:10.017154 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:10.018274 (+ 1120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:10.019277 (+ 1003us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:10.020537 (+ 1260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:10.021088 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:10.021185 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:10.024966 (+ 3781us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:50:10.024976 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:50:10.024989 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:50:10.025021 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:50:10.028088 (+ 3067us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:10.028640 (+ 552us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:10.028646 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:10.028649 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:10.028766 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:10.029057 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:10.029060 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:10.029062 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:10.029379 (+ 317us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:50:10.029682 (+ 303us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:10.029982 (+ 300us) server_negotiation.cc:299] Negotiation successful
0808 14:50:10.030240 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":494,"thread_start_us":333,"threads_started":1}
W20260808 14:50:10.031872 31202 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:41662
W20260808 14:50:10.032950 27451 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 31061: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 14:50:10.033126 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 31061
I20260808 14:50:10.053550 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 31213
Aug 08 14:50:10 dist-test-slave-6k22 krb5kdc[30934](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200609, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.26.206.194@KRBTEST.COM
I20260808 14:50:10.070374 31519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:10.054464 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38042 (local address 127.26.206.194:39569)
0808 14:50:10.055035 (+ 571us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:10.055042 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:10.055070 (+ 28us) server_negotiation.cc:407] Connection header received
0808 14:50:10.055130 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:10.055137 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:10.055360 (+ 223us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:10.055489 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:10.056814 (+ 1325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:10.057998 (+ 1184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:10.059240 (+ 1242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:10.059953 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:10.060081 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:10.064242 (+ 4161us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:50:10.064254 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:50:10.064268 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:50:10.064304 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:50:10.067484 (+ 3180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:10.068201 (+ 717us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:10.068208 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:10.068210 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:10.068342 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:10.068820 (+ 478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:10.068824 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:10.068826 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:10.069193 (+ 367us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:50:10.069455 (+ 262us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:10.069772 (+ 317us) server_negotiation.cc:299] Negotiation successful
0808 14:50:10.070038 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":418,"thread_start_us":304,"threads_started":1}
W20260808 14:50:10.071856 31353 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:38042
W20260808 14:50:10.072968 27451 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 31213: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 14:50:10.073161 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 31213
I20260808 14:50:10.092435 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 31364
Aug 08 14:50:10 dist-test-slave-6k22 krb5kdc[30934](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200609, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.26.206.195@KRBTEST.COM
I20260808 14:50:10.108762 31520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:10.093429 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57238 (local address 127.26.206.195:41375)
0808 14:50:10.094067 (+ 638us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:10.094074 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:10.094103 (+ 29us) server_negotiation.cc:407] Connection header received
0808 14:50:10.094159 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:10.094165 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:10.094374 (+ 209us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:10.094545 (+ 171us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:10.095999 (+ 1454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:10.097024 (+ 1025us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:10.098263 (+ 1239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:10.098829 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:10.098963 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:10.103417 (+ 4454us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:50:10.103427 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:50:10.103440 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:50:10.103470 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:50:10.106042 (+ 2572us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:10.106664 (+ 622us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:10.106671 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:10.106674 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:10.106822 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:10.107176 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:10.107182 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:10.107185 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:10.107508 (+ 323us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:50:10.107882 (+ 374us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:10.108141 (+ 259us) server_negotiation.cc:299] Negotiation successful
0808 14:50:10.108409 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":504,"thread_start_us":359,"threads_started":1}
W20260808 14:50:10.110008 31501 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:57238
W20260808 14:50:10.111053 27451 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 31364: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 14:50:10.111183 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 31364
I20260808 14:50:10.130234 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 30951
I20260808 14:50:10.131487 31026 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:50:10.240645 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 30951
2026-08-08T14:50:10Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (3738 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200577490656-27451-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:50:10 dist-test-slave-6k22 krb5kdc[31524](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:50:10 dist-test-slave-6k22 krb5kdc[31524](info): set up 2 sockets
Aug 08 14:50:10 dist-test-slave-6k22 krb5kdc[31524](info): commencing operation
krb5kdc: starting...
W20260808 14:50:11.394143 27451 mini_kdc.cc:121] Time spent starting KDC: real 1.107s user 0.002s sys 0.022s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200577490656-27451-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200577490656-27451-0/krb5kdc/test-user.keytab.
Aug 08 14:50:11 dist-test-slave-6k22 krb5kdc[31524](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200611, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:50:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:50:11Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.206.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.206.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.206.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.254.keytab.
Entry for principal kudu/127.26.206.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.254.keytab.
I20260808 14:50:11.606946 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200577490656-27451-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200577490656-27451-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200577490656-27451-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.206.254:38409
--webserver_interface=127.26.206.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.254.keytab
--principal=kudu/127.26.206.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.206.212:46591
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.206.254:38409
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:50:11.948772 31538 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:50:11.949046 31538 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:50:11.949155 31538 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:50:11.956190 31538 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:50:11.956295 31538 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:50:11.956391 31538 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:50:11.956480 31538 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:50:11.956552 31538 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:50:11.966086 31538 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:46591
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200577490656-27451-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200577490656-27451-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.206.254:38409
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.254.keytab
--principal=kudu/127.26.206.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.206.254:38409
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.206.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200577490656-27451-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:50:11.967437 31538 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:50:11.968763 31538 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:50:11.980810 31544 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:50:11.980754 31548 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:50:11.980716 31546 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:50:11.981729 31538 server_base.cc:1034] running on GCE node
I20260808 14:50:11.982522 31538 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:50:11.983978 31538 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:50:11.985198 31538 hybrid_clock.cc:648] HybridClock initialized: now 1786200611985165 us; error 43 us; skew 500 ppm
I20260808 14:50:11.985548 31538 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:50:11 dist-test-slave-6k22 krb5kdc[31524](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200611, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:50:11.988660 31538 init.cc:377] Logged in from keytab as kudu/127.26.206.254@KRBTEST.COM (short username kudu)
I20260808 14:50:11.990126 31538 webserver.cc:460] Webserver started at http://127.26.206.254:41037/ using document root <none> and password file <none>
I20260808 14:50:11.990797 31538 fs_manager.cc:359] Metadata directory not provided
I20260808 14:50:11.990935 31538 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:50:11.991243 31538 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:50:11.994199 31538 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200577490656-27451-0/minicluster-data/master-0/data/instance:
uuid: "4fe352a5c4e8438fa6099a98d378259c"
format_stamp: "Formatted at 2026-08-08 14:50:11 on dist-test-slave-6k22"
server_key: "712ee3f3e6277e1859a974a03f0d69cc"
server_key_iv: "3884b16a5d714573aac80f530df9ffaf"
server_key_version: "encryptionkey@0"
I20260808 14:50:11.995004 31538 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200577490656-27451-0/minicluster-data/master-0/wal/instance:
uuid: "4fe352a5c4e8438fa6099a98d378259c"
format_stamp: "Formatted at 2026-08-08 14:50:11 on dist-test-slave-6k22"
server_key: "712ee3f3e6277e1859a974a03f0d69cc"
server_key_iv: "3884b16a5d714573aac80f530df9ffaf"
server_key_version: "encryptionkey@0"
I20260808 14:50:11.999972 31538 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260808 14:50:12.003186 31558 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:50:12.004510 31538 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 14:50:12.004690 31538 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200577490656-27451-0/minicluster-data/master-0/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200577490656-27451-0/minicluster-data/master-0/wal
uuid: "4fe352a5c4e8438fa6099a98d378259c"
format_stamp: "Formatted at 2026-08-08 14:50:11 on dist-test-slave-6k22"
server_key: "712ee3f3e6277e1859a974a03f0d69cc"
server_key_iv: "3884b16a5d714573aac80f530df9ffaf"
server_key_version: "encryptionkey@0"
I20260808 14:50:12.004891 31538 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200577490656-27451-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200577490656-27451-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200577490656-27451-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:50:12.028219 31538 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:50:12.032110 31538 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:50:12.032425 31538 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:50:12.050873 31538 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.254:38409
I20260808 14:50:12.050906 31614 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.254:38409 every 8 connection(s)
I20260808 14:50:12.052238 31538 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
I20260808 14:50:12.056030 31615 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:50:12.056344 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 31538
I20260808 14:50:12.056565 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200577490656-27451-0/minicluster-data/master-0/wal/instance
I20260808 14:50:12.057458 27451 external_mini_cluster.cc:1428] Setting key 5b04c9d9cc0d543273835e8a152743e6
I20260808 14:50:12.070046 31615 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4fe352a5c4e8438fa6099a98d378259c: Bootstrap starting.
Aug 08 14:50:12 dist-test-slave-6k22 krb5kdc[31524](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200611, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.206.254@KRBTEST.COM
I20260808 14:50:12.073948 31615 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4fe352a5c4e8438fa6099a98d378259c: Neither blocks nor log segments found. Creating new log.
I20260808 14:50:12.074995 31615 log.cc:824] T 00000000000000000000000000000000 P 4fe352a5c4e8438fa6099a98d378259c: Log is configured to *not* fsync() on all Append() calls
I20260808 14:50:12.078038 31615 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4fe352a5c4e8438fa6099a98d378259c: No bootstrap required, opened a new log
I20260808 14:50:12.081101 31618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:12.059657 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35136 (local address 127.26.206.254:38409)
0808 14:50:12.060417 (+ 760us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:12.060428 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:12.060467 (+ 39us) server_negotiation.cc:407] Connection header received
0808 14:50:12.062410 (+ 1943us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:12.062431 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:12.062839 (+ 408us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:12.063147 (+ 308us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:12.064954 (+ 1807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:12.066140 (+ 1186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:12.067994 (+ 1854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:12.068637 (+ 643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:12.068773 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:12.073631 (+ 4858us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:50:12.073637 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:50:12.073650 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:50:12.073686 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:50:12.077047 (+ 3361us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:12.077872 (+ 825us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:12.077878 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:12.077883 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:12.078047 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:12.078460 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:12.078463 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:12.078465 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:12.078961 (+ 496us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:50:12.079281 (+ 320us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:12.079779 (+ 498us) server_negotiation.cc:299] Negotiation successful
0808 14:50:12.080167 (+ 388us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":555,"thread_start_us":353,"threads_started":1}
I20260808 14:50:12.085973 31615 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4fe352a5c4e8438fa6099a98d378259c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4fe352a5c4e8438fa6099a98d378259c" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 38409 } }
I20260808 14:50:12.086369 31615 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4fe352a5c4e8438fa6099a98d378259c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:50:12.086472 31615 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4fe352a5c4e8438fa6099a98d378259c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4fe352a5c4e8438fa6099a98d378259c, State: Initialized, Role: FOLLOWER
I20260808 14:50:12.086977 31615 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4fe352a5c4e8438fa6099a98d378259c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4fe352a5c4e8438fa6099a98d378259c" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 38409 } }
I20260808 14:50:12.087214 31615 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4fe352a5c4e8438fa6099a98d378259c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:50:12.087324 31615 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4fe352a5c4e8438fa6099a98d378259c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:50:12.087442 31615 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4fe352a5c4e8438fa6099a98d378259c [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:50:12.089754 31615 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4fe352a5c4e8438fa6099a98d378259c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4fe352a5c4e8438fa6099a98d378259c" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 38409 } }
I20260808 14:50:12.090158 31615 leader_election.cc:302] T 00000000000000000000000000000000 P 4fe352a5c4e8438fa6099a98d378259c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4fe352a5c4e8438fa6099a98d378259c; no voters:
I20260808 14:50:12.090669 31615 leader_election.cc:288] T 00000000000000000000000000000000 P 4fe352a5c4e8438fa6099a98d378259c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:50:12.090791 31620 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4fe352a5c4e8438fa6099a98d378259c [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:50:12.091459 31620 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4fe352a5c4e8438fa6099a98d378259c [term 1 LEADER]: Becoming Leader. State: Replica: 4fe352a5c4e8438fa6099a98d378259c, State: Running, Role: LEADER
I20260808 14:50:12.092072 31620 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4fe352a5c4e8438fa6099a98d378259c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4fe352a5c4e8438fa6099a98d378259c" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 38409 } }
I20260808 14:50:12.092653 31615 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4fe352a5c4e8438fa6099a98d378259c [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:50:12.094712 31621 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4fe352a5c4e8438fa6099a98d378259c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4fe352a5c4e8438fa6099a98d378259c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4fe352a5c4e8438fa6099a98d378259c" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 38409 } } }
I20260808 14:50:12.095011 31621 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4fe352a5c4e8438fa6099a98d378259c [sys.catalog]: This master's current role is: LEADER
I20260808 14:50:12.095903 31627 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:50:12.095752 31622 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4fe352a5c4e8438fa6099a98d378259c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4fe352a5c4e8438fa6099a98d378259c. Latest consensus state: current_term: 1 leader_uuid: "4fe352a5c4e8438fa6099a98d378259c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4fe352a5c4e8438fa6099a98d378259c" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 38409 } } }
I20260808 14:50:12.096086 31622 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4fe352a5c4e8438fa6099a98d378259c [sys.catalog]: This master's current role is: LEADER
I20260808 14:50:12.101259 31627 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:50:12.113065 31627 catalog_manager.cc:1347] Generated new cluster ID: 2f755082e3a34e5d858cfc31808b6f53
I20260808 14:50:12.113171 31627 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:50:12.129156 31627 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:50:12.130400 31627 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:50:12.147892 31627 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4fe352a5c4e8438fa6099a98d378259c: Generated new TSK 0
I20260808 14:50:12.148648 31627 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.206.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.206.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.206.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.193.keytab.
Entry for principal kudu/127.26.206.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.193.keytab.
I20260808 14:50:12.205950 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200577490656-27451-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200577490656-27451-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200577490656-27451-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200577490656-27451-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.206.193:0
--local_ip_for_outbound_sockets=127.26.206.193
--webserver_interface=127.26.206.193
--webserver_port=0
--tserver_master_addrs=127.26.206.254:38409
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.193.keytab
--principal=kudu/127.26.206.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.206.212:46591
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:50:12.538025 31644 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:50:12.538297 31644 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:50:12.538471 31644 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:50:12.545655 31644 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:50:12.545789 31644 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:50:12.545966 31644 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.206.193
I20260808 14:50:12.555253 31644 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:46591
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200577490656-27451-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200577490656-27451-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.193.keytab
--principal=kudu/127.26.206.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.206.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200577490656-27451-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.206.193
--webserver_port=0
--tserver_master_addrs=127.26.206.254:38409
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.206.193
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200577490656-27451-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:50:12.556483 31644 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:50:12.557821 31644 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:50:12.570540 31651 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:50:12.570590 31652 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:50:12.570616 31654 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:50:12.571676 31644 server_base.cc:1034] running on GCE node
I20260808 14:50:12.572255 31644 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:50:12.573129 31644 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:50:12.574362 31644 hybrid_clock.cc:648] HybridClock initialized: now 1786200612574313 us; error 40 us; skew 500 ppm
I20260808 14:50:12.574661 31644 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:50:12 dist-test-slave-6k22 krb5kdc[31524](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200612, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:50:12.577741 31644 init.cc:377] Logged in from keytab as kudu/127.26.206.193@KRBTEST.COM (short username kudu)
I20260808 14:50:12.579175 31644 webserver.cc:460] Webserver started at http://127.26.206.193:41357/ using document root <none> and password file <none>
I20260808 14:50:12.579910 31644 fs_manager.cc:359] Metadata directory not provided
I20260808 14:50:12.580046 31644 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:50:12.580354 31644 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:50:12.583257 31644 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200577490656-27451-0/minicluster-data/ts-0/data/instance:
uuid: "472ff5dac72e419d9e944f68cc7414f3"
format_stamp: "Formatted at 2026-08-08 14:50:12 on dist-test-slave-6k22"
server_key: "848b9d12e15c45cb0401d6dfc933260a"
server_key_iv: "110c7ab7f3d5ef3d01902efcf1171a7e"
server_key_version: "encryptionkey@0"
I20260808 14:50:12.584107 31644 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200577490656-27451-0/minicluster-data/ts-0/wal/instance:
uuid: "472ff5dac72e419d9e944f68cc7414f3"
format_stamp: "Formatted at 2026-08-08 14:50:12 on dist-test-slave-6k22"
server_key: "848b9d12e15c45cb0401d6dfc933260a"
server_key_iv: "110c7ab7f3d5ef3d01902efcf1171a7e"
server_key_version: "encryptionkey@0"
I20260808 14:50:12.589299 31644 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260808 14:50:12.592716 31662 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:50:12.594182 31644 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260808 14:50:12.594347 31644 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200577490656-27451-0/minicluster-data/ts-0/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200577490656-27451-0/minicluster-data/ts-0/wal
uuid: "472ff5dac72e419d9e944f68cc7414f3"
format_stamp: "Formatted at 2026-08-08 14:50:12 on dist-test-slave-6k22"
server_key: "848b9d12e15c45cb0401d6dfc933260a"
server_key_iv: "110c7ab7f3d5ef3d01902efcf1171a7e"
server_key_version: "encryptionkey@0"
I20260808 14:50:12.594535 31644 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200577490656-27451-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200577490656-27451-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200577490656-27451-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:50:12.620180 31644 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:50:12.624176 31644 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:50:12.624460 31644 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:50:12.625454 31644 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:50:12.626801 31644 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:50:12.626907 31644 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:50:12.627064 31644 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:50:12.627135 31644 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:50:12.660843 31644 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.193:44825
I20260808 14:50:12.660889 31786 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.193:44825 every 8 connection(s)
I20260808 14:50:12.662159 31644 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200577490656-27451-0/minicluster-data/ts-0/data/info.pb
I20260808 14:50:12.669780 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 31644
I20260808 14:50:12.669988 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200577490656-27451-0/minicluster-data/ts-0/wal/instance
I20260808 14:50:12.670657 27451 external_mini_cluster.cc:1428] Setting key aea1b738cb766fe12e2bfcf5e3190c20
Aug 08 14:50:12 dist-test-slave-6k22 krb5kdc[31524](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200612, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.193@KRBTEST.COM for kudu/127.26.206.254@KRBTEST.COM
I20260808 14:50:12.684084 31790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:12.664706 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.193:39593 (local address 127.26.206.254:38409)
0808 14:50:12.665201 (+ 495us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:12.665206 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:12.666003 (+ 797us) server_negotiation.cc:407] Connection header received
0808 14:50:12.667934 (+ 1931us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:12.667940 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:12.668036 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:12.668162 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:12.669563 (+ 1401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:12.670434 (+ 871us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:12.672335 (+ 1901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:12.673044 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:12.673229 (+ 185us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:12.676895 (+ 3666us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:50:12.676905 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:50:12.676913 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:50:12.676962 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:50:12.680709 (+ 3747us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:12.681405 (+ 696us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:12.681413 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:12.681420 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:12.681590 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:12.682218 (+ 628us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:12.682223 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:12.682225 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:12.682530 (+ 305us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:50:12.682674 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:12.683552 (+ 878us) server_negotiation.cc:299] Negotiation successful
0808 14:50:12.683816 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":383,"thread_start_us":284,"threads_started":1}
I20260808 14:50:12.685477 31791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:12.665154 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:38409 (local address 127.26.206.193:39593)
0808 14:50:12.665841 (+ 687us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:12.665879 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 14:50:12.667668 (+ 1789us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:50:12.668390 (+ 722us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:50:12.668398 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:50:12.668879 (+ 481us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:50:12.669396 (+ 517us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:12.669411 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:12.670588 (+ 1177us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:12.670592 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:12.672152 (+ 1560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:12.672172 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:12.673297 (+ 1125us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:12.673303 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:12.673528 (+ 225us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:12.674236 (+ 708us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:50:12.674257 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:50:12.676657 (+ 2400us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:50:12.680851 (+ 4194us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:50:12.680857 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:50:12.680868 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:50:12.681268 (+ 400us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:50:12.681747 (+ 479us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:50:12.681753 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:50:12.681758 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:50:12.682043 (+ 285us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:50:12.682665 (+ 622us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:50:12.682676 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:50:12.683115 (+ 439us) client_negotiation.cc:769] Sending connection context
0808 14:50:12.683407 (+ 292us) client_negotiation.cc:240] Negotiation successful
0808 14:50:12.684008 (+ 601us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":443,"thread_start_us":254,"threads_started":1}
I20260808 14:50:12.687234 31788 heartbeater.cc:347] Connected to a master server at 127.26.206.254:38409
I20260808 14:50:12.687598 31788 heartbeater.cc:464] Registering TS with master...
I20260808 14:50:12.688405 31788 heartbeater.cc:511] Master 127.26.206.254:38409 requested a full tablet report, sending...
I20260808 14:50:12.690657 31576 ts_manager.cc:194] Registered new tserver with Master: 472ff5dac72e419d9e944f68cc7414f3 (127.26.206.193:44825)
I20260808 14:50:12.692368 31576 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.206.193@KRBTEST.COM'} at 127.26.206.193:39593
WARNING: no policy specified for kudu/127.26.206.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.206.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.206.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.194.keytab.
Entry for principal kudu/127.26.206.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.194.keytab.
I20260808 14:50:12.722393 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200577490656-27451-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200577490656-27451-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200577490656-27451-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200577490656-27451-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.206.194:0
--local_ip_for_outbound_sockets=127.26.206.194
--webserver_interface=127.26.206.194
--webserver_port=0
--tserver_master_addrs=127.26.206.254:38409
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.194.keytab
--principal=kudu/127.26.206.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.206.212:46591
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:50:13.041208 31794 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:50:13.041531 31794 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:50:13.041697 31794 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:50:13.049217 31794 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:50:13.049482 31794 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:50:13.049674 31794 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.206.194
I20260808 14:50:13.060043 31794 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:46591
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200577490656-27451-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200577490656-27451-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.194.keytab
--principal=kudu/127.26.206.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.206.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200577490656-27451-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.206.194
--webserver_port=0
--tserver_master_addrs=127.26.206.254:38409
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.206.194
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200577490656-27451-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:50:13.061292 31794 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:50:13.062597 31794 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:50:13.075166 31799 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:50:13.075116 31800 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:50:13.075136 31802 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:50:13.076129 31794 server_base.cc:1034] running on GCE node
I20260808 14:50:13.076721 31794 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:50:13.077634 31794 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:50:13.078855 31794 hybrid_clock.cc:648] HybridClock initialized: now 1786200613078817 us; error 45 us; skew 500 ppm
I20260808 14:50:13.079147 31794 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:50:13 dist-test-slave-6k22 krb5kdc[31524](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200613, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:50:13.082216 31794 init.cc:377] Logged in from keytab as kudu/127.26.206.194@KRBTEST.COM (short username kudu)
I20260808 14:50:13.083550 31794 webserver.cc:460] Webserver started at http://127.26.206.194:46129/ using document root <none> and password file <none>
I20260808 14:50:13.084240 31794 fs_manager.cc:359] Metadata directory not provided
I20260808 14:50:13.084340 31794 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:50:13.084595 31794 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:50:13.087323 31794 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200577490656-27451-0/minicluster-data/ts-1/data/instance:
uuid: "9934e18a4f8a417fb2d91c998715d23c"
format_stamp: "Formatted at 2026-08-08 14:50:13 on dist-test-slave-6k22"
server_key: "f407cfcf1c706d379317c36437ab8a33"
server_key_iv: "1c1f20ab48dfa6e8c9b7be7154f35cfe"
server_key_version: "encryptionkey@0"
I20260808 14:50:13.088104 31794 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200577490656-27451-0/minicluster-data/ts-1/wal/instance:
uuid: "9934e18a4f8a417fb2d91c998715d23c"
format_stamp: "Formatted at 2026-08-08 14:50:13 on dist-test-slave-6k22"
server_key: "f407cfcf1c706d379317c36437ab8a33"
server_key_iv: "1c1f20ab48dfa6e8c9b7be7154f35cfe"
server_key_version: "encryptionkey@0"
I20260808 14:50:13.093012 31794 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.004s
I20260808 14:50:13.096312 31809 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:50:13.097525 31794 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 14:50:13.097747 31794 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200577490656-27451-0/minicluster-data/ts-1/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200577490656-27451-0/minicluster-data/ts-1/wal
uuid: "9934e18a4f8a417fb2d91c998715d23c"
format_stamp: "Formatted at 2026-08-08 14:50:13 on dist-test-slave-6k22"
server_key: "f407cfcf1c706d379317c36437ab8a33"
server_key_iv: "1c1f20ab48dfa6e8c9b7be7154f35cfe"
server_key_version: "encryptionkey@0"
I20260808 14:50:13.097946 31794 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200577490656-27451-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200577490656-27451-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200577490656-27451-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:50:13.116928 31794 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:50:13.120784 31794 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:50:13.121052 31794 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:50:13.122020 31794 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:50:13.123319 31794 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:50:13.123392 31794 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:50:13.123564 31794 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:50:13.123628 31794 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.001s sys 0.000s
I20260808 14:50:13.156155 31794 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.194:38275
I20260808 14:50:13.156199 31933 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.194:38275 every 8 connection(s)
I20260808 14:50:13.157377 31794 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200577490656-27451-0/minicluster-data/ts-1/data/info.pb
I20260808 14:50:13.162343 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 31794
I20260808 14:50:13.162508 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200577490656-27451-0/minicluster-data/ts-1/wal/instance
I20260808 14:50:13.162932 27451 external_mini_cluster.cc:1428] Setting key de2de5e5365a471db93de94e1d81a019
Aug 08 14:50:13 dist-test-slave-6k22 krb5kdc[31524](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200613, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.194@KRBTEST.COM for kudu/127.26.206.254@KRBTEST.COM
I20260808 14:50:13.178776 31790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:13.159974 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.194:47849 (local address 127.26.206.254:38409)
0808 14:50:13.160176 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:13.160180 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:13.161238 (+ 1058us) server_negotiation.cc:407] Connection header received
0808 14:50:13.163061 (+ 1823us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:13.163066 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:13.163156 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:13.163258 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:13.164900 (+ 1642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:13.165648 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:13.168167 (+ 2519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:13.168604 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:13.168714 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:13.172765 (+ 4051us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:50:13.172774 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:50:13.172782 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:50:13.172828 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:50:13.175648 (+ 2820us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:13.176526 (+ 878us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:13.176529 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:13.176531 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:13.176650 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:13.177172 (+ 522us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:13.177175 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:13.177177 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:13.177428 (+ 251us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:50:13.177550 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:13.178357 (+ 807us) server_negotiation.cc:299] Negotiation successful
0808 14:50:13.178534 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260808 14:50:13.180300 31936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:13.160424 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:38409 (local address 127.26.206.194:47849)
0808 14:50:13.161069 (+ 645us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:13.161106 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0808 14:50:13.162810 (+ 1704us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:50:13.163492 (+ 682us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:50:13.163499 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:50:13.164133 (+ 634us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:50:13.164748 (+ 615us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:13.164767 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:13.165825 (+ 1058us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:13.165833 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:13.168025 (+ 2192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:13.168043 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:13.168849 (+ 806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:13.168858 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:13.169181 (+ 323us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:13.169905 (+ 724us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:50:13.169947 (+ 42us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:50:13.172543 (+ 2596us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:50:13.175791 (+ 3248us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:50:13.175802 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:50:13.175819 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:50:13.176418 (+ 599us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:50:13.176749 (+ 331us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:50:13.176756 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:50:13.176763 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:50:13.177046 (+ 283us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:50:13.177550 (+ 504us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:50:13.177560 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:50:13.177988 (+ 428us) client_negotiation.cc:769] Sending connection context
0808 14:50:13.178274 (+ 286us) client_negotiation.cc:240] Negotiation successful
0808 14:50:13.178838 (+ 564us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":442,"thread_start_us":252,"threads_started":1}
I20260808 14:50:13.181704 31934 heartbeater.cc:347] Connected to a master server at 127.26.206.254:38409
I20260808 14:50:13.182029 31934 heartbeater.cc:464] Registering TS with master...
I20260808 14:50:13.182871 31934 heartbeater.cc:511] Master 127.26.206.254:38409 requested a full tablet report, sending...
I20260808 14:50:13.184446 31576 ts_manager.cc:194] Registered new tserver with Master: 9934e18a4f8a417fb2d91c998715d23c (127.26.206.194:38275)
I20260808 14:50:13.185251 31576 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.206.194@KRBTEST.COM'} at 127.26.206.194:47849
WARNING: no policy specified for kudu/127.26.206.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.206.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.206.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.195.keytab.
Entry for principal kudu/127.26.206.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.195.keytab.
I20260808 14:50:13.214532 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200577490656-27451-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200577490656-27451-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200577490656-27451-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200577490656-27451-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.206.195:0
--local_ip_for_outbound_sockets=127.26.206.195
--webserver_interface=127.26.206.195
--webserver_port=0
--tserver_master_addrs=127.26.206.254:38409
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.195.keytab
--principal=kudu/127.26.206.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.206.212:46591
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:50:13.545872 31940 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:50:13.546224 31940 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:50:13.546415 31940 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:50:13.553695 31940 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:50:13.553872 31940 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:50:13.554071 31940 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.206.195
I20260808 14:50:13.563983 31940 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:46591
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200577490656-27451-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200577490656-27451-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.195.keytab
--principal=kudu/127.26.206.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.206.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200577490656-27451-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.206.195
--webserver_port=0
--tserver_master_addrs=127.26.206.254:38409
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.206.195
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200577490656-27451-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:50:13.565294 31940 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:50:13.566700 31940 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:50:13.580299 31946 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:50:13.580523 31947 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:50:13.580330 31949 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:50:13.581559 31940 server_base.cc:1034] running on GCE node
I20260808 14:50:13.582122 31940 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:50:13.583015 31940 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:50:13.584205 31940 hybrid_clock.cc:648] HybridClock initialized: now 1786200613584162 us; error 31 us; skew 500 ppm
I20260808 14:50:13.584481 31940 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:50:13 dist-test-slave-6k22 krb5kdc[31524](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200613, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:50:13.587670 31940 init.cc:377] Logged in from keytab as kudu/127.26.206.195@KRBTEST.COM (short username kudu)
I20260808 14:50:13.589119 31940 webserver.cc:460] Webserver started at http://127.26.206.195:34379/ using document root <none> and password file <none>
I20260808 14:50:13.589819 31940 fs_manager.cc:359] Metadata directory not provided
I20260808 14:50:13.589959 31940 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:50:13.590271 31940 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:50:13.593307 31940 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200577490656-27451-0/minicluster-data/ts-2/data/instance:
uuid: "bb4cf8a446f24c92a3b73227f42ab2c4"
format_stamp: "Formatted at 2026-08-08 14:50:13 on dist-test-slave-6k22"
server_key: "3f95f24b07585f55dcec8b8bf292314b"
server_key_iv: "2f2ee45df83e9759e150665d6e1d503a"
server_key_version: "encryptionkey@0"
I20260808 14:50:13.594153 31940 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200577490656-27451-0/minicluster-data/ts-2/wal/instance:
uuid: "bb4cf8a446f24c92a3b73227f42ab2c4"
format_stamp: "Formatted at 2026-08-08 14:50:13 on dist-test-slave-6k22"
server_key: "3f95f24b07585f55dcec8b8bf292314b"
server_key_iv: "2f2ee45df83e9759e150665d6e1d503a"
server_key_version: "encryptionkey@0"
I20260808 14:50:13.599495 31940 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260808 14:50:13.603163 31956 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:50:13.604533 31940 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 14:50:13.604698 31940 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200577490656-27451-0/minicluster-data/ts-2/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200577490656-27451-0/minicluster-data/ts-2/wal
uuid: "bb4cf8a446f24c92a3b73227f42ab2c4"
format_stamp: "Formatted at 2026-08-08 14:50:13 on dist-test-slave-6k22"
server_key: "3f95f24b07585f55dcec8b8bf292314b"
server_key_iv: "2f2ee45df83e9759e150665d6e1d503a"
server_key_version: "encryptionkey@0"
I20260808 14:50:13.604893 31940 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200577490656-27451-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200577490656-27451-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200577490656-27451-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:50:13.624459 31940 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:50:13.628494 31940 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:50:13.628782 31940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:50:13.629724 31940 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:50:13.631070 31940 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:50:13.631145 31940 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:50:13.631309 31940 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:50:13.631361 31940 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:50:13.664656 31940 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.195:35631
I20260808 14:50:13.664701 32084 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.195:35631 every 8 connection(s)
I20260808 14:50:13.665911 31940 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200577490656-27451-0/minicluster-data/ts-2/data/info.pb
I20260808 14:50:13.673252 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 31940
I20260808 14:50:13.673434 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200577490656-27451-0/minicluster-data/ts-2/wal/instance
I20260808 14:50:13.673893 27451 external_mini_cluster.cc:1428] Setting key 15bfd8612d72757ff6c6a1a1d8b81b61
Aug 08 14:50:13 dist-test-slave-6k22 krb5kdc[31524](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200613, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.195@KRBTEST.COM for kudu/127.26.206.254@KRBTEST.COM
I20260808 14:50:13.685263 31790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:13.668331 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.195:57933 (local address 127.26.206.254:38409)
0808 14:50:13.668508 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:13.668512 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:13.669532 (+ 1020us) server_negotiation.cc:407] Connection header received
0808 14:50:13.671481 (+ 1949us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:13.671487 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:13.671617 (+ 130us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:13.671731 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:13.673245 (+ 1514us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:13.674175 (+ 930us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:13.676251 (+ 2076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:13.676777 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:13.676915 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:13.680116 (+ 3201us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:50:13.680121 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:50:13.680124 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:50:13.680154 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:50:13.682731 (+ 2577us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:13.683356 (+ 625us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:13.683360 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:13.683362 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:13.683483 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:13.683896 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:13.683899 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:13.683901 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:13.684173 (+ 272us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:50:13.684284 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:13.684873 (+ 589us) server_negotiation.cc:299] Negotiation successful
0808 14:50:13.685028 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260808 14:50:13.686097 32087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:13.668685 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:38409 (local address 127.26.206.195:57933)
0808 14:50:13.669377 (+ 692us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:13.669420 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 14:50:13.671170 (+ 1750us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:50:13.671959 (+ 789us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:50:13.671967 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:50:13.672473 (+ 506us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:50:13.673085 (+ 612us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:13.673104 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:13.674350 (+ 1246us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:13.674358 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:13.676122 (+ 1764us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:13.676137 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:13.676981 (+ 844us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:13.676987 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:13.677174 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:13.677759 (+ 585us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:50:13.677788 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:50:13.679928 (+ 2140us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:50:13.682861 (+ 2933us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:50:13.682867 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:50:13.682877 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:50:13.683257 (+ 380us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:50:13.683624 (+ 367us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:50:13.683627 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:50:13.683630 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:50:13.683804 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:50:13.684275 (+ 471us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:50:13.684283 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:50:13.684564 (+ 281us) client_negotiation.cc:769] Sending connection context
0808 14:50:13.684771 (+ 207us) client_negotiation.cc:240] Negotiation successful
0808 14:50:13.685122 (+ 351us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":469,"thread_start_us":273,"threads_started":1}
I20260808 14:50:13.687376 32085 heartbeater.cc:347] Connected to a master server at 127.26.206.254:38409
I20260808 14:50:13.687712 32085 heartbeater.cc:464] Registering TS with master...
I20260808 14:50:13.688500 32085 heartbeater.cc:511] Master 127.26.206.254:38409 requested a full tablet report, sending...
I20260808 14:50:13.689823 31576 ts_manager.cc:194] Registered new tserver with Master: bb4cf8a446f24c92a3b73227f42ab2c4 (127.26.206.195:35631)
I20260808 14:50:13.690586 31576 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.206.195@KRBTEST.COM'} at 127.26.206.195:57933
I20260808 14:50:13.695498 31788 heartbeater.cc:503] Master 127.26.206.254:38409 was elected leader, sending a full tablet report...
I20260808 14:50:13.700870 27451 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 08 14:50:13 dist-test-slave-6k22 krb5kdc[31524](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200613, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 14:50:13 dist-test-slave-6k22 krb5kdc[31524](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200613, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.206.193@KRBTEST.COM
I20260808 14:50:13.756146 32094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:13.740999 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52054 (local address 127.26.206.193:44825)
0808 14:50:13.741745 (+ 746us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:13.741752 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:13.741780 (+ 28us) server_negotiation.cc:407] Connection header received
0808 14:50:13.741839 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:13.741846 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:13.742068 (+ 222us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:13.742247 (+ 179us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:13.743741 (+ 1494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:13.744777 (+ 1036us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:13.746027 (+ 1250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:13.746651 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:13.746792 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:13.750941 (+ 4149us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:50:13.750953 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:50:13.750967 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:50:13.751005 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:50:13.753682 (+ 2677us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:13.754291 (+ 609us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:13.754297 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:13.754299 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:13.754423 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:13.754742 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:13.754745 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:13.754747 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:13.755059 (+ 312us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:50:13.755267 (+ 208us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:13.755501 (+ 234us) server_negotiation.cc:299] Negotiation successful
0808 14:50:13.755760 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":565,"thread_start_us":374,"threads_started":1}
Aug 08 14:50:13 dist-test-slave-6k22 krb5kdc[31524](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200613, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.206.254@KRBTEST.COM
I20260808 14:50:13.773439 31790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:13.760457 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35140 (local address 127.26.206.254:38409)
0808 14:50:13.760661 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:13.760667 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:13.760737 (+ 70us) server_negotiation.cc:407] Connection header received
0808 14:50:13.760940 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:13.760945 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:13.761008 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:13.761104 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:13.762351 (+ 1247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:13.763084 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:13.764406 (+ 1322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:13.764843 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:13.764983 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:13.768633 (+ 3650us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:50:13.768638 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:50:13.768641 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:50:13.768671 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:50:13.771205 (+ 2534us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:13.771873 (+ 668us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:13.771877 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:13.771879 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:13.772003 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:13.772309 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:13.772312 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:13.772314 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:13.772631 (+ 317us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:50:13.772817 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:13.773057 (+ 240us) server_negotiation.cc:299] Negotiation successful
0808 14:50:13.773206 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
W20260808 14:50:13.774133 31576 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35140
I20260808 14:50:13.775136 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 31644
I20260808 14:50:13.786605 32094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:13.776116 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52060 (local address 127.26.206.193:44825)
0808 14:50:13.776308 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:13.776314 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:13.776450 (+ 136us) server_negotiation.cc:407] Connection header received
0808 14:50:13.776562 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:13.776566 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:13.776652 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:13.776728 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:13.777830 (+ 1102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:13.778491 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:13.779672 (+ 1181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:13.780099 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:13.780193 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:13.782197 (+ 2004us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:50:13.782202 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:50:13.782205 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:50:13.782232 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:50:13.784618 (+ 2386us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:13.785136 (+ 518us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:13.785139 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:13.785141 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:13.785246 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:13.785581 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:13.785584 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:13.785586 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:13.785805 (+ 219us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:50:13.785979 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:13.786194 (+ 215us) server_negotiation.cc:299] Negotiation successful
0808 14:50:13.786374 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260808 14:50:13.787171 31780 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:50:13.868547 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 31644
I20260808 14:50:13.889858 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 31794
Aug 08 14:50:13 dist-test-slave-6k22 krb5kdc[31524](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200613, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.206.194@KRBTEST.COM
I20260808 14:50:13.905578 32101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:13.890830 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53560 (local address 127.26.206.194:38275)
0808 14:50:13.891364 (+ 534us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:13.891371 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:13.891395 (+ 24us) server_negotiation.cc:407] Connection header received
0808 14:50:13.891453 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:13.891460 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:13.891726 (+ 266us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:13.891902 (+ 176us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:13.893133 (+ 1231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:13.894165 (+ 1032us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:13.895430 (+ 1265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:13.896095 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:13.896239 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:13.900269 (+ 4030us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:50:13.900280 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:50:13.900293 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:50:13.900331 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:50:13.903056 (+ 2725us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:13.903783 (+ 727us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:13.903790 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:13.903793 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:13.903918 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:13.904221 (+ 303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:13.904224 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:13.904226 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:13.904545 (+ 319us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:50:13.904758 (+ 213us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:13.905002 (+ 244us) server_negotiation.cc:299] Negotiation successful
0808 14:50:13.905186 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":390,"thread_start_us":259,"threads_started":1}
I20260808 14:50:13.906804 31929 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:50:13.989428 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 31794
I20260808 14:50:14.009264 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 31940
Aug 08 14:50:14 dist-test-slave-6k22 krb5kdc[31524](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200613, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.206.195@KRBTEST.COM
I20260808 14:50:14.025681 32103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:14.010327 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57042 (local address 127.26.206.195:35631)
0808 14:50:14.010912 (+ 585us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:14.010918 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:14.010947 (+ 29us) server_negotiation.cc:407] Connection header received
0808 14:50:14.011005 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:14.011010 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:14.011243 (+ 233us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:14.011370 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:14.012638 (+ 1268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:14.013665 (+ 1027us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:14.014966 (+ 1301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:14.015507 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:14.015760 (+ 253us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:14.020375 (+ 4615us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:50:14.020385 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:50:14.020399 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:50:14.020435 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:50:14.023328 (+ 2893us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:14.023994 (+ 666us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:14.024000 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:14.024002 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:14.024130 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:14.024438 (+ 308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:14.024441 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:14.024443 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:14.024773 (+ 330us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:50:14.024995 (+ 222us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:14.025194 (+ 199us) server_negotiation.cc:299] Negotiation successful
0808 14:50:14.025397 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":458,"thread_start_us":304,"threads_started":1}
I20260808 14:50:14.026907 32079 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:50:14.109272 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 31940
I20260808 14:50:14.127465 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 31538
I20260808 14:50:14.128662 31609 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:50:14.234787 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 31538
2026-08-08T14:50:14Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (3995 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200577490656-27451-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:50:14 dist-test-slave-6k22 krb5kdc[32109](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:50:14 dist-test-slave-6k22 krb5kdc[32109](info): set up 2 sockets
Aug 08 14:50:14 dist-test-slave-6k22 krb5kdc[32109](info): commencing operation
krb5kdc: starting...
W20260808 14:50:15.406747 27451 mini_kdc.cc:121] Time spent starting KDC: real 1.125s user 0.000s sys 0.024s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200577490656-27451-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200577490656-27451-0/krb5kdc/test-user.keytab.
Aug 08 14:50:15 dist-test-slave-6k22 krb5kdc[32109](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200615, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:50:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:50:15Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.206.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.206.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.206.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.254.keytab.
Entry for principal kudu/127.26.206.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.254.keytab.
I20260808 14:50:15.621191 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200577490656-27451-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200577490656-27451-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200577490656-27451-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.206.254:37975
--webserver_interface=127.26.206.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.254.keytab
--principal=kudu/127.26.206.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.206.212:39919
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.206.254:37975
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:50:15.935866 32123 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:50:15.936136 32123 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:50:15.936228 32123 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:50:15.943241 32123 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:50:15.943333 32123 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:50:15.943385 32123 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:50:15.943440 32123 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:50:15.943492 32123 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:50:15.952900 32123 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:39919
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200577490656-27451-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200577490656-27451-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.206.254:37975
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.254.keytab
--principal=kudu/127.26.206.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.206.254:37975
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.206.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200577490656-27451-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:50:15.954017 32123 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:50:15.955200 32123 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:50:15.966638 32128 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:50:15.966672 32131 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:50:15.966558 32129 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:50:15.967656 32123 server_base.cc:1034] running on GCE node
I20260808 14:50:15.968398 32123 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:50:15.969671 32123 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:50:15.970896 32123 hybrid_clock.cc:648] HybridClock initialized: now 1786200615970859 us; error 34 us; skew 500 ppm
I20260808 14:50:15.971223 32123 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:50:15 dist-test-slave-6k22 krb5kdc[32109](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200615, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:50:15.974581 32123 init.cc:377] Logged in from keytab as kudu/127.26.206.254@KRBTEST.COM (short username kudu)
I20260808 14:50:15.975775 32123 fs_manager.cc:359] Metadata directory not provided
I20260808 14:50:15.975888 32123 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:50:15.976222 32123 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:50:15.979127 32123 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200577490656-27451-0/minicluster-data/master-0/data/instance:
uuid: "e31edf40b38f427fb51cce62102dca39"
format_stamp: "Formatted at 2026-08-08 14:50:15 on dist-test-slave-6k22"
server_key: "b4920e19fcd324bae0c494d2ea7a1699"
server_key_iv: "ae8f752488bfd61e17feb06b08682089"
server_key_version: "encryptionkey@0"
I20260808 14:50:15.980027 32123 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200577490656-27451-0/minicluster-data/master-0/wal/instance:
uuid: "e31edf40b38f427fb51cce62102dca39"
format_stamp: "Formatted at 2026-08-08 14:50:15 on dist-test-slave-6k22"
server_key: "b4920e19fcd324bae0c494d2ea7a1699"
server_key_iv: "ae8f752488bfd61e17feb06b08682089"
server_key_version: "encryptionkey@0"
I20260808 14:50:15.984850 32123 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.003s
I20260808 14:50:15.988186 32137 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:50:15.989427 32123 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 14:50:15.989595 32123 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200577490656-27451-0/minicluster-data/master-0/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200577490656-27451-0/minicluster-data/master-0/wal
uuid: "e31edf40b38f427fb51cce62102dca39"
format_stamp: "Formatted at 2026-08-08 14:50:15 on dist-test-slave-6k22"
server_key: "b4920e19fcd324bae0c494d2ea7a1699"
server_key_iv: "ae8f752488bfd61e17feb06b08682089"
server_key_version: "encryptionkey@0"
I20260808 14:50:15.989804 32123 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200577490656-27451-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200577490656-27451-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200577490656-27451-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:50:16.017756 32123 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:50:16.021596 32123 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:50:16.021863 32123 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:50:16.039623 32123 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.254:37975
I20260808 14:50:16.039628 32195 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.254:37975 every 8 connection(s)
I20260808 14:50:16.040612 32123 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
I20260808 14:50:16.041097 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 32123
I20260808 14:50:16.041335 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200577490656-27451-0/minicluster-data/master-0/wal/instance
I20260808 14:50:16.042174 27451 external_mini_cluster.cc:1428] Setting key 9eb82433d6f90e90caeebef8c0503cb3
I20260808 14:50:16.044859 32196 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 08 14:50:16 dist-test-slave-6k22 krb5kdc[32109](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200615, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.206.254@KRBTEST.COM
I20260808 14:50:16.056010 32196 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e31edf40b38f427fb51cce62102dca39: Bootstrap starting.
I20260808 14:50:16.060089 32196 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e31edf40b38f427fb51cce62102dca39: Neither blocks nor log segments found. Creating new log.
I20260808 14:50:16.061259 32196 log.cc:824] T 00000000000000000000000000000000 P e31edf40b38f427fb51cce62102dca39: Log is configured to *not* fsync() on all Append() calls
I20260808 14:50:16.064122 32199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:16.044199 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35376 (local address 127.26.206.254:37975)
0808 14:50:16.045032 (+ 833us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:16.045043 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:16.045081 (+ 38us) server_negotiation.cc:407] Connection header received
0808 14:50:16.046633 (+ 1552us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:16.046652 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:16.047067 (+ 415us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:16.047457 (+ 390us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:16.048964 (+ 1507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:16.050243 (+ 1279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:16.051483 (+ 1240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:16.052183 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:16.052386 (+ 203us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:16.056681 (+ 4295us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:50:16.056688 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:50:16.056701 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:50:16.056733 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:50:16.059771 (+ 3038us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:16.060484 (+ 713us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:16.060490 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:16.060495 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:16.060659 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:16.061026 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:16.061030 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:16.061032 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:16.061586 (+ 554us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:50:16.061925 (+ 339us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:16.062387 (+ 462us) server_negotiation.cc:299] Negotiation successful
0808 14:50:16.062817 (+ 430us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":583,"thread_start_us":356,"threads_started":1}
I20260808 14:50:16.064730 32196 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e31edf40b38f427fb51cce62102dca39: No bootstrap required, opened a new log
I20260808 14:50:16.072556 32196 raft_consensus.cc:348] T 00000000000000000000000000000000 P e31edf40b38f427fb51cce62102dca39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e31edf40b38f427fb51cce62102dca39" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 37975 } }
I20260808 14:50:16.072871 32196 raft_consensus.cc:374] T 00000000000000000000000000000000 P e31edf40b38f427fb51cce62102dca39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:50:16.072943 32196 raft_consensus.cc:729] T 00000000000000000000000000000000 P e31edf40b38f427fb51cce62102dca39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e31edf40b38f427fb51cce62102dca39, State: Initialized, Role: FOLLOWER
I20260808 14:50:16.073388 32196 consensus_queue.cc:260] T 00000000000000000000000000000000 P e31edf40b38f427fb51cce62102dca39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e31edf40b38f427fb51cce62102dca39" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 37975 } }
I20260808 14:50:16.073581 32196 raft_consensus.cc:388] T 00000000000000000000000000000000 P e31edf40b38f427fb51cce62102dca39 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:50:16.073679 32196 raft_consensus.cc:482] T 00000000000000000000000000000000 P e31edf40b38f427fb51cce62102dca39 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:50:16.073787 32196 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e31edf40b38f427fb51cce62102dca39 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:50:16.075789 32196 raft_consensus.cc:504] T 00000000000000000000000000000000 P e31edf40b38f427fb51cce62102dca39 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e31edf40b38f427fb51cce62102dca39" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 37975 } }
I20260808 14:50:16.076187 32196 leader_election.cc:302] T 00000000000000000000000000000000 P e31edf40b38f427fb51cce62102dca39 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e31edf40b38f427fb51cce62102dca39; no voters:
I20260808 14:50:16.076733 32196 leader_election.cc:288] T 00000000000000000000000000000000 P e31edf40b38f427fb51cce62102dca39 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:50:16.076876 32202 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e31edf40b38f427fb51cce62102dca39 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:50:16.077764 32202 raft_consensus.cc:686] T 00000000000000000000000000000000 P e31edf40b38f427fb51cce62102dca39 [term 1 LEADER]: Becoming Leader. State: Replica: e31edf40b38f427fb51cce62102dca39, State: Running, Role: LEADER
I20260808 14:50:16.078370 32202 consensus_queue.cc:237] T 00000000000000000000000000000000 P e31edf40b38f427fb51cce62102dca39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e31edf40b38f427fb51cce62102dca39" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 37975 } }
I20260808 14:50:16.078907 32196 sys_catalog.cc:564] T 00000000000000000000000000000000 P e31edf40b38f427fb51cce62102dca39 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:50:16.081319 32203 sys_catalog.cc:455] T 00000000000000000000000000000000 P e31edf40b38f427fb51cce62102dca39 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e31edf40b38f427fb51cce62102dca39" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e31edf40b38f427fb51cce62102dca39" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 37975 } } }
I20260808 14:50:16.081387 32204 sys_catalog.cc:455] T 00000000000000000000000000000000 P e31edf40b38f427fb51cce62102dca39 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e31edf40b38f427fb51cce62102dca39. Latest consensus state: current_term: 1 leader_uuid: "e31edf40b38f427fb51cce62102dca39" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e31edf40b38f427fb51cce62102dca39" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 37975 } } }
I20260808 14:50:16.081689 32203 sys_catalog.cc:458] T 00000000000000000000000000000000 P e31edf40b38f427fb51cce62102dca39 [sys.catalog]: This master's current role is: LEADER
I20260808 14:50:16.081763 32204 sys_catalog.cc:458] T 00000000000000000000000000000000 P e31edf40b38f427fb51cce62102dca39 [sys.catalog]: This master's current role is: LEADER
I20260808 14:50:16.084563 32212 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:50:16.089589 32212 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:50:16.098527 32212 catalog_manager.cc:1347] Generated new cluster ID: 20c1d6ee3eed4d50a8e30f2ac6dc63c8
I20260808 14:50:16.098635 32212 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:50:16.109226 32212 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:50:16.111012 32212 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:50:16.125995 32212 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e31edf40b38f427fb51cce62102dca39: Generated new TSK 0
I20260808 14:50:16.126947 32212 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.206.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.206.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.206.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.193.keytab.
Entry for principal kudu/127.26.206.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.193.keytab.
I20260808 14:50:16.179227 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200577490656-27451-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200577490656-27451-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200577490656-27451-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200577490656-27451-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.206.193:0
--local_ip_for_outbound_sockets=127.26.206.193
--webserver_interface=127.26.206.193
--webserver_port=0
--tserver_master_addrs=127.26.206.254:37975
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.193.keytab
--principal=kudu/127.26.206.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.206.212:39919
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:50:16.520820 32225 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:50:16.521134 32225 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:50:16.521322 32225 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:50:16.528633 32225 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:50:16.528790 32225 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:50:16.528987 32225 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.206.193
I20260808 14:50:16.538604 32225 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:39919
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200577490656-27451-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200577490656-27451-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.193.keytab
--principal=kudu/127.26.206.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.206.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200577490656-27451-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.206.193
--webserver_port=0
--tserver_master_addrs=127.26.206.254:37975
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.206.193
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200577490656-27451-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:50:16.539930 32225 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:50:16.541276 32225 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:50:16.554425 32231 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:50:16.554421 32234 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:50:16.555001 32232 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:50:16.555328 32225 server_base.cc:1034] running on GCE node
I20260808 14:50:16.556010 32225 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:50:16.556895 32225 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:50:16.558115 32225 hybrid_clock.cc:648] HybridClock initialized: now 1786200616558071 us; error 45 us; skew 500 ppm
I20260808 14:50:16.558435 32225 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:50:16 dist-test-slave-6k22 krb5kdc[32109](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200616, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:50:16.561648 32225 init.cc:377] Logged in from keytab as kudu/127.26.206.193@KRBTEST.COM (short username kudu)
I20260808 14:50:16.562848 32225 fs_manager.cc:359] Metadata directory not provided
I20260808 14:50:16.562973 32225 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:50:16.563294 32225 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:50:16.566228 32225 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200577490656-27451-0/minicluster-data/ts-0/data/instance:
uuid: "e9ee1970ac5f4ccb860975f7200f5fa4"
format_stamp: "Formatted at 2026-08-08 14:50:16 on dist-test-slave-6k22"
server_key: "9df49a6243f3f36616af7f152e7a393d"
server_key_iv: "b053a4691f5adffb761cc288df450475"
server_key_version: "encryptionkey@0"
I20260808 14:50:16.567131 32225 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200577490656-27451-0/minicluster-data/ts-0/wal/instance:
uuid: "e9ee1970ac5f4ccb860975f7200f5fa4"
format_stamp: "Formatted at 2026-08-08 14:50:16 on dist-test-slave-6k22"
server_key: "9df49a6243f3f36616af7f152e7a393d"
server_key_iv: "b053a4691f5adffb761cc288df450475"
server_key_version: "encryptionkey@0"
I20260808 14:50:16.571997 32225 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.003s
I20260808 14:50:16.575312 32241 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:50:16.576536 32225 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 14:50:16.576697 32225 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200577490656-27451-0/minicluster-data/ts-0/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200577490656-27451-0/minicluster-data/ts-0/wal
uuid: "e9ee1970ac5f4ccb860975f7200f5fa4"
format_stamp: "Formatted at 2026-08-08 14:50:16 on dist-test-slave-6k22"
server_key: "9df49a6243f3f36616af7f152e7a393d"
server_key_iv: "b053a4691f5adffb761cc288df450475"
server_key_version: "encryptionkey@0"
I20260808 14:50:16.576928 32225 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200577490656-27451-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200577490656-27451-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200577490656-27451-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:50:16.588750 32225 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:50:16.592525 32225 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:50:16.592842 32225 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:50:16.593739 32225 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:50:16.595052 32225 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:50:16.595157 32225 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:50:16.595290 32225 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:50:16.595384 32225 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:50:16.627753 32225 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.193:42819
I20260808 14:50:16.627841 32373 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.193:42819 every 8 connection(s)
I20260808 14:50:16.628733 32225 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200577490656-27451-0/minicluster-data/ts-0/data/info.pb
I20260808 14:50:16.630358 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 32225
I20260808 14:50:16.630569 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200577490656-27451-0/minicluster-data/ts-0/wal/instance
I20260808 14:50:16.631310 27451 external_mini_cluster.cc:1428] Setting key b7deb04869d9d94c3c85553f04501317
Aug 08 14:50:16 dist-test-slave-6k22 krb5kdc[32109](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200616, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.193@KRBTEST.COM for kudu/127.26.206.254@KRBTEST.COM
I20260808 14:50:16.652961 32377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:16.631348 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.193:53415 (local address 127.26.206.254:37975)
0808 14:50:16.631884 (+ 536us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:16.631890 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:16.633026 (+ 1136us) server_negotiation.cc:407] Connection header received
0808 14:50:16.635377 (+ 2351us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:16.635382 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:16.635489 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:16.635616 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:16.638010 (+ 2394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:16.638740 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:16.641134 (+ 2394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:16.641879 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:16.642030 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:16.646407 (+ 4377us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:50:16.646416 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:50:16.646424 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:50:16.646473 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:50:16.649789 (+ 3316us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:16.650531 (+ 742us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:16.650537 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:16.650541 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:16.650668 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:16.651104 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:16.651109 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:16.651113 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:16.651443 (+ 330us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:50:16.651619 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:16.652354 (+ 735us) server_negotiation.cc:299] Negotiation successful
0808 14:50:16.652579 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":406,"thread_start_us":294,"threads_started":1}
I20260808 14:50:16.653939 32379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:16.631951 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:37975 (local address 127.26.206.193:53415)
0808 14:50:16.632863 (+ 912us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:16.632913 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0808 14:50:16.635113 (+ 2200us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:50:16.636066 (+ 953us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:50:16.636077 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:50:16.636956 (+ 879us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:50:16.637815 (+ 859us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:16.637842 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:16.638902 (+ 1060us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:16.638909 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:16.640954 (+ 2045us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:16.640973 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:16.642356 (+ 1383us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:16.642366 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:16.642692 (+ 326us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:16.643408 (+ 716us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:50:16.643450 (+ 42us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:50:16.646178 (+ 2728us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:50:16.649937 (+ 3759us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:50:16.649946 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:50:16.649963 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:50:16.650399 (+ 436us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:50:16.650788 (+ 389us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:50:16.650793 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:50:16.650796 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:50:16.650982 (+ 186us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:50:16.651608 (+ 626us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:50:16.651616 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:50:16.651968 (+ 352us) client_negotiation.cc:769] Sending connection context
0808 14:50:16.652236 (+ 268us) client_negotiation.cc:240] Negotiation successful
0808 14:50:16.652795 (+ 559us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":598,"thread_start_us":357,"threads_started":1}
I20260808 14:50:16.655575 32374 heartbeater.cc:347] Connected to a master server at 127.26.206.254:37975
I20260808 14:50:16.655921 32374 heartbeater.cc:464] Registering TS with master...
I20260808 14:50:16.656760 32374 heartbeater.cc:511] Master 127.26.206.254:37975 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.26.206.194@KRBTEST.COM; defaulting to no policy
I20260808 14:50:16.659039 32155 ts_manager.cc:194] Registered new tserver with Master: e9ee1970ac5f4ccb860975f7200f5fa4 (127.26.206.193:42819)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.206.194@KRBTEST.COM" created.
I20260808 14:50:16.660852 32155 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.206.193@KRBTEST.COM'} at 127.26.206.193:53415
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.206.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.194.keytab.
Entry for principal kudu/127.26.206.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.194.keytab.
I20260808 14:50:16.686898 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200577490656-27451-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200577490656-27451-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200577490656-27451-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200577490656-27451-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.206.194:0
--local_ip_for_outbound_sockets=127.26.206.194
--webserver_interface=127.26.206.194
--webserver_port=0
--tserver_master_addrs=127.26.206.254:37975
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.194.keytab
--principal=kudu/127.26.206.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.206.212:39919
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:50:17.021646 32382 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:50:17.021972 32382 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:50:17.022153 32382 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:50:17.029423 32382 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:50:17.029592 32382 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:50:17.029788 32382 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.206.194
I20260808 14:50:17.040201 32382 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:39919
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200577490656-27451-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200577490656-27451-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.194.keytab
--principal=kudu/127.26.206.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.206.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200577490656-27451-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.206.194
--webserver_port=0
--tserver_master_addrs=127.26.206.254:37975
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.206.194
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200577490656-27451-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:50:17.041790 32382 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:50:17.043457 32382 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:50:17.057587 32387 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:50:17.057603 32388 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:50:17.058403 32390 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:50:17.058857 32382 server_base.cc:1034] running on GCE node
I20260808 14:50:17.059602 32382 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:50:17.060806 32382 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:50:17.062039 32382 hybrid_clock.cc:648] HybridClock initialized: now 1786200617061993 us; error 48 us; skew 500 ppm
I20260808 14:50:17.062363 32382 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:50:17 dist-test-slave-6k22 krb5kdc[32109](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200617, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:50:17.075788 32382 init.cc:377] Logged in from keytab as kudu/127.26.206.194@KRBTEST.COM (short username kudu)
I20260808 14:50:17.076912 32382 fs_manager.cc:359] Metadata directory not provided
I20260808 14:50:17.077024 32382 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:50:17.077358 32382 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:50:17.080456 32382 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200577490656-27451-0/minicluster-data/ts-1/data/instance:
uuid: "3a3dd8b5946b446ebe5bdc1d66ca2ba0"
format_stamp: "Formatted at 2026-08-08 14:50:17 on dist-test-slave-6k22"
server_key: "c77a9df136e3c06f534b862e6e451f62"
server_key_iv: "0996e755dd5e5bed7e271eaf7a039174"
server_key_version: "encryptionkey@0"
I20260808 14:50:17.081336 32382 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200577490656-27451-0/minicluster-data/ts-1/wal/instance:
uuid: "3a3dd8b5946b446ebe5bdc1d66ca2ba0"
format_stamp: "Formatted at 2026-08-08 14:50:17 on dist-test-slave-6k22"
server_key: "c77a9df136e3c06f534b862e6e451f62"
server_key_iv: "0996e755dd5e5bed7e271eaf7a039174"
server_key_version: "encryptionkey@0"
I20260808 14:50:17.086512 32382 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260808 14:50:17.089890 32399 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:50:17.091161 32382 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 14:50:17.091332 32382 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200577490656-27451-0/minicluster-data/ts-1/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200577490656-27451-0/minicluster-data/ts-1/wal
uuid: "3a3dd8b5946b446ebe5bdc1d66ca2ba0"
format_stamp: "Formatted at 2026-08-08 14:50:17 on dist-test-slave-6k22"
server_key: "c77a9df136e3c06f534b862e6e451f62"
server_key_iv: "0996e755dd5e5bed7e271eaf7a039174"
server_key_version: "encryptionkey@0"
I20260808 14:50:17.091532 32382 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200577490656-27451-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200577490656-27451-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200577490656-27451-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:50:17.104166 32382 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:50:17.107813 32382 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:50:17.108083 32382 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:50:17.108981 32382 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:50:17.110309 32382 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:50:17.110417 32382 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:50:17.110540 32382 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:50:17.110626 32382 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:50:17.143128 32382 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.194:38931
I20260808 14:50:17.143177 32520 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.194:38931 every 8 connection(s)
I20260808 14:50:17.144057 32382 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200577490656-27451-0/minicluster-data/ts-1/data/info.pb
I20260808 14:50:17.149154 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 32382
I20260808 14:50:17.149335 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200577490656-27451-0/minicluster-data/ts-1/wal/instance
I20260808 14:50:17.149821 27451 external_mini_cluster.cc:1428] Setting key ed50b7db1cc9ea457961ac04446f3548
Aug 08 14:50:17 dist-test-slave-6k22 krb5kdc[32109](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200617, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.194@KRBTEST.COM for kudu/127.26.206.254@KRBTEST.COM
I20260808 14:50:17.166971 32377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:17.146385 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.194:52387 (local address 127.26.206.254:37975)
0808 14:50:17.146571 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:17.146575 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:17.147765 (+ 1190us) server_negotiation.cc:407] Connection header received
0808 14:50:17.149654 (+ 1889us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:17.149660 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:17.149744 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:17.149845 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:17.151342 (+ 1497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:17.152574 (+ 1232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:17.155086 (+ 2512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:17.155507 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:17.155675 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:17.159713 (+ 4038us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:50:17.159719 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:50:17.159729 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:50:17.159763 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:50:17.163438 (+ 3675us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:17.164295 (+ 857us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:17.164303 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:17.164308 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:17.164507 (+ 199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:17.164991 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:17.164999 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:17.165005 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:17.165375 (+ 370us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:50:17.165565 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:17.166226 (+ 661us) server_negotiation.cc:299] Negotiation successful
0808 14:50:17.166515 (+ 289us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260808 14:50:17.167484 32524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:17.146875 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:37975 (local address 127.26.206.194:52387)
0808 14:50:17.147612 (+ 737us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:17.147657 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 14:50:17.149372 (+ 1715us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:50:17.150066 (+ 694us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:50:17.150074 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:50:17.150585 (+ 511us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:50:17.151157 (+ 572us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:17.151173 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:17.152748 (+ 1575us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:17.152756 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:17.154925 (+ 2169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:17.154943 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:17.155767 (+ 824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:17.155776 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:17.156078 (+ 302us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:17.156839 (+ 761us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:50:17.156883 (+ 44us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:50:17.159471 (+ 2588us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:50:17.163711 (+ 4240us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:50:17.163717 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:50:17.163727 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:50:17.164168 (+ 441us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:50:17.164678 (+ 510us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:50:17.164682 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:50:17.164684 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:50:17.164861 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:50:17.165552 (+ 691us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:50:17.165558 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:50:17.165855 (+ 297us) client_negotiation.cc:769] Sending connection context
0808 14:50:17.166074 (+ 219us) client_negotiation.cc:240] Negotiation successful
0808 14:50:17.166410 (+ 336us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":478,"thread_start_us":285,"threads_started":1}
I20260808 14:50:17.168906 32522 heartbeater.cc:347] Connected to a master server at 127.26.206.254:37975
I20260808 14:50:17.169234 32522 heartbeater.cc:464] Registering TS with master...
I20260808 14:50:17.170060 32522 heartbeater.cc:511] Master 127.26.206.254:37975 requested a full tablet report, sending...
I20260808 14:50:17.171681 32155 ts_manager.cc:194] Registered new tserver with Master: 3a3dd8b5946b446ebe5bdc1d66ca2ba0 (127.26.206.194:38931)
I20260808 14:50:17.172524 32155 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.206.194@KRBTEST.COM'} at 127.26.206.194:52387
WARNING: no policy specified for kudu/127.26.206.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.206.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.206.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.195.keytab.
Entry for principal kudu/127.26.206.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.195.keytab.
I20260808 14:50:17.202544 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200577490656-27451-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200577490656-27451-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200577490656-27451-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200577490656-27451-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.206.195:0
--local_ip_for_outbound_sockets=127.26.206.195
--webserver_interface=127.26.206.195
--webserver_port=0
--tserver_master_addrs=127.26.206.254:37975
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.195.keytab
--principal=kudu/127.26.206.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.206.212:39919
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:50:17.551795 32528 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:50:17.552119 32528 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:50:17.552307 32528 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:50:17.559803 32528 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:50:17.559958 32528 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:50:17.560140 32528 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.206.195
I20260808 14:50:17.570282 32528 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:39919
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200577490656-27451-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200577490656-27451-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.195.keytab
--principal=kudu/127.26.206.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.206.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200577490656-27451-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.206.195
--webserver_port=0
--tserver_master_addrs=127.26.206.254:37975
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.206.195
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200577490656-27451-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:50:17.571884 32528 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:50:17.573275 32528 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:50:17.587600 32534 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:50:17.587694 32533 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:50:17.587868 32537 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:50:17.588357 32528 server_base.cc:1034] running on GCE node
I20260808 14:50:17.589058 32528 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:50:17.590169 32528 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:50:17.591430 32528 hybrid_clock.cc:648] HybridClock initialized: now 1786200617591368 us; error 51 us; skew 500 ppm
I20260808 14:50:17.591801 32528 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:50:17 dist-test-slave-6k22 krb5kdc[32109](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200617, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:50:17.595091 32528 init.cc:377] Logged in from keytab as kudu/127.26.206.195@KRBTEST.COM (short username kudu)
I20260808 14:50:17.596412 32528 fs_manager.cc:359] Metadata directory not provided
I20260808 14:50:17.596529 32528 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:50:17.596871 32528 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:50:17.599768 32528 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200577490656-27451-0/minicluster-data/ts-2/data/instance:
uuid: "3c891714fdf240adbacf48c0375465f4"
format_stamp: "Formatted at 2026-08-08 14:50:17 on dist-test-slave-6k22"
server_key: "c2f14132efc1e0326936b302b148d138"
server_key_iv: "af52ca3e4a7e38859508bcdbec336ca3"
server_key_version: "encryptionkey@0"
I20260808 14:50:17.600558 32528 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200577490656-27451-0/minicluster-data/ts-2/wal/instance:
uuid: "3c891714fdf240adbacf48c0375465f4"
format_stamp: "Formatted at 2026-08-08 14:50:17 on dist-test-slave-6k22"
server_key: "c2f14132efc1e0326936b302b148d138"
server_key_iv: "af52ca3e4a7e38859508bcdbec336ca3"
server_key_version: "encryptionkey@0"
I20260808 14:50:17.605520 32528 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.004s
I20260808 14:50:17.608999 32543 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:50:17.610334 32528 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 14:50:17.610493 32528 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200577490656-27451-0/minicluster-data/ts-2/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200577490656-27451-0/minicluster-data/ts-2/wal
uuid: "3c891714fdf240adbacf48c0375465f4"
format_stamp: "Formatted at 2026-08-08 14:50:17 on dist-test-slave-6k22"
server_key: "c2f14132efc1e0326936b302b148d138"
server_key_iv: "af52ca3e4a7e38859508bcdbec336ca3"
server_key_version: "encryptionkey@0"
I20260808 14:50:17.610697 32528 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200577490656-27451-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200577490656-27451-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200577490656-27451-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:50:17.628968 32528 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:50:17.633209 32528 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:50:17.633487 32528 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:50:17.634394 32528 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:50:17.635720 32528 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:50:17.635850 32528 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:50:17.635974 32528 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:50:17.636061 32528 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:50:17.663785 32374 heartbeater.cc:503] Master 127.26.206.254:37975 was elected leader, sending a full tablet report...
I20260808 14:50:17.668658 32528 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.195:43569
I20260808 14:50:17.668689 32669 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.195:43569 every 8 connection(s)
I20260808 14:50:17.669531 32528 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200577490656-27451-0/minicluster-data/ts-2/data/info.pb
I20260808 14:50:17.673123 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 32528
I20260808 14:50:17.673311 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200577490656-27451-0/minicluster-data/ts-2/wal/instance
I20260808 14:50:17.673765 27451 external_mini_cluster.cc:1428] Setting key e8db6b18c5ebca18431c99289b62fb12
Aug 08 14:50:17 dist-test-slave-6k22 krb5kdc[32109](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200617, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.195@KRBTEST.COM for kudu/127.26.206.254@KRBTEST.COM
I20260808 14:50:17.690624 32672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:17.671940 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.195:37423 (local address 127.26.206.254:37975)
0808 14:50:17.672502 (+ 562us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:17.672511 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:17.673739 (+ 1228us) server_negotiation.cc:407] Connection header received
0808 14:50:17.676035 (+ 2296us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:17.676041 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:17.676149 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:17.676278 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:17.677919 (+ 1641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:17.678855 (+ 936us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:17.680651 (+ 1796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:17.681153 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:17.681291 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:17.684883 (+ 3592us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:50:17.684890 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:50:17.684895 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:50:17.684937 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:50:17.687808 (+ 2871us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:17.688597 (+ 789us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:17.688602 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:17.688604 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:17.688771 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:17.689193 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:17.689196 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:17.689198 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:17.689466 (+ 268us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:50:17.689585 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:17.690200 (+ 615us) server_negotiation.cc:299] Negotiation successful
0808 14:50:17.690372 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":433,"thread_start_us":321,"threads_started":1}
I20260808 14:50:17.691514 32673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:17.672603 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:37975 (local address 127.26.206.195:37423)
0808 14:50:17.673554 (+ 951us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:17.673603 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0808 14:50:17.675763 (+ 2160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:50:17.676505 (+ 742us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:50:17.676514 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:50:17.677146 (+ 632us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:50:17.677728 (+ 582us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:17.677747 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:17.679026 (+ 1279us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:17.679033 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:17.680499 (+ 1466us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:17.680513 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:17.681394 (+ 881us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:17.681402 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:17.681625 (+ 223us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:17.682430 (+ 805us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:50:17.682454 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:50:17.684668 (+ 2214us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:50:17.687948 (+ 3280us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:50:17.687956 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:50:17.687970 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:50:17.688477 (+ 507us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:50:17.688889 (+ 412us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:50:17.688896 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:50:17.688902 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:50:17.689090 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:50:17.689580 (+ 490us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:50:17.689586 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:50:17.689872 (+ 286us) client_negotiation.cc:769] Sending connection context
0808 14:50:17.690103 (+ 231us) client_negotiation.cc:240] Negotiation successful
0808 14:50:17.690476 (+ 373us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":657,"thread_start_us":427,"threads_started":1}
I20260808 14:50:17.692766 32670 heartbeater.cc:347] Connected to a master server at 127.26.206.254:37975
I20260808 14:50:17.693015 32670 heartbeater.cc:464] Registering TS with master...
I20260808 14:50:17.693625 32670 heartbeater.cc:511] Master 127.26.206.254:37975 requested a full tablet report, sending...
I20260808 14:50:17.694979 32155 ts_manager.cc:194] Registered new tserver with Master: 3c891714fdf240adbacf48c0375465f4 (127.26.206.195:43569)
I20260808 14:50:17.695920 32155 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.206.195@KRBTEST.COM'} at 127.26.206.195:37423
I20260808 14:50:17.700803 27451 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 14:50:17.716849 32672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:17.705161 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35392 (local address 127.26.206.254:37975)
0808 14:50:17.705409 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:17.705413 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:17.705883 (+ 470us) server_negotiation.cc:407] Connection header received
0808 14:50:17.706015 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:17.706018 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:17.706072 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:17.706148 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:17.707533 (+ 1385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:17.708270 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:17.709460 (+ 1190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:17.709870 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:17.709960 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:17.712204 (+ 2244us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:50:17.712208 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:50:17.712211 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:50:17.712238 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:50:17.714591 (+ 2353us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:17.715220 (+ 629us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:17.715223 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:17.715225 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:17.715344 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:17.715735 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:17.715738 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:17.715740 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:17.716042 (+ 302us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:50:17.716217 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:17.716480 (+ 263us) server_negotiation.cc:299] Negotiation successful
0808 14:50:17.716629 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":128}
I20260808 14:50:17.720530 32155 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35392:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:50:17.727429 32155 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:50:17.749778 32684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:17.739825 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54538 (local address 127.26.206.193:42819)
0808 14:50:17.740542 (+ 717us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:17.740551 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:17.741044 (+ 493us) server_negotiation.cc:407] Connection header received
0808 14:50:17.741357 (+ 313us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:17.741366 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:17.741642 (+ 276us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:17.741840 (+ 198us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:50:17.742906 (+ 1066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:17.744421 (+ 1515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:17.747138 (+ 2717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:17.748665 (+ 1527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:17.748885 (+ 220us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:17.749057 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:17.749302 (+ 245us) server_negotiation.cc:299] Negotiation successful
0808 14:50:17.749459 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":523,"thread_start_us":318,"threads_started":1}
I20260808 14:50:17.749871 32683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:17.739769 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.193:42819 (local address 127.0.0.1:54538)
0808 14:50:17.740901 (+ 1132us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:17.740946 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 14:50:17.741118 (+ 172us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:50:17.742140 (+ 1022us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:50:17.742149 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:50:17.742182 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:50:17.742551 (+ 369us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:17.742563 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:17.744564 (+ 2001us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:17.744568 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:17.746944 (+ 2376us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:17.746964 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:17.748866 (+ 1902us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:17.748872 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:17.749048 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:17.749104 (+ 56us) client_negotiation.cc:769] Sending connection context
0808 14:50:17.749242 (+ 138us) client_negotiation.cc:240] Negotiation successful
0808 14:50:17.749423 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":918,"mutex_wait_us":1,"thread_start_us":782,"threads_started":1}
I20260808 14:50:17.750406 32687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:17.741963 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.195:43569 (local address 127.0.0.1:34092)
0808 14:50:17.742795 (+ 832us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:17.742813 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 14:50:17.742931 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:50:17.744092 (+ 1161us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:50:17.744097 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:50:17.744126 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:50:17.744526 (+ 400us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:17.744538 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:17.746019 (+ 1481us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:17.746025 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:17.747970 (+ 1945us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:17.747982 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:17.749487 (+ 1505us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:17.749494 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:17.749672 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:17.749707 (+ 35us) client_negotiation.cc:769] Sending connection context
0808 14:50:17.749787 (+ 80us) client_negotiation.cc:240] Negotiation successful
0808 14:50:17.749920 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":722,"mutex_wait_us":3,"thread_start_us":935,"threads_started":1}
I20260808 14:50:17.751447 32688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:17.742612 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34092 (local address 127.26.206.195:43569)
0808 14:50:17.743503 (+ 891us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:17.743511 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:17.743545 (+ 34us) server_negotiation.cc:407] Connection header received
0808 14:50:17.743666 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:17.743673 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:17.743890 (+ 217us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:17.744085 (+ 195us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:50:17.744819 (+ 734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:17.745885 (+ 1066us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:17.748114 (+ 2229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:17.749263 (+ 1149us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:17.750706 (+ 1443us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:17.750899 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:17.750966 (+ 67us) server_negotiation.cc:299] Negotiation successful
0808 14:50:17.751121 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":721,"thread_start_us":564,"threads_started":1}
I20260808 14:50:17.751600 32685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:17.741313 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.194:38931 (local address 127.0.0.1:46410)
0808 14:50:17.741857 (+ 544us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:17.741875 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 14:50:17.741980 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:50:17.743696 (+ 1716us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:50:17.743701 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:50:17.743726 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:50:17.744228 (+ 502us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:17.744243 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:17.746344 (+ 2101us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:17.746350 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:17.748561 (+ 2211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:17.748576 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:17.750802 (+ 2226us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:17.750809 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:17.750977 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:17.751007 (+ 30us) client_negotiation.cc:769] Sending connection context
0808 14:50:17.751073 (+ 66us) client_negotiation.cc:240] Negotiation successful
0808 14:50:17.751185 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":417,"mutex_wait_us":28,"thread_start_us":269,"threads_started":1}
I20260808 14:50:17.752295 32686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:17.741599 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46410 (local address 127.26.206.194:38931)
0808 14:50:17.742448 (+ 849us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:17.742460 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:17.742488 (+ 28us) server_negotiation.cc:407] Connection header received
0808 14:50:17.742582 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:17.742592 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:17.742817 (+ 225us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:17.744423 (+ 1606us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:50:17.744650 (+ 227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:17.746178 (+ 1528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:17.748726 (+ 2548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:17.750545 (+ 1819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:17.751802 (+ 1257us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:17.751940 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:17.751988 (+ 48us) server_negotiation.cc:299] Negotiation successful
0808 14:50:17.752097 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":693,"thread_start_us":588,"threads_started":1}
I20260808 14:50:17.754052 32300 tablet_service.cc:1467] Processing CreateTablet for tablet dd7a9fc114784422956c7e14759c03bd (DEFAULT_TABLE table=test-table [id=0edd9edd1e854307b5b9e4dbc60068e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:50:17.754714 32596 tablet_service.cc:1467] Processing CreateTablet for tablet dd7a9fc114784422956c7e14759c03bd (DEFAULT_TABLE table=test-table [id=0edd9edd1e854307b5b9e4dbc60068e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:50:17.755651 32300 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dd7a9fc114784422956c7e14759c03bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:50:17.755957 32596 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dd7a9fc114784422956c7e14759c03bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:50:17.755541 32453 tablet_service.cc:1467] Processing CreateTablet for tablet dd7a9fc114784422956c7e14759c03bd (DEFAULT_TABLE table=test-table [id=0edd9edd1e854307b5b9e4dbc60068e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:50:17.756863 32453 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dd7a9fc114784422956c7e14759c03bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:50:17.768358 32689 tablet_bootstrap.cc:492] T dd7a9fc114784422956c7e14759c03bd P 3c891714fdf240adbacf48c0375465f4: Bootstrap starting.
I20260808 14:50:17.770980 32690 tablet_bootstrap.cc:492] T dd7a9fc114784422956c7e14759c03bd P 3a3dd8b5946b446ebe5bdc1d66ca2ba0: Bootstrap starting.
I20260808 14:50:17.774562 32690 tablet_bootstrap.cc:654] T dd7a9fc114784422956c7e14759c03bd P 3a3dd8b5946b446ebe5bdc1d66ca2ba0: Neither blocks nor log segments found. Creating new log.
I20260808 14:50:17.774562 32689 tablet_bootstrap.cc:654] T dd7a9fc114784422956c7e14759c03bd P 3c891714fdf240adbacf48c0375465f4: Neither blocks nor log segments found. Creating new log.
I20260808 14:50:17.775465 32691 tablet_bootstrap.cc:492] T dd7a9fc114784422956c7e14759c03bd P e9ee1970ac5f4ccb860975f7200f5fa4: Bootstrap starting.
I20260808 14:50:17.775888 32690 log.cc:824] T dd7a9fc114784422956c7e14759c03bd P 3a3dd8b5946b446ebe5bdc1d66ca2ba0: Log is configured to *not* fsync() on all Append() calls
I20260808 14:50:17.775888 32689 log.cc:824] T dd7a9fc114784422956c7e14759c03bd P 3c891714fdf240adbacf48c0375465f4: Log is configured to *not* fsync() on all Append() calls
I20260808 14:50:17.779083 32691 tablet_bootstrap.cc:654] T dd7a9fc114784422956c7e14759c03bd P e9ee1970ac5f4ccb860975f7200f5fa4: Neither blocks nor log segments found. Creating new log.
I20260808 14:50:17.779513 32689 tablet_bootstrap.cc:492] T dd7a9fc114784422956c7e14759c03bd P 3c891714fdf240adbacf48c0375465f4: No bootstrap required, opened a new log
I20260808 14:50:17.779850 32689 ts_tablet_manager.cc:1397] T dd7a9fc114784422956c7e14759c03bd P 3c891714fdf240adbacf48c0375465f4: Time spent bootstrapping tablet: real 0.012s user 0.008s sys 0.000s
I20260808 14:50:17.780323 32690 tablet_bootstrap.cc:492] T dd7a9fc114784422956c7e14759c03bd P 3a3dd8b5946b446ebe5bdc1d66ca2ba0: No bootstrap required, opened a new log
I20260808 14:50:17.780421 32691 log.cc:824] T dd7a9fc114784422956c7e14759c03bd P e9ee1970ac5f4ccb860975f7200f5fa4: Log is configured to *not* fsync() on all Append() calls
I20260808 14:50:17.780622 32690 ts_tablet_manager.cc:1397] T dd7a9fc114784422956c7e14759c03bd P 3a3dd8b5946b446ebe5bdc1d66ca2ba0: Time spent bootstrapping tablet: real 0.010s user 0.005s sys 0.004s
I20260808 14:50:17.785995 32691 tablet_bootstrap.cc:492] T dd7a9fc114784422956c7e14759c03bd P e9ee1970ac5f4ccb860975f7200f5fa4: No bootstrap required, opened a new log
I20260808 14:50:17.786270 32691 ts_tablet_manager.cc:1397] T dd7a9fc114784422956c7e14759c03bd P e9ee1970ac5f4ccb860975f7200f5fa4: Time spent bootstrapping tablet: real 0.011s user 0.005s sys 0.005s
I20260808 14:50:17.788256 32690 raft_consensus.cc:348] T dd7a9fc114784422956c7e14759c03bd P 3a3dd8b5946b446ebe5bdc1d66ca2ba0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9ee1970ac5f4ccb860975f7200f5fa4" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 42819 } } peers { permanent_uuid: "3a3dd8b5946b446ebe5bdc1d66ca2ba0" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 38931 } } peers { permanent_uuid: "3c891714fdf240adbacf48c0375465f4" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 43569 } }
I20260808 14:50:17.788607 32690 raft_consensus.cc:374] T dd7a9fc114784422956c7e14759c03bd P 3a3dd8b5946b446ebe5bdc1d66ca2ba0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:50:17.788720 32690 raft_consensus.cc:729] T dd7a9fc114784422956c7e14759c03bd P 3a3dd8b5946b446ebe5bdc1d66ca2ba0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a3dd8b5946b446ebe5bdc1d66ca2ba0, State: Initialized, Role: FOLLOWER
I20260808 14:50:17.789273 32690 consensus_queue.cc:260] T dd7a9fc114784422956c7e14759c03bd P 3a3dd8b5946b446ebe5bdc1d66ca2ba0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9ee1970ac5f4ccb860975f7200f5fa4" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 42819 } } peers { permanent_uuid: "3a3dd8b5946b446ebe5bdc1d66ca2ba0" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 38931 } } peers { permanent_uuid: "3c891714fdf240adbacf48c0375465f4" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 43569 } }
I20260808 14:50:17.790378 32522 heartbeater.cc:503] Master 127.26.206.254:37975 was elected leader, sending a full tablet report...
I20260808 14:50:17.790829 32690 ts_tablet_manager.cc:1428] T dd7a9fc114784422956c7e14759c03bd P 3a3dd8b5946b446ebe5bdc1d66ca2ba0: Time spent starting tablet: real 0.010s user 0.005s sys 0.004s
I20260808 14:50:17.792017 32689 raft_consensus.cc:348] T dd7a9fc114784422956c7e14759c03bd P 3c891714fdf240adbacf48c0375465f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9ee1970ac5f4ccb860975f7200f5fa4" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 42819 } } peers { permanent_uuid: "3a3dd8b5946b446ebe5bdc1d66ca2ba0" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 38931 } } peers { permanent_uuid: "3c891714fdf240adbacf48c0375465f4" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 43569 } }
I20260808 14:50:17.792411 32689 raft_consensus.cc:374] T dd7a9fc114784422956c7e14759c03bd P 3c891714fdf240adbacf48c0375465f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:50:17.792528 32689 raft_consensus.cc:729] T dd7a9fc114784422956c7e14759c03bd P 3c891714fdf240adbacf48c0375465f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c891714fdf240adbacf48c0375465f4, State: Initialized, Role: FOLLOWER
I20260808 14:50:17.793109 32689 consensus_queue.cc:260] T dd7a9fc114784422956c7e14759c03bd P 3c891714fdf240adbacf48c0375465f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9ee1970ac5f4ccb860975f7200f5fa4" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 42819 } } peers { permanent_uuid: "3a3dd8b5946b446ebe5bdc1d66ca2ba0" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 38931 } } peers { permanent_uuid: "3c891714fdf240adbacf48c0375465f4" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 43569 } }
I20260808 14:50:17.794749 32689 ts_tablet_manager.cc:1428] T dd7a9fc114784422956c7e14759c03bd P 3c891714fdf240adbacf48c0375465f4: Time spent starting tablet: real 0.015s user 0.009s sys 0.004s
I20260808 14:50:17.795010 32670 heartbeater.cc:503] Master 127.26.206.254:37975 was elected leader, sending a full tablet report...
I20260808 14:50:17.796458 32691 raft_consensus.cc:348] T dd7a9fc114784422956c7e14759c03bd P e9ee1970ac5f4ccb860975f7200f5fa4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9ee1970ac5f4ccb860975f7200f5fa4" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 42819 } } peers { permanent_uuid: "3a3dd8b5946b446ebe5bdc1d66ca2ba0" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 38931 } } peers { permanent_uuid: "3c891714fdf240adbacf48c0375465f4" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 43569 } }
I20260808 14:50:17.796893 32691 raft_consensus.cc:374] T dd7a9fc114784422956c7e14759c03bd P e9ee1970ac5f4ccb860975f7200f5fa4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:50:17.797046 32691 raft_consensus.cc:729] T dd7a9fc114784422956c7e14759c03bd P e9ee1970ac5f4ccb860975f7200f5fa4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9ee1970ac5f4ccb860975f7200f5fa4, State: Initialized, Role: FOLLOWER
I20260808 14:50:17.797631 32691 consensus_queue.cc:260] T dd7a9fc114784422956c7e14759c03bd P e9ee1970ac5f4ccb860975f7200f5fa4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9ee1970ac5f4ccb860975f7200f5fa4" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 42819 } } peers { permanent_uuid: "3a3dd8b5946b446ebe5bdc1d66ca2ba0" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 38931 } } peers { permanent_uuid: "3c891714fdf240adbacf48c0375465f4" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 43569 } }
I20260808 14:50:17.799397 32691 ts_tablet_manager.cc:1428] T dd7a9fc114784422956c7e14759c03bd P e9ee1970ac5f4ccb860975f7200f5fa4: Time spent starting tablet: real 0.013s user 0.012s sys 0.000s
W20260808 14:50:17.880959 32375 tablet.cc:2369] T dd7a9fc114784422956c7e14759c03bd P e9ee1970ac5f4ccb860975f7200f5fa4: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 14:50:17.895830 32523 tablet.cc:2369] T dd7a9fc114784422956c7e14759c03bd P 3a3dd8b5946b446ebe5bdc1d66ca2ba0: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 14:50:17.921133 32671 tablet.cc:2369] T dd7a9fc114784422956c7e14759c03bd P 3c891714fdf240adbacf48c0375465f4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:50:18.041441 32700 raft_consensus.cc:482] T dd7a9fc114784422956c7e14759c03bd P e9ee1970ac5f4ccb860975f7200f5fa4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:50:18.041746 32700 raft_consensus.cc:504] T dd7a9fc114784422956c7e14759c03bd P e9ee1970ac5f4ccb860975f7200f5fa4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9ee1970ac5f4ccb860975f7200f5fa4" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 42819 } } peers { permanent_uuid: "3a3dd8b5946b446ebe5bdc1d66ca2ba0" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 38931 } } peers { permanent_uuid: "3c891714fdf240adbacf48c0375465f4" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 43569 } }
I20260808 14:50:18.043483 32700 leader_election.cc:288] T dd7a9fc114784422956c7e14759c03bd P e9ee1970ac5f4ccb860975f7200f5fa4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3a3dd8b5946b446ebe5bdc1d66ca2ba0 (127.26.206.194:38931), 3c891714fdf240adbacf48c0375465f4 (127.26.206.195:43569)
I20260808 14:50:18.051489 32686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:18.043880 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.193:57923 (local address 127.26.206.194:38931)
0808 14:50:18.044128 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:18.044137 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:18.044756 (+ 619us) server_negotiation.cc:407] Connection header received
0808 14:50:18.045016 (+ 260us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:18.045022 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:18.045091 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:18.045147 (+ 56us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:50:18.045974 (+ 827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:18.046992 (+ 1018us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:18.049231 (+ 2239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:18.050468 (+ 1237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:18.050611 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:18.050681 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:18.051090 (+ 409us) server_negotiation.cc:299] Negotiation successful
0808 14:50:18.051241 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260808 14:50:18.051944 32702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:18.044725 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.195:43569 (local address 127.26.206.193:49993)
0808 14:50:18.045665 (+ 940us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:18.045681 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 14:50:18.045844 (+ 163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:50:18.046309 (+ 465us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:50:18.046313 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:50:18.046340 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:50:18.046654 (+ 314us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:18.046665 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:18.048071 (+ 1406us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:18.048077 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:18.049775 (+ 1698us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:18.049786 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:18.051075 (+ 1289us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:18.051082 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:18.051252 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:18.051293 (+ 41us) client_negotiation.cc:769] Sending connection context
0808 14:50:18.051379 (+ 86us) client_negotiation.cc:240] Negotiation successful
0808 14:50:18.051519 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":839,"mutex_wait_us":28,"thread_start_us":603,"threads_started":1}
I20260808 14:50:18.052151 32688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:18.044867 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.193:49993 (local address 127.26.206.195:43569)
0808 14:50:18.045126 (+ 259us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:18.045134 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:18.045785 (+ 651us) server_negotiation.cc:407] Connection header received
0808 14:50:18.046073 (+ 288us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:18.046082 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:18.046164 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:18.046265 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:50:18.046817 (+ 552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:18.047924 (+ 1107us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:18.049929 (+ 2005us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:18.050853 (+ 924us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:18.051032 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:18.051109 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:18.051421 (+ 312us) server_negotiation.cc:299] Negotiation successful
0808 14:50:18.051804 (+ 383us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260808 14:50:18.052477 32701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:18.043904 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.194:38931 (local address 127.26.206.193:57923)
0808 14:50:18.044650 (+ 746us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:18.044675 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0808 14:50:18.044866 (+ 191us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:50:18.045347 (+ 481us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:50:18.045352 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:50:18.045376 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:50:18.045817 (+ 441us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:18.045830 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:18.047111 (+ 1281us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:18.047119 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:18.049052 (+ 1933us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:18.049068 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:18.050680 (+ 1612us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:18.050686 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:18.050878 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:18.050926 (+ 48us) client_negotiation.cc:769] Sending connection context
0808 14:50:18.051753 (+ 827us) client_negotiation.cc:240] Negotiation successful
0808 14:50:18.051902 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":608,"mutex_wait_us":1,"thread_start_us":401,"threads_started":1}
I20260808 14:50:18.052644 32696 raft_consensus.cc:482] T dd7a9fc114784422956c7e14759c03bd P 3a3dd8b5946b446ebe5bdc1d66ca2ba0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:50:18.052948 32696 raft_consensus.cc:504] T dd7a9fc114784422956c7e14759c03bd P 3a3dd8b5946b446ebe5bdc1d66ca2ba0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9ee1970ac5f4ccb860975f7200f5fa4" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 42819 } } peers { permanent_uuid: "3a3dd8b5946b446ebe5bdc1d66ca2ba0" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 38931 } } peers { permanent_uuid: "3c891714fdf240adbacf48c0375465f4" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 43569 } }
I20260808 14:50:18.053627 32620 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dd7a9fc114784422956c7e14759c03bd" candidate_uuid: "e9ee1970ac5f4ccb860975f7200f5fa4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c891714fdf240adbacf48c0375465f4" is_pre_election: true
I20260808 14:50:18.053635 32474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dd7a9fc114784422956c7e14759c03bd" candidate_uuid: "e9ee1970ac5f4ccb860975f7200f5fa4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a3dd8b5946b446ebe5bdc1d66ca2ba0" is_pre_election: true
I20260808 14:50:18.054122 32474 raft_consensus.cc:2454] T dd7a9fc114784422956c7e14759c03bd P 3a3dd8b5946b446ebe5bdc1d66ca2ba0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9ee1970ac5f4ccb860975f7200f5fa4 in term 0.
I20260808 14:50:18.054162 32620 raft_consensus.cc:2454] T dd7a9fc114784422956c7e14759c03bd P 3c891714fdf240adbacf48c0375465f4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9ee1970ac5f4ccb860975f7200f5fa4 in term 0.
I20260808 14:50:18.054877 32696 leader_election.cc:288] T dd7a9fc114784422956c7e14759c03bd P 3a3dd8b5946b446ebe5bdc1d66ca2ba0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e9ee1970ac5f4ccb860975f7200f5fa4 (127.26.206.193:42819), 3c891714fdf240adbacf48c0375465f4 (127.26.206.195:43569)
I20260808 14:50:18.055233 32245 leader_election.cc:302] T dd7a9fc114784422956c7e14759c03bd P e9ee1970ac5f4ccb860975f7200f5fa4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c891714fdf240adbacf48c0375465f4, e9ee1970ac5f4ccb860975f7200f5fa4; no voters:
I20260808 14:50:18.056077 32700 raft_consensus.cc:2781] T dd7a9fc114784422956c7e14759c03bd P e9ee1970ac5f4ccb860975f7200f5fa4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:50:18.056233 32700 raft_consensus.cc:482] T dd7a9fc114784422956c7e14759c03bd P e9ee1970ac5f4ccb860975f7200f5fa4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:50:18.056351 32700 raft_consensus.cc:3037] T dd7a9fc114784422956c7e14759c03bd P e9ee1970ac5f4ccb860975f7200f5fa4 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:50:18.059345 32700 raft_consensus.cc:504] T dd7a9fc114784422956c7e14759c03bd P e9ee1970ac5f4ccb860975f7200f5fa4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9ee1970ac5f4ccb860975f7200f5fa4" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 42819 } } peers { permanent_uuid: "3a3dd8b5946b446ebe5bdc1d66ca2ba0" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 38931 } } peers { permanent_uuid: "3c891714fdf240adbacf48c0375465f4" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 43569 } }
I20260808 14:50:18.060096 32700 leader_election.cc:288] T dd7a9fc114784422956c7e14759c03bd P e9ee1970ac5f4ccb860975f7200f5fa4 [CANDIDATE]: Term 1 election: Requested vote from peers 3a3dd8b5946b446ebe5bdc1d66ca2ba0 (127.26.206.194:38931), 3c891714fdf240adbacf48c0375465f4 (127.26.206.195:43569)
I20260808 14:50:18.060607 32620 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dd7a9fc114784422956c7e14759c03bd" candidate_uuid: "e9ee1970ac5f4ccb860975f7200f5fa4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c891714fdf240adbacf48c0375465f4"
I20260808 14:50:18.060698 32474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dd7a9fc114784422956c7e14759c03bd" candidate_uuid: "e9ee1970ac5f4ccb860975f7200f5fa4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a3dd8b5946b446ebe5bdc1d66ca2ba0"
I20260808 14:50:18.060827 32620 raft_consensus.cc:3037] T dd7a9fc114784422956c7e14759c03bd P 3c891714fdf240adbacf48c0375465f4 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:50:18.060909 32474 raft_consensus.cc:3037] T dd7a9fc114784422956c7e14759c03bd P 3a3dd8b5946b446ebe5bdc1d66ca2ba0 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:50:18.063198 32684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:18.055775 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.194:58561 (local address 127.26.206.193:42819)
0808 14:50:18.055962 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:18.055967 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:18.056071 (+ 104us) server_negotiation.cc:407] Connection header received
0808 14:50:18.056316 (+ 245us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:18.056321 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:18.056404 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:18.056491 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:50:18.057305 (+ 814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:18.058413 (+ 1108us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:18.060805 (+ 2392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:18.062012 (+ 1207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:18.062135 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:18.062209 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:18.062833 (+ 624us) server_negotiation.cc:299] Negotiation successful
0808 14:50:18.062964 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260808 14:50:18.064157 32703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:18.055317 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.193:42819 (local address 127.26.206.194:58561)
0808 14:50:18.055967 (+ 650us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:18.055988 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 14:50:18.056182 (+ 194us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:50:18.056640 (+ 458us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:50:18.056644 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:50:18.056672 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:50:18.057140 (+ 468us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:18.057152 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:18.058571 (+ 1419us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:18.058577 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:18.060607 (+ 2030us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:18.060620 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:18.062412 (+ 1792us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:18.062418 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:18.062621 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:18.062655 (+ 34us) client_negotiation.cc:769] Sending connection context
0808 14:50:18.063409 (+ 754us) client_negotiation.cc:240] Negotiation successful
0808 14:50:18.063582 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":532,"mutex_wait_us":6,"thread_start_us":650,"threads_started":1}
I20260808 14:50:18.064342 32620 raft_consensus.cc:2454] T dd7a9fc114784422956c7e14759c03bd P 3c891714fdf240adbacf48c0375465f4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9ee1970ac5f4ccb860975f7200f5fa4 in term 1.
I20260808 14:50:18.064466 32474 raft_consensus.cc:2454] T dd7a9fc114784422956c7e14759c03bd P 3a3dd8b5946b446ebe5bdc1d66ca2ba0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9ee1970ac5f4ccb860975f7200f5fa4 in term 1.
I20260808 14:50:18.064668 32704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:18.056372 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.195:43569 (local address 127.26.206.194:39153)
0808 14:50:18.057204 (+ 832us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:18.057227 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 14:50:18.057382 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:50:18.057676 (+ 294us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:50:18.057680 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:50:18.057702 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:50:18.057998 (+ 296us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:18.058005 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:18.059370 (+ 1365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:18.059376 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:18.061622 (+ 2246us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:18.061637 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:18.063541 (+ 1904us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:18.063547 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:18.063754 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:18.063901 (+ 147us) client_negotiation.cc:769] Sending connection context
0808 14:50:18.064038 (+ 137us) client_negotiation.cc:240] Negotiation successful
0808 14:50:18.064222 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":707,"mutex_wait_us":24,"thread_start_us":486,"threads_started":1}
I20260808 14:50:18.064774 32245 leader_election.cc:302] T dd7a9fc114784422956c7e14759c03bd P e9ee1970ac5f4ccb860975f7200f5fa4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c891714fdf240adbacf48c0375465f4, e9ee1970ac5f4ccb860975f7200f5fa4; no voters:
I20260808 14:50:18.065251 32688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:18.056511 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.194:39153 (local address 127.26.206.195:43569)
0808 14:50:18.056678 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:18.056687 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:18.057300 (+ 613us) server_negotiation.cc:407] Connection header received
0808 14:50:18.057501 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:18.057505 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:18.057563 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:18.057659 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:50:18.058131 (+ 472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:18.059206 (+ 1075us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:18.061815 (+ 2609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:18.063119 (+ 1304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:18.063254 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:18.063335 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:18.064843 (+ 1508us) server_negotiation.cc:299] Negotiation successful
0808 14:50:18.064986 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260808 14:50:18.065559 32324 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dd7a9fc114784422956c7e14759c03bd" candidate_uuid: "3a3dd8b5946b446ebe5bdc1d66ca2ba0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9ee1970ac5f4ccb860975f7200f5fa4" is_pre_election: true
I20260808 14:50:18.065886 32700 raft_consensus.cc:2781] T dd7a9fc114784422956c7e14759c03bd P e9ee1970ac5f4ccb860975f7200f5fa4 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:50:18.065922 32619 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dd7a9fc114784422956c7e14759c03bd" candidate_uuid: "3a3dd8b5946b446ebe5bdc1d66ca2ba0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c891714fdf240adbacf48c0375465f4" is_pre_election: true
I20260808 14:50:18.066419 32619 raft_consensus.cc:2379] T dd7a9fc114784422956c7e14759c03bd P 3c891714fdf240adbacf48c0375465f4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3a3dd8b5946b446ebe5bdc1d66ca2ba0 in current term 1: Already voted for candidate e9ee1970ac5f4ccb860975f7200f5fa4 in this term.
I20260808 14:50:18.066453 32700 raft_consensus.cc:686] T dd7a9fc114784422956c7e14759c03bd P e9ee1970ac5f4ccb860975f7200f5fa4 [term 1 LEADER]: Becoming Leader. State: Replica: e9ee1970ac5f4ccb860975f7200f5fa4, State: Running, Role: LEADER
I20260808 14:50:18.067031 32700 consensus_queue.cc:237] T dd7a9fc114784422956c7e14759c03bd P e9ee1970ac5f4ccb860975f7200f5fa4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9ee1970ac5f4ccb860975f7200f5fa4" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 42819 } } peers { permanent_uuid: "3a3dd8b5946b446ebe5bdc1d66ca2ba0" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 38931 } } peers { permanent_uuid: "3c891714fdf240adbacf48c0375465f4" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 43569 } }
I20260808 14:50:18.070935 32403 leader_election.cc:302] T dd7a9fc114784422956c7e14759c03bd P 3a3dd8b5946b446ebe5bdc1d66ca2ba0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3a3dd8b5946b446ebe5bdc1d66ca2ba0; no voters: 3c891714fdf240adbacf48c0375465f4, e9ee1970ac5f4ccb860975f7200f5fa4
I20260808 14:50:18.071342 32696 raft_consensus.cc:2726] T dd7a9fc114784422956c7e14759c03bd P 3a3dd8b5946b446ebe5bdc1d66ca2ba0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260808 14:50:18.072342 32155 catalog_manager.cc:5495] T dd7a9fc114784422956c7e14759c03bd P e9ee1970ac5f4ccb860975f7200f5fa4 reported cstate change: term changed from 0 to 1, leader changed from <none> to e9ee1970ac5f4ccb860975f7200f5fa4 (127.26.206.193). New cstate: current_term: 1 leader_uuid: "e9ee1970ac5f4ccb860975f7200f5fa4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9ee1970ac5f4ccb860975f7200f5fa4" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 42819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3a3dd8b5946b446ebe5bdc1d66ca2ba0" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 38931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c891714fdf240adbacf48c0375465f4" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 43569 } health_report { overall_health: UNKNOWN } } }
I20260808 14:50:18.122141 32684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:18.117085 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54552 (local address 127.26.206.193:42819)
0808 14:50:18.117243 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:18.117247 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:18.117433 (+ 186us) server_negotiation.cc:407] Connection header received
0808 14:50:18.117607 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:18.117611 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:18.117703 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:18.117844 (+ 141us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:50:18.118155 (+ 311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:18.118926 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:18.120285 (+ 1359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:18.120678 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:18.120775 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:18.121174 (+ 399us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:50:18.121652 (+ 478us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:50:18.121776 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:18.121836 (+ 60us) server_negotiation.cc:299] Negotiation successful
0808 14:50:18.121899 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260808 14:50:18.129966 32619 raft_consensus.cc:1261] T dd7a9fc114784422956c7e14759c03bd P 3c891714fdf240adbacf48c0375465f4 [term 1 FOLLOWER]: Refusing update from remote peer e9ee1970ac5f4ccb860975f7200f5fa4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:50:18.130020 32474 raft_consensus.cc:1261] T dd7a9fc114784422956c7e14759c03bd P 3a3dd8b5946b446ebe5bdc1d66ca2ba0 [term 1 FOLLOWER]: Refusing update from remote peer e9ee1970ac5f4ccb860975f7200f5fa4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:50:18.130925 32705 consensus_queue.cc:1035] T dd7a9fc114784422956c7e14759c03bd P e9ee1970ac5f4ccb860975f7200f5fa4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a3dd8b5946b446ebe5bdc1d66ca2ba0" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 38931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:50:18.131291 32700 consensus_queue.cc:1035] T dd7a9fc114784422956c7e14759c03bd P e9ee1970ac5f4ccb860975f7200f5fa4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c891714fdf240adbacf48c0375465f4" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 43569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:50:18.165781 32155 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35392:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:50:18.166077 32155 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35392:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:50:18.170060 32155 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e31edf40b38f427fb51cce62102dca39: Sending DeleteTablet for 3 replicas of tablet dd7a9fc114784422956c7e14759c03bd
I20260808 14:50:18.171330 32596 tablet_service.cc:1514] Processing DeleteTablet for tablet dd7a9fc114784422956c7e14759c03bd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:50:18 UTC) from {username='kudu', principal='kudu/127.26.206.254@KRBTEST.COM'} at 127.0.0.1:34092
I20260808 14:50:18.171834 32453 tablet_service.cc:1514] Processing DeleteTablet for tablet dd7a9fc114784422956c7e14759c03bd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:50:18 UTC) from {username='kudu', principal='kudu/127.26.206.254@KRBTEST.COM'} at 127.0.0.1:46410
I20260808 14:50:18.171542 32300 tablet_service.cc:1514] Processing DeleteTablet for tablet dd7a9fc114784422956c7e14759c03bd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:50:18 UTC) from {username='kudu', principal='kudu/127.26.206.254@KRBTEST.COM'} at 127.0.0.1:54538
I20260808 14:50:18.176666 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 32225
I20260808 14:50:18.179544 32723 tablet_replica.cc:330] T dd7a9fc114784422956c7e14759c03bd P e9ee1970ac5f4ccb860975f7200f5fa4: stopping tablet replica
I20260808 14:50:18.181200 32723 raft_consensus.cc:2229] T dd7a9fc114784422956c7e14759c03bd P e9ee1970ac5f4ccb860975f7200f5fa4 [term 1 LEADER]: Raft consensus shutting down.
I20260808 14:50:18.184180 32723 raft_consensus.cc:2258] T dd7a9fc114784422956c7e14759c03bd P e9ee1970ac5f4ccb860975f7200f5fa4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:50:18.187029 32723 ts_tablet_manager.cc:1905] T dd7a9fc114784422956c7e14759c03bd P e9ee1970ac5f4ccb860975f7200f5fa4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:50:18.190213 32722 tablet_replica.cc:330] T dd7a9fc114784422956c7e14759c03bd P 3a3dd8b5946b446ebe5bdc1d66ca2ba0: stopping tablet replica
I20260808 14:50:18.190778 32722 raft_consensus.cc:2229] T dd7a9fc114784422956c7e14759c03bd P 3a3dd8b5946b446ebe5bdc1d66ca2ba0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:50:18.191359 32722 raft_consensus.cc:2258] T dd7a9fc114784422956c7e14759c03bd P 3a3dd8b5946b446ebe5bdc1d66ca2ba0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:50:18.193612 32722 ts_tablet_manager.cc:1905] T dd7a9fc114784422956c7e14759c03bd P 3a3dd8b5946b446ebe5bdc1d66ca2ba0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:50:18.196321 32723 ts_tablet_manager.cc:1918] T dd7a9fc114784422956c7e14759c03bd P e9ee1970ac5f4ccb860975f7200f5fa4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:50:18.196496 32723 log.cc:1196] T dd7a9fc114784422956c7e14759c03bd P e9ee1970ac5f4ccb860975f7200f5fa4: Deleting WAL directory at /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200577490656-27451-0/minicluster-data/ts-0/wal/wals/dd7a9fc114784422956c7e14759c03bd
I20260808 14:50:18.197072 32723 ts_tablet_manager.cc:1939] T dd7a9fc114784422956c7e14759c03bd P e9ee1970ac5f4ccb860975f7200f5fa4: Deleting consensus metadata
I20260808 14:50:18.198968 32141 catalog_manager.cc:4841] TS e9ee1970ac5f4ccb860975f7200f5fa4 (127.26.206.193:42819): tablet dd7a9fc114784422956c7e14759c03bd (table test-table [id=0edd9edd1e854307b5b9e4dbc60068e9]) successfully deleted
I20260808 14:50:18.200984 32722 ts_tablet_manager.cc:1918] T dd7a9fc114784422956c7e14759c03bd P 3a3dd8b5946b446ebe5bdc1d66ca2ba0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:50:18.201283 32722 log.cc:1196] T dd7a9fc114784422956c7e14759c03bd P 3a3dd8b5946b446ebe5bdc1d66ca2ba0: Deleting WAL directory at /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200577490656-27451-0/minicluster-data/ts-1/wal/wals/dd7a9fc114784422956c7e14759c03bd
I20260808 14:50:18.201922 32722 ts_tablet_manager.cc:1939] T dd7a9fc114784422956c7e14759c03bd P 3a3dd8b5946b446ebe5bdc1d66ca2ba0: Deleting consensus metadata
I20260808 14:50:18.202921 32720 tablet_replica.cc:330] T dd7a9fc114784422956c7e14759c03bd P 3c891714fdf240adbacf48c0375465f4: stopping tablet replica
I20260808 14:50:18.203359 32720 raft_consensus.cc:2229] T dd7a9fc114784422956c7e14759c03bd P 3c891714fdf240adbacf48c0375465f4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:50:18.203807 32141 catalog_manager.cc:4841] TS 3a3dd8b5946b446ebe5bdc1d66ca2ba0 (127.26.206.194:38931): tablet dd7a9fc114784422956c7e14759c03bd (table test-table [id=0edd9edd1e854307b5b9e4dbc60068e9]) successfully deleted
I20260808 14:50:18.204305 32720 raft_consensus.cc:2258] T dd7a9fc114784422956c7e14759c03bd P 3c891714fdf240adbacf48c0375465f4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:50:18.205910 32720 ts_tablet_manager.cc:1905] T dd7a9fc114784422956c7e14759c03bd P 3c891714fdf240adbacf48c0375465f4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:50:18.211100 32720 ts_tablet_manager.cc:1918] T dd7a9fc114784422956c7e14759c03bd P 3c891714fdf240adbacf48c0375465f4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:50:18.211246 32720 log.cc:1196] T dd7a9fc114784422956c7e14759c03bd P 3c891714fdf240adbacf48c0375465f4: Deleting WAL directory at /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200577490656-27451-0/minicluster-data/ts-2/wal/wals/dd7a9fc114784422956c7e14759c03bd
Aug 08 14:50:18 dist-test-slave-6k22 krb5kdc[32109](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200615, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.206.193@KRBTEST.COM
I20260808 14:50:18.211915 32720 ts_tablet_manager.cc:1939] T dd7a9fc114784422956c7e14759c03bd P 3c891714fdf240adbacf48c0375465f4: Deleting consensus metadata
I20260808 14:50:18.213629 32141 catalog_manager.cc:4841] TS 3c891714fdf240adbacf48c0375465f4 (127.26.206.195:43569): tablet dd7a9fc114784422956c7e14759c03bd (table test-table [id=0edd9edd1e854307b5b9e4dbc60068e9]) successfully deleted
I20260808 14:50:18.219374 32684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:18.178118 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54560 (local address 127.26.206.193:42819)
0808 14:50:18.179612 (+ 1494us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:18.179619 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:18.200146 (+ 20527us) server_negotiation.cc:407] Connection header received
0808 14:50:18.200406 (+ 260us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:18.200412 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:18.200485 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:18.200549 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:18.203171 (+ 2622us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:18.204394 (+ 1223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:18.206492 (+ 2098us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:18.207146 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:18.207298 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:18.212518 (+ 5220us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:50:18.212534 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:50:18.212562 (+ 28us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:50:18.212618 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:50:18.216656 (+ 4038us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:18.217281 (+ 625us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:18.217290 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:18.217292 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:18.217440 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:18.217815 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:18.217821 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:18.217823 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:18.218182 (+ 359us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:50:18.218551 (+ 369us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:18.218812 (+ 261us) server_negotiation.cc:299] Negotiation successful
0808 14:50:18.219045 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1276}
I20260808 14:50:18.220162 32369 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:50:18.321343 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 32225
I20260808 14:50:18.343523 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 32382
Aug 08 14:50:18 dist-test-slave-6k22 krb5kdc[32109](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200615, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.206.194@KRBTEST.COM
I20260808 14:50:18.358062 32686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:18.344359 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46418 (local address 127.26.206.194:38931)
0808 14:50:18.344540 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:18.344547 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:18.344637 (+ 90us) server_negotiation.cc:407] Connection header received
0808 14:50:18.344854 (+ 217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:18.344860 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:18.344943 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:18.345056 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:18.346241 (+ 1185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:18.346939 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:18.348376 (+ 1437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:18.348792 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:18.348906 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:18.352852 (+ 3946us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:50:18.352864 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:50:18.352878 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:50:18.352911 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:50:18.355772 (+ 2861us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:18.356360 (+ 588us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:18.356367 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:18.356369 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:18.356499 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:18.356813 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:18.356816 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:18.356818 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:18.357132 (+ 314us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:50:18.357392 (+ 260us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:18.357608 (+ 216us) server_negotiation.cc:299] Negotiation successful
0808 14:50:18.357769 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260808 14:50:18.358704 32516 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:50:18.449188 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 32382
I20260808 14:50:18.470677 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 32528
Aug 08 14:50:18 dist-test-slave-6k22 krb5kdc[32109](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200615, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.206.195@KRBTEST.COM
I20260808 14:50:18.485559 32688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:18.471439 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43014 (local address 127.26.206.195:43569)
0808 14:50:18.471638 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:18.471643 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:18.471661 (+ 18us) server_negotiation.cc:407] Connection header received
0808 14:50:18.471789 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:18.471793 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:18.471865 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:18.471944 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:18.473233 (+ 1289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:18.473887 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:18.475102 (+ 1215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:18.475510 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:18.475713 (+ 203us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:18.480089 (+ 4376us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:50:18.480103 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:50:18.480120 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:50:18.480152 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:50:18.482851 (+ 2699us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:18.483476 (+ 625us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:18.483484 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:18.483486 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:18.483664 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:18.484045 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:18.484049 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:18.484050 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:18.484519 (+ 469us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:50:18.484801 (+ 282us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:18.485096 (+ 295us) server_negotiation.cc:299] Negotiation successful
0808 14:50:18.485310 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260808 14:50:18.486280 32665 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:50:18.578611 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 32528
I20260808 14:50:18.599238 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 32123
I20260808 14:50:18.600466 32191 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:50:18.710273 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 32123
2026-08-08T14:50:18Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (4474 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-08T14:50:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:50:18Z Disabled control of system clock
I20260808 14:50:18.787887 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200577490656-27451-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200577490656-27451-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200577490656-27451-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.206.254:41331
--webserver_interface=127.26.206.254
--webserver_port=0
--builtin_ntp_servers=127.26.206.212:40529
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.206.254:41331
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260808 14:50:19.113584 32732 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:50:19.113873 32732 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:50:19.113958 32732 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:50:19.121024 32732 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:50:19.121124 32732 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:50:19.121169 32732 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:50:19.121227 32732 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:50:19.121270 32732 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:50:19.130040 32732 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:40529
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200577490656-27451-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200577490656-27451-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.206.254:41331
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.206.254:41331
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.206.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200577490656-27451-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:50:19.131193 32732 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:50:19.132982 32732 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:50:19.144227 32741 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:50:19.144335 32740 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:50:19.144167 32743 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:50:19.145587 32732 server_base.cc:1034] running on GCE node
I20260808 14:50:19.146373 32732 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:50:19.147691 32732 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:50:19.148896 32732 hybrid_clock.cc:648] HybridClock initialized: now 1786200619148842 us; error 49 us; skew 500 ppm
I20260808 14:50:19.149240 32732 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 14:50:19.151414 32732 webserver.cc:460] Webserver started at http://127.26.206.254:46793/ using document root <none> and password file <none>
I20260808 14:50:19.152143 32732 fs_manager.cc:359] Metadata directory not provided
I20260808 14:50:19.152258 32732 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:50:19.152590 32732 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:50:19.155405 32732 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200577490656-27451-0/minicluster-data/master-0/data/instance:
uuid: "87ccf13c88c8433087c098b086930dda"
format_stamp: "Formatted at 2026-08-08 14:50:19 on dist-test-slave-6k22"
server_key: "e0054c8fbb99b1e60e60c3de63b388f3"
server_key_iv: "ac2309eb6a4a1be8c3ec842b94ac0a39"
server_key_version: "encryptionkey@0"
I20260808 14:50:19.156236 32732 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200577490656-27451-0/minicluster-data/master-0/wal/instance:
uuid: "87ccf13c88c8433087c098b086930dda"
format_stamp: "Formatted at 2026-08-08 14:50:19 on dist-test-slave-6k22"
server_key: "e0054c8fbb99b1e60e60c3de63b388f3"
server_key_iv: "ac2309eb6a4a1be8c3ec842b94ac0a39"
server_key_version: "encryptionkey@0"
I20260808 14:50:19.161115 32732 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 14:50:19.164496 32750 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:50:19.165738 32732 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260808 14:50:19.165917 32732 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200577490656-27451-0/minicluster-data/master-0/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200577490656-27451-0/minicluster-data/master-0/wal
uuid: "87ccf13c88c8433087c098b086930dda"
format_stamp: "Formatted at 2026-08-08 14:50:19 on dist-test-slave-6k22"
server_key: "e0054c8fbb99b1e60e60c3de63b388f3"
server_key_iv: "ac2309eb6a4a1be8c3ec842b94ac0a39"
server_key_version: "encryptionkey@0"
I20260808 14:50:19.166117 32732 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200577490656-27451-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200577490656-27451-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200577490656-27451-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:50:19.171674 32732 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:50:19.172387 32732 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:50:19.172708 32732 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:50:19.191430 32732 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.254:41331
I20260808 14:50:19.191470 336 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.254:41331 every 8 connection(s)
I20260808 14:50:19.192991 32732 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
I20260808 14:50:19.196594 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 32732
I20260808 14:50:19.196830 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200577490656-27451-0/minicluster-data/master-0/wal/instance
I20260808 14:50:19.197197 339 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:50:19.197731 27451 external_mini_cluster.cc:1428] Setting key ca2f66a591b39bcc244ae9f44999a2d9
I20260808 14:50:19.207367 343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:19.199888 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38534 (local address 127.26.206.254:41331)
0808 14:50:19.200950 (+ 1062us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:19.200960 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:19.201002 (+ 42us) server_negotiation.cc:407] Connection header received
0808 14:50:19.203703 (+ 2701us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:19.203727 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:19.204138 (+ 411us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:19.204478 (+ 340us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:19.205597 (+ 1119us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:50:19.205603 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:50:19.205614 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:50:19.205628 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:50:19.205709 (+ 81us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:50:19.205726 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:50:19.205891 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:19.205991 (+ 100us) server_negotiation.cc:299] Negotiation successful
0808 14:50:19.206266 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":644,"thread_start_us":424,"threads_started":1}
I20260808 14:50:19.211776 339 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 87ccf13c88c8433087c098b086930dda: Bootstrap starting.
I20260808 14:50:19.215242 339 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 87ccf13c88c8433087c098b086930dda: Neither blocks nor log segments found. Creating new log.
I20260808 14:50:19.216719 339 log.cc:824] T 00000000000000000000000000000000 P 87ccf13c88c8433087c098b086930dda: Log is configured to *not* fsync() on all Append() calls
I20260808 14:50:19.219875 339 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 87ccf13c88c8433087c098b086930dda: No bootstrap required, opened a new log
I20260808 14:50:19.227089 339 raft_consensus.cc:348] T 00000000000000000000000000000000 P 87ccf13c88c8433087c098b086930dda [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87ccf13c88c8433087c098b086930dda" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 41331 } }
I20260808 14:50:19.227447 339 raft_consensus.cc:374] T 00000000000000000000000000000000 P 87ccf13c88c8433087c098b086930dda [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:50:19.227556 339 raft_consensus.cc:729] T 00000000000000000000000000000000 P 87ccf13c88c8433087c098b086930dda [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87ccf13c88c8433087c098b086930dda, State: Initialized, Role: FOLLOWER
I20260808 14:50:19.228184 339 consensus_queue.cc:260] T 00000000000000000000000000000000 P 87ccf13c88c8433087c098b086930dda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87ccf13c88c8433087c098b086930dda" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 41331 } }
I20260808 14:50:19.228415 339 raft_consensus.cc:388] T 00000000000000000000000000000000 P 87ccf13c88c8433087c098b086930dda [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:50:19.228555 339 raft_consensus.cc:482] T 00000000000000000000000000000000 P 87ccf13c88c8433087c098b086930dda [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:50:19.228732 339 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 87ccf13c88c8433087c098b086930dda [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:50:19.230777 339 raft_consensus.cc:504] T 00000000000000000000000000000000 P 87ccf13c88c8433087c098b086930dda [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87ccf13c88c8433087c098b086930dda" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 41331 } }
I20260808 14:50:19.231251 339 leader_election.cc:302] T 00000000000000000000000000000000 P 87ccf13c88c8433087c098b086930dda [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 87ccf13c88c8433087c098b086930dda; no voters:
I20260808 14:50:19.231889 339 leader_election.cc:288] T 00000000000000000000000000000000 P 87ccf13c88c8433087c098b086930dda [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:50:19.232057 345 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 87ccf13c88c8433087c098b086930dda [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:50:19.232781 345 raft_consensus.cc:686] T 00000000000000000000000000000000 P 87ccf13c88c8433087c098b086930dda [term 1 LEADER]: Becoming Leader. State: Replica: 87ccf13c88c8433087c098b086930dda, State: Running, Role: LEADER
I20260808 14:50:19.233357 345 consensus_queue.cc:237] T 00000000000000000000000000000000 P 87ccf13c88c8433087c098b086930dda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87ccf13c88c8433087c098b086930dda" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 41331 } }
I20260808 14:50:19.234110 339 sys_catalog.cc:564] T 00000000000000000000000000000000 P 87ccf13c88c8433087c098b086930dda [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:50:19.236349 347 sys_catalog.cc:455] T 00000000000000000000000000000000 P 87ccf13c88c8433087c098b086930dda [sys.catalog]: SysCatalogTable state changed. Reason: New leader 87ccf13c88c8433087c098b086930dda. Latest consensus state: current_term: 1 leader_uuid: "87ccf13c88c8433087c098b086930dda" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87ccf13c88c8433087c098b086930dda" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 41331 } } }
I20260808 14:50:19.236857 347 sys_catalog.cc:458] T 00000000000000000000000000000000 P 87ccf13c88c8433087c098b086930dda [sys.catalog]: This master's current role is: LEADER
I20260808 14:50:19.236712 346 sys_catalog.cc:455] T 00000000000000000000000000000000 P 87ccf13c88c8433087c098b086930dda [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "87ccf13c88c8433087c098b086930dda" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87ccf13c88c8433087c098b086930dda" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 41331 } } }
I20260808 14:50:19.237047 346 sys_catalog.cc:458] T 00000000000000000000000000000000 P 87ccf13c88c8433087c098b086930dda [sys.catalog]: This master's current role is: LEADER
I20260808 14:50:19.238660 354 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:50:19.243407 354 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:50:19.251725 354 catalog_manager.cc:1347] Generated new cluster ID: e869d42dbcf34453aa615bdf98487215
I20260808 14:50:19.251866 354 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:50:19.259274 354 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:50:19.259743 354 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:50:19.273033 354 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 87ccf13c88c8433087c098b086930dda: Generated new TSK 0
I20260808 14:50:19.274041 354 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:50:19.293306 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200577490656-27451-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200577490656-27451-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200577490656-27451-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200577490656-27451-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.206.193:0
--local_ip_for_outbound_sockets=127.26.206.193
--webserver_interface=127.26.206.193
--webserver_port=0
--tserver_master_addrs=127.26.206.254:41331
--builtin_ntp_servers=127.26.206.212:40529
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260808 14:50:19.625888 365 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:50:19.626157 365 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:50:19.626303 365 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:50:19.633555 365 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:50:19.633664 365 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:50:19.633885 365 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.206.193
I20260808 14:50:19.643113 365 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:40529
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200577490656-27451-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200577490656-27451-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.206.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200577490656-27451-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.206.193
--webserver_port=0
--tserver_master_addrs=127.26.206.254:41331
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.206.193
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200577490656-27451-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:50:19.644462 365 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:50:19.646257 365 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:50:19.659691 371 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:50:19.659781 370 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:50:19.659741 373 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:50:19.660688 365 server_base.cc:1034] running on GCE node
I20260808 14:50:19.661248 365 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:50:19.662201 365 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:50:19.663415 365 hybrid_clock.cc:648] HybridClock initialized: now 1786200619663357 us; error 48 us; skew 500 ppm
I20260808 14:50:19.663764 365 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 14:50:19.665827 365 webserver.cc:460] Webserver started at http://127.26.206.193:42443/ using document root <none> and password file <none>
I20260808 14:50:19.666494 365 fs_manager.cc:359] Metadata directory not provided
I20260808 14:50:19.666617 365 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:50:19.666932 365 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:50:19.669840 365 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200577490656-27451-0/minicluster-data/ts-0/data/instance:
uuid: "7ded9c782a1a4cc5b70f8e72b588c974"
format_stamp: "Formatted at 2026-08-08 14:50:19 on dist-test-slave-6k22"
server_key: "35ee0fbc3446d1af1b057282f2473fd8"
server_key_iv: "314c857f9c82b3a55477a18d9f3f8c88"
server_key_version: "encryptionkey@0"
I20260808 14:50:19.670706 365 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200577490656-27451-0/minicluster-data/ts-0/wal/instance:
uuid: "7ded9c782a1a4cc5b70f8e72b588c974"
format_stamp: "Formatted at 2026-08-08 14:50:19 on dist-test-slave-6k22"
server_key: "35ee0fbc3446d1af1b057282f2473fd8"
server_key_iv: "314c857f9c82b3a55477a18d9f3f8c88"
server_key_version: "encryptionkey@0"
I20260808 14:50:19.675900 365 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.008s sys 0.000s
I20260808 14:50:19.679136 379 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:50:19.680382 365 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 14:50:19.680555 365 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200577490656-27451-0/minicluster-data/ts-0/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200577490656-27451-0/minicluster-data/ts-0/wal
uuid: "7ded9c782a1a4cc5b70f8e72b588c974"
format_stamp: "Formatted at 2026-08-08 14:50:19 on dist-test-slave-6k22"
server_key: "35ee0fbc3446d1af1b057282f2473fd8"
server_key_iv: "314c857f9c82b3a55477a18d9f3f8c88"
server_key_version: "encryptionkey@0"
I20260808 14:50:19.680770 365 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200577490656-27451-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200577490656-27451-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200577490656-27451-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:50:19.686112 365 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:50:19.686858 365 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:50:19.687116 365 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:50:19.688040 365 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:50:19.689356 365 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:50:19.689471 365 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:50:19.689595 365 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:50:19.689697 365 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:50:19.722585 365 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.193:41777
I20260808 14:50:19.722635 505 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.193:41777 every 8 connection(s)
I20260808 14:50:19.724062 365 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200577490656-27451-0/minicluster-data/ts-0/data/info.pb
I20260808 14:50:19.727890 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 365
I20260808 14:50:19.728112 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200577490656-27451-0/minicluster-data/ts-0/wal/instance
I20260808 14:50:19.728847 27451 external_mini_cluster.cc:1428] Setting key 1fc425961e6cfb85312f58a8d86d15f2
I20260808 14:50:19.731769 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200577490656-27451-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200577490656-27451-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200577490656-27451-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200577490656-27451-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.206.194:0
--local_ip_for_outbound_sockets=127.26.206.194
--webserver_interface=127.26.206.194
--webserver_port=0
--tserver_master_addrs=127.26.206.254:41331
--builtin_ntp_servers=127.26.206.212:40529
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260808 14:50:19.732596 508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:19.726654 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.193:57871 (local address 127.26.206.254:41331)
0808 14:50:19.727086 (+ 432us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:19.727091 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:19.728383 (+ 1292us) server_negotiation.cc:407] Connection header received
0808 14:50:19.730156 (+ 1773us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:19.730162 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:19.730243 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:19.730361 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:19.731734 (+ 1373us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:50:19.731739 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:50:19.731745 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:50:19.731765 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:50:19.731811 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:50:19.731823 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:50:19.731966 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:19.732223 (+ 257us) server_negotiation.cc:299] Negotiation successful
0808 14:50:19.732291 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":318,"thread_start_us":212,"threads_started":1}
I20260808 14:50:19.733474 509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:19.727254 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:41331 (local address 127.26.206.193:57871)
0808 14:50:19.728215 (+ 961us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:19.728250 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0808 14:50:19.729899 (+ 1649us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:50:19.730609 (+ 710us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:50:19.730617 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:50:19.730705 (+ 88us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:50:19.731397 (+ 692us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 14:50:19.731399 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:50:19.731434 (+ 35us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 14:50:19.731509 (+ 75us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:50:19.732027 (+ 518us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:50:19.732035 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:50:19.732041 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 14:50:19.732308 (+ 267us) client_negotiation.cc:240] Negotiation successful
0808 14:50:19.732547 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":554,"thread_start_us":369,"threads_started":1}
I20260808 14:50:19.735004 506 heartbeater.cc:347] Connected to a master server at 127.26.206.254:41331
I20260808 14:50:19.735292 506 heartbeater.cc:464] Registering TS with master...
I20260808 14:50:19.735873 506 heartbeater.cc:511] Master 127.26.206.254:41331 requested a full tablet report, sending...
I20260808 14:50:19.738044 32767 ts_manager.cc:194] Registered new tserver with Master: 7ded9c782a1a4cc5b70f8e72b588c974 (127.26.206.193:41777)
W20260808 14:50:20.065919 510 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:50:20.066217 510 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:50:20.066396 510 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:50:20.073760 510 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:50:20.073891 510 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:50:20.074070 510 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.206.194
I20260808 14:50:20.083021 510 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:40529
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200577490656-27451-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200577490656-27451-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.206.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200577490656-27451-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.206.194
--webserver_port=0
--tserver_master_addrs=127.26.206.254:41331
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.206.194
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200577490656-27451-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:50:20.084316 510 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:50:20.086051 510 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:50:20.098568 518 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:50:20.098649 516 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:50:20.098609 515 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:50:20.099727 510 server_base.cc:1034] running on GCE node
I20260808 14:50:20.100292 510 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:50:20.101176 510 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:50:20.102396 510 hybrid_clock.cc:648] HybridClock initialized: now 1786200620102338 us; error 48 us; skew 500 ppm
I20260808 14:50:20.102692 510 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 14:50:20.104907 510 webserver.cc:460] Webserver started at http://127.26.206.194:39067/ using document root <none> and password file <none>
I20260808 14:50:20.105559 510 fs_manager.cc:359] Metadata directory not provided
I20260808 14:50:20.105690 510 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:50:20.106033 510 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:50:20.108783 510 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200577490656-27451-0/minicluster-data/ts-1/data/instance:
uuid: "26eb14918f6e46babdd2e377c7635f6b"
format_stamp: "Formatted at 2026-08-08 14:50:20 on dist-test-slave-6k22"
server_key: "89860152785bad94d066ad0387679c78"
server_key_iv: "02473998dd427b4dfd9f470696b01a02"
server_key_version: "encryptionkey@0"
I20260808 14:50:20.109557 510 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200577490656-27451-0/minicluster-data/ts-1/wal/instance:
uuid: "26eb14918f6e46babdd2e377c7635f6b"
format_stamp: "Formatted at 2026-08-08 14:50:20 on dist-test-slave-6k22"
server_key: "89860152785bad94d066ad0387679c78"
server_key_iv: "02473998dd427b4dfd9f470696b01a02"
server_key_version: "encryptionkey@0"
I20260808 14:50:20.114529 510 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.005s
I20260808 14:50:20.117738 524 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:50:20.118917 510 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260808 14:50:20.119092 510 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200577490656-27451-0/minicluster-data/ts-1/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200577490656-27451-0/minicluster-data/ts-1/wal
uuid: "26eb14918f6e46babdd2e377c7635f6b"
format_stamp: "Formatted at 2026-08-08 14:50:20 on dist-test-slave-6k22"
server_key: "89860152785bad94d066ad0387679c78"
server_key_iv: "02473998dd427b4dfd9f470696b01a02"
server_key_version: "encryptionkey@0"
I20260808 14:50:20.119307 510 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200577490656-27451-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200577490656-27451-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200577490656-27451-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:50:20.124694 510 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:50:20.125432 510 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:50:20.125707 510 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:50:20.126536 510 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:50:20.127956 510 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:50:20.128078 510 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:50:20.128213 510 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:50:20.128302 510 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:50:20.161388 510 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.194:36803
I20260808 14:50:20.161473 651 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.194:36803 every 8 connection(s)
I20260808 14:50:20.162670 510 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200577490656-27451-0/minicluster-data/ts-1/data/info.pb
I20260808 14:50:20.165477 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 510
I20260808 14:50:20.165675 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200577490656-27451-0/minicluster-data/ts-1/wal/instance
I20260808 14:50:20.166163 27451 external_mini_cluster.cc:1428] Setting key a3ac2b78527187befa4c8729ad4db652
I20260808 14:50:20.169373 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200577490656-27451-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200577490656-27451-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200577490656-27451-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200577490656-27451-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.206.195:0
--local_ip_for_outbound_sockets=127.26.206.195
--webserver_interface=127.26.206.195
--webserver_port=0
--tserver_master_addrs=127.26.206.254:41331
--builtin_ntp_servers=127.26.206.212:40529
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260808 14:50:20.171968 508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:20.165341 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.194:56403 (local address 127.26.206.254:41331)
0808 14:50:20.165550 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:20.165557 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:20.167182 (+ 1625us) server_negotiation.cc:407] Connection header received
0808 14:50:20.169550 (+ 2368us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:20.169558 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:20.169625 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:20.169733 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:20.171109 (+ 1376us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:50:20.171117 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:50:20.171124 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:50:20.171145 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:50:20.171188 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:50:20.171206 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:50:20.171356 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:20.171578 (+ 222us) server_negotiation.cc:299] Negotiation successful
0808 14:50:20.171646 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260808 14:50:20.172951 655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:20.165888 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:41331 (local address 127.26.206.194:56403)
0808 14:50:20.167017 (+ 1129us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:20.167074 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0808 14:50:20.169262 (+ 2188us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:50:20.169963 (+ 701us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:50:20.169970 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:50:20.170051 (+ 81us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:50:20.170777 (+ 726us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 14:50:20.170780 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:50:20.170814 (+ 34us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 14:50:20.170938 (+ 124us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:50:20.171328 (+ 390us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:50:20.171335 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:50:20.171341 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 14:50:20.171638 (+ 297us) client_negotiation.cc:240] Negotiation successful
0808 14:50:20.171832 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":554,"thread_start_us":329,"threads_started":1}
I20260808 14:50:20.178695 652 heartbeater.cc:347] Connected to a master server at 127.26.206.254:41331
I20260808 14:50:20.179049 652 heartbeater.cc:464] Registering TS with master...
I20260808 14:50:20.179858 652 heartbeater.cc:511] Master 127.26.206.254:41331 requested a full tablet report, sending...
I20260808 14:50:20.183905 32767 ts_manager.cc:194] Registered new tserver with Master: 26eb14918f6e46babdd2e377c7635f6b (127.26.206.194:36803)
W20260808 14:50:20.505119 656 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:50:20.505386 656 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:50:20.505471 656 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:50:20.512439 656 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:50:20.512537 656 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:50:20.512661 656 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.206.195
I20260808 14:50:20.521404 656 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:40529
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200577490656-27451-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200577490656-27451-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.206.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200577490656-27451-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.206.195
--webserver_port=0
--tserver_master_addrs=127.26.206.254:41331
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.206.195
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200577490656-27451-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:50:20.522626 656 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:50:20.524490 656 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:50:20.537456 661 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:50:20.537540 662 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:50:20.537583 664 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:50:20.538364 656 server_base.cc:1034] running on GCE node
I20260808 14:50:20.538975 656 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:50:20.539928 656 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:50:20.541131 656 hybrid_clock.cc:648] HybridClock initialized: now 1786200620541092 us; error 35 us; skew 500 ppm
I20260808 14:50:20.541448 656 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 14:50:20.543629 656 webserver.cc:460] Webserver started at http://127.26.206.195:41981/ using document root <none> and password file <none>
I20260808 14:50:20.544307 656 fs_manager.cc:359] Metadata directory not provided
I20260808 14:50:20.544426 656 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:50:20.544766 656 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:50:20.547652 656 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200577490656-27451-0/minicluster-data/ts-2/data/instance:
uuid: "fe6b9796306f4c5890ba6fd86b4b1eed"
format_stamp: "Formatted at 2026-08-08 14:50:20 on dist-test-slave-6k22"
server_key: "24c9592a780adc29493388738acd0f1f"
server_key_iv: "8e425e382dfeeca0d59f17ad062653f0"
server_key_version: "encryptionkey@0"
I20260808 14:50:20.548434 656 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200577490656-27451-0/minicluster-data/ts-2/wal/instance:
uuid: "fe6b9796306f4c5890ba6fd86b4b1eed"
format_stamp: "Formatted at 2026-08-08 14:50:20 on dist-test-slave-6k22"
server_key: "24c9592a780adc29493388738acd0f1f"
server_key_iv: "8e425e382dfeeca0d59f17ad062653f0"
server_key_version: "encryptionkey@0"
I20260808 14:50:20.553299 656 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.004s
I20260808 14:50:20.556533 670 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:50:20.557745 656 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260808 14:50:20.557924 656 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200577490656-27451-0/minicluster-data/ts-2/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200577490656-27451-0/minicluster-data/ts-2/wal
uuid: "fe6b9796306f4c5890ba6fd86b4b1eed"
format_stamp: "Formatted at 2026-08-08 14:50:20 on dist-test-slave-6k22"
server_key: "24c9592a780adc29493388738acd0f1f"
server_key_iv: "8e425e382dfeeca0d59f17ad062653f0"
server_key_version: "encryptionkey@0"
I20260808 14:50:20.558147 656 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200577490656-27451-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200577490656-27451-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200577490656-27451-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:50:20.563687 656 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:50:20.564446 656 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:50:20.564720 656 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:50:20.565608 656 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:50:20.566926 656 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:50:20.567046 656 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:50:20.567173 656 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:50:20.567269 656 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:50:20.600522 656 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.195:39779
I20260808 14:50:20.600574 804 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.195:39779 every 8 connection(s)
I20260808 14:50:20.601936 656 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200577490656-27451-0/minicluster-data/ts-2/data/info.pb
I20260808 14:50:20.606362 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 656
I20260808 14:50:20.606544 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200577490656-27451-0/minicluster-data/ts-2/wal/instance
I20260808 14:50:20.606978 27451 external_mini_cluster.cc:1428] Setting key 0ee373005220f6036319a259a0e72535
I20260808 14:50:20.610424 508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:20.604519 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.195:41455 (local address 127.26.206.254:41331)
0808 14:50:20.604721 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:20.604725 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:20.606035 (+ 1310us) server_negotiation.cc:407] Connection header received
0808 14:50:20.608035 (+ 2000us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:20.608039 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:20.608090 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:20.608203 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:20.609682 (+ 1479us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:50:20.609686 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:50:20.609689 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:50:20.609704 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:50:20.609733 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:50:20.609747 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:50:20.609849 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:20.610091 (+ 242us) server_negotiation.cc:299] Negotiation successful
0808 14:50:20.610140 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260808 14:50:20.611343 807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:20.604968 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:41331 (local address 127.26.206.195:41455)
0808 14:50:20.605873 (+ 905us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:20.605908 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0808 14:50:20.607752 (+ 1844us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:50:20.608478 (+ 726us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:50:20.608486 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:50:20.608576 (+ 90us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:50:20.609342 (+ 766us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 14:50:20.609346 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:50:20.609395 (+ 49us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 14:50:20.609513 (+ 118us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:50:20.609858 (+ 345us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:50:20.609868 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:50:20.609876 (+ 8us) client_negotiation.cc:769] Sending connection context
0808 14:50:20.610183 (+ 307us) client_negotiation.cc:240] Negotiation successful
0808 14:50:20.610410 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":469,"thread_start_us":275,"threads_started":1}
I20260808 14:50:20.612944 805 heartbeater.cc:347] Connected to a master server at 127.26.206.254:41331
I20260808 14:50:20.613287 805 heartbeater.cc:464] Registering TS with master...
I20260808 14:50:20.613811 805 heartbeater.cc:511] Master 127.26.206.254:41331 requested a full tablet report, sending...
I20260808 14:50:20.615060 32767 ts_manager.cc:194] Registered new tserver with Master: fe6b9796306f4c5890ba6fd86b4b1eed (127.26.206.195:39779)
I20260808 14:50:20.622444 27451 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 14:50:20.629504 508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:20.626835 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38550 (local address 127.26.206.254:41331)
0808 14:50:20.627008 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:20.627017 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:20.627476 (+ 459us) server_negotiation.cc:407] Connection header received
0808 14:50:20.627720 (+ 244us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:20.627725 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:20.627798 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:20.627899 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:20.628845 (+ 946us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:50:20.628850 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:50:20.628854 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:50:20.628872 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:50:20.628913 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:50:20.628925 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:50:20.629045 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:20.629180 (+ 135us) server_negotiation.cc:299] Negotiation successful
0808 14:50:20.629243 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260808 14:50:20.633345 32767 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38550:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:50:20.640434 32767 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:50:20.657646 820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:20.652061 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.195:39779 (local address 127.0.0.1:43302)
0808 14:50:20.653122 (+ 1061us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:20.653192 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0808 14:50:20.653355 (+ 163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:50:20.654495 (+ 1140us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:50:20.654504 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:50:20.654592 (+ 88us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:50:20.655477 (+ 885us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 14:50:20.655480 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:50:20.655516 (+ 36us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 14:50:20.655619 (+ 103us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:50:20.656814 (+ 1195us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:50:20.656826 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:50:20.656834 (+ 8us) client_negotiation.cc:769] Sending connection context
0808 14:50:20.657010 (+ 176us) client_negotiation.cc:240] Negotiation successful
0808 14:50:20.657102 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":893,"thread_start_us":1158,"threads_started":1}
I20260808 14:50:20.658164 819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:20.652003 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38442 (local address 127.26.206.193:41777)
0808 14:50:20.652621 (+ 618us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:20.652641 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:20.654152 (+ 1511us) server_negotiation.cc:407] Connection header received
0808 14:50:20.654421 (+ 269us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:20.654432 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:20.654625 (+ 193us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:20.654754 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:20.657062 (+ 2308us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:50:20.657070 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:50:20.657081 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:50:20.657099 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:50:20.657154 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:50:20.657173 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:50:20.657279 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:20.657749 (+ 470us) server_negotiation.cc:299] Negotiation successful
0808 14:50:20.657858 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":456,"thread_start_us":323,"threads_started":1}
I20260808 14:50:20.659085 818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:20.651818 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.193:41777 (local address 127.0.0.1:38442)
0808 14:50:20.653122 (+ 1304us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:20.653191 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0808 14:50:20.654257 (+ 1066us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:50:20.656164 (+ 1907us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:50:20.656169 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:50:20.656191 (+ 22us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:50:20.656831 (+ 640us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 14:50:20.656834 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:50:20.656849 (+ 15us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 14:50:20.656886 (+ 37us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:50:20.657370 (+ 484us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:50:20.657378 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:50:20.657383 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 14:50:20.657532 (+ 149us) client_negotiation.cc:240] Negotiation successful
0808 14:50:20.657585 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1039,"thread_start_us":823,"threads_started":1}
I20260808 14:50:20.659149 821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:20.652812 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43302 (local address 127.26.206.195:39779)
0808 14:50:20.653917 (+ 1105us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:20.653924 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:20.653958 (+ 34us) server_negotiation.cc:407] Connection header received
0808 14:50:20.654030 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:20.654038 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:20.654304 (+ 266us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:20.655051 (+ 747us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:20.656540 (+ 1489us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:50:20.656550 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:50:20.656566 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:50:20.656586 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:50:20.656649 (+ 63us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:50:20.656675 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:50:20.658593 (+ 1918us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:20.658671 (+ 78us) server_negotiation.cc:299] Negotiation successful
0808 14:50:20.658760 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":940,"thread_start_us":779,"threads_started":1}
I20260808 14:50:20.662846 820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:20.653496 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.194:36803 (local address 127.0.0.1:53688)
0808 14:50:20.658842 (+ 5346us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:20.658859 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 14:50:20.658932 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:50:20.660648 (+ 1716us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:50:20.660654 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:50:20.660699 (+ 45us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:50:20.661265 (+ 566us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 14:50:20.661268 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:50:20.661287 (+ 19us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 14:50:20.661329 (+ 42us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:50:20.662433 (+ 1104us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:50:20.662441 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:50:20.662447 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 14:50:20.662540 (+ 93us) client_negotiation.cc:240] Negotiation successful
0808 14:50:20.662588 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5248,"thread_start_us":6040,"threads_started":1}
I20260808 14:50:20.663194 823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:20.654122 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53688 (local address 127.26.206.194:36803)
0808 14:50:20.660113 (+ 5991us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:20.660122 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:20.660153 (+ 31us) server_negotiation.cc:407] Connection header received
0808 14:50:20.660222 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:20.660232 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:20.660464 (+ 232us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:20.660964 (+ 500us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:20.662171 (+ 1207us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:50:20.662176 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:50:20.662184 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:50:20.662200 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:50:20.662234 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:50:20.662245 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:50:20.662487 (+ 242us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:20.662568 (+ 81us) server_negotiation.cc:299] Negotiation successful
0808 14:50:20.662654 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5819,"thread_start_us":5672,"threads_started":1}
I20260808 14:50:20.663231 729 tablet_service.cc:1467] Processing CreateTablet for tablet ed3b8ae24c514c09aa4b11859f191a7c (DEFAULT_TABLE table=test-table [id=8d72e5ef19864c819ccdd89c99b36c0a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:50:20.663558 436 tablet_service.cc:1467] Processing CreateTablet for tablet ed3b8ae24c514c09aa4b11859f191a7c (DEFAULT_TABLE table=test-table [id=8d72e5ef19864c819ccdd89c99b36c0a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:50:20.664916 436 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ed3b8ae24c514c09aa4b11859f191a7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:50:20.664916 729 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ed3b8ae24c514c09aa4b11859f191a7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:50:20.666266 578 tablet_service.cc:1467] Processing CreateTablet for tablet ed3b8ae24c514c09aa4b11859f191a7c (DEFAULT_TABLE table=test-table [id=8d72e5ef19864c819ccdd89c99b36c0a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:50:20.667508 578 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ed3b8ae24c514c09aa4b11859f191a7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:50:20.679178 824 tablet_bootstrap.cc:492] T ed3b8ae24c514c09aa4b11859f191a7c P 26eb14918f6e46babdd2e377c7635f6b: Bootstrap starting.
I20260808 14:50:20.681120 825 tablet_bootstrap.cc:492] T ed3b8ae24c514c09aa4b11859f191a7c P 7ded9c782a1a4cc5b70f8e72b588c974: Bootstrap starting.
I20260808 14:50:20.681912 826 tablet_bootstrap.cc:492] T ed3b8ae24c514c09aa4b11859f191a7c P fe6b9796306f4c5890ba6fd86b4b1eed: Bootstrap starting.
I20260808 14:50:20.683874 824 tablet_bootstrap.cc:654] T ed3b8ae24c514c09aa4b11859f191a7c P 26eb14918f6e46babdd2e377c7635f6b: Neither blocks nor log segments found. Creating new log.
I20260808 14:50:20.684849 825 tablet_bootstrap.cc:654] T ed3b8ae24c514c09aa4b11859f191a7c P 7ded9c782a1a4cc5b70f8e72b588c974: Neither blocks nor log segments found. Creating new log.
I20260808 14:50:20.685177 824 log.cc:824] T ed3b8ae24c514c09aa4b11859f191a7c P 26eb14918f6e46babdd2e377c7635f6b: Log is configured to *not* fsync() on all Append() calls
I20260808 14:50:20.685361 826 tablet_bootstrap.cc:654] T ed3b8ae24c514c09aa4b11859f191a7c P fe6b9796306f4c5890ba6fd86b4b1eed: Neither blocks nor log segments found. Creating new log.
I20260808 14:50:20.686012 825 log.cc:824] T ed3b8ae24c514c09aa4b11859f191a7c P 7ded9c782a1a4cc5b70f8e72b588c974: Log is configured to *not* fsync() on all Append() calls
I20260808 14:50:20.686489 826 log.cc:824] T ed3b8ae24c514c09aa4b11859f191a7c P fe6b9796306f4c5890ba6fd86b4b1eed: Log is configured to *not* fsync() on all Append() calls
I20260808 14:50:20.688390 824 tablet_bootstrap.cc:492] T ed3b8ae24c514c09aa4b11859f191a7c P 26eb14918f6e46babdd2e377c7635f6b: No bootstrap required, opened a new log
I20260808 14:50:20.688664 824 ts_tablet_manager.cc:1397] T ed3b8ae24c514c09aa4b11859f191a7c P 26eb14918f6e46babdd2e377c7635f6b: Time spent bootstrapping tablet: real 0.010s user 0.004s sys 0.003s
I20260808 14:50:20.689013 825 tablet_bootstrap.cc:492] T ed3b8ae24c514c09aa4b11859f191a7c P 7ded9c782a1a4cc5b70f8e72b588c974: No bootstrap required, opened a new log
I20260808 14:50:20.689288 825 ts_tablet_manager.cc:1397] T ed3b8ae24c514c09aa4b11859f191a7c P 7ded9c782a1a4cc5b70f8e72b588c974: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.000s
I20260808 14:50:20.689652 826 tablet_bootstrap.cc:492] T ed3b8ae24c514c09aa4b11859f191a7c P fe6b9796306f4c5890ba6fd86b4b1eed: No bootstrap required, opened a new log
I20260808 14:50:20.689927 826 ts_tablet_manager.cc:1397] T ed3b8ae24c514c09aa4b11859f191a7c P fe6b9796306f4c5890ba6fd86b4b1eed: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.006s
I20260808 14:50:20.696404 824 raft_consensus.cc:348] T ed3b8ae24c514c09aa4b11859f191a7c P 26eb14918f6e46babdd2e377c7635f6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ded9c782a1a4cc5b70f8e72b588c974" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 41777 } } peers { permanent_uuid: "fe6b9796306f4c5890ba6fd86b4b1eed" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 39779 } } peers { permanent_uuid: "26eb14918f6e46babdd2e377c7635f6b" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 36803 } }
I20260808 14:50:20.696797 824 raft_consensus.cc:374] T ed3b8ae24c514c09aa4b11859f191a7c P 26eb14918f6e46babdd2e377c7635f6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:50:20.696925 824 raft_consensus.cc:729] T ed3b8ae24c514c09aa4b11859f191a7c P 26eb14918f6e46babdd2e377c7635f6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26eb14918f6e46babdd2e377c7635f6b, State: Initialized, Role: FOLLOWER
I20260808 14:50:20.697549 824 consensus_queue.cc:260] T ed3b8ae24c514c09aa4b11859f191a7c P 26eb14918f6e46babdd2e377c7635f6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ded9c782a1a4cc5b70f8e72b588c974" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 41777 } } peers { permanent_uuid: "fe6b9796306f4c5890ba6fd86b4b1eed" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 39779 } } peers { permanent_uuid: "26eb14918f6e46babdd2e377c7635f6b" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 36803 } }
I20260808 14:50:20.698624 652 heartbeater.cc:503] Master 127.26.206.254:41331 was elected leader, sending a full tablet report...
I20260808 14:50:20.699148 824 ts_tablet_manager.cc:1428] T ed3b8ae24c514c09aa4b11859f191a7c P 26eb14918f6e46babdd2e377c7635f6b: Time spent starting tablet: real 0.010s user 0.010s sys 0.000s
I20260808 14:50:20.699826 825 raft_consensus.cc:348] T ed3b8ae24c514c09aa4b11859f191a7c P 7ded9c782a1a4cc5b70f8e72b588c974 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ded9c782a1a4cc5b70f8e72b588c974" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 41777 } } peers { permanent_uuid: "fe6b9796306f4c5890ba6fd86b4b1eed" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 39779 } } peers { permanent_uuid: "26eb14918f6e46babdd2e377c7635f6b" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 36803 } }
I20260808 14:50:20.700233 825 raft_consensus.cc:374] T ed3b8ae24c514c09aa4b11859f191a7c P 7ded9c782a1a4cc5b70f8e72b588c974 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:50:20.700352 825 raft_consensus.cc:729] T ed3b8ae24c514c09aa4b11859f191a7c P 7ded9c782a1a4cc5b70f8e72b588c974 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ded9c782a1a4cc5b70f8e72b588c974, State: Initialized, Role: FOLLOWER
I20260808 14:50:20.700911 825 consensus_queue.cc:260] T ed3b8ae24c514c09aa4b11859f191a7c P 7ded9c782a1a4cc5b70f8e72b588c974 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ded9c782a1a4cc5b70f8e72b588c974" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 41777 } } peers { permanent_uuid: "fe6b9796306f4c5890ba6fd86b4b1eed" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 39779 } } peers { permanent_uuid: "26eb14918f6e46babdd2e377c7635f6b" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 36803 } }
I20260808 14:50:20.701306 826 raft_consensus.cc:348] T ed3b8ae24c514c09aa4b11859f191a7c P fe6b9796306f4c5890ba6fd86b4b1eed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ded9c782a1a4cc5b70f8e72b588c974" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 41777 } } peers { permanent_uuid: "fe6b9796306f4c5890ba6fd86b4b1eed" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 39779 } } peers { permanent_uuid: "26eb14918f6e46babdd2e377c7635f6b" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 36803 } }
I20260808 14:50:20.701733 826 raft_consensus.cc:374] T ed3b8ae24c514c09aa4b11859f191a7c P fe6b9796306f4c5890ba6fd86b4b1eed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:50:20.701866 826 raft_consensus.cc:729] T ed3b8ae24c514c09aa4b11859f191a7c P fe6b9796306f4c5890ba6fd86b4b1eed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe6b9796306f4c5890ba6fd86b4b1eed, State: Initialized, Role: FOLLOWER
I20260808 14:50:20.702394 826 consensus_queue.cc:260] T ed3b8ae24c514c09aa4b11859f191a7c P fe6b9796306f4c5890ba6fd86b4b1eed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ded9c782a1a4cc5b70f8e72b588c974" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 41777 } } peers { permanent_uuid: "fe6b9796306f4c5890ba6fd86b4b1eed" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 39779 } } peers { permanent_uuid: "26eb14918f6e46babdd2e377c7635f6b" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 36803 } }
I20260808 14:50:20.703514 506 heartbeater.cc:503] Master 127.26.206.254:41331 was elected leader, sending a full tablet report...
I20260808 14:50:20.704181 825 ts_tablet_manager.cc:1428] T ed3b8ae24c514c09aa4b11859f191a7c P 7ded9c782a1a4cc5b70f8e72b588c974: Time spent starting tablet: real 0.015s user 0.012s sys 0.004s
I20260808 14:50:20.704994 805 heartbeater.cc:503] Master 127.26.206.254:41331 was elected leader, sending a full tablet report...
I20260808 14:50:20.705633 826 ts_tablet_manager.cc:1428] T ed3b8ae24c514c09aa4b11859f191a7c P fe6b9796306f4c5890ba6fd86b4b1eed: Time spent starting tablet: real 0.016s user 0.014s sys 0.001s
W20260808 14:50:20.726343 507 tablet.cc:2369] T ed3b8ae24c514c09aa4b11859f191a7c P 7ded9c782a1a4cc5b70f8e72b588c974: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 14:50:20.854000 806 tablet.cc:2369] T ed3b8ae24c514c09aa4b11859f191a7c P fe6b9796306f4c5890ba6fd86b4b1eed: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 14:50:20.914831 653 tablet.cc:2369] T ed3b8ae24c514c09aa4b11859f191a7c P 26eb14918f6e46babdd2e377c7635f6b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:50:21.057986 831 raft_consensus.cc:482] T ed3b8ae24c514c09aa4b11859f191a7c P 7ded9c782a1a4cc5b70f8e72b588c974 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:50:21.058336 831 raft_consensus.cc:504] T ed3b8ae24c514c09aa4b11859f191a7c P 7ded9c782a1a4cc5b70f8e72b588c974 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ded9c782a1a4cc5b70f8e72b588c974" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 41777 } } peers { permanent_uuid: "fe6b9796306f4c5890ba6fd86b4b1eed" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 39779 } } peers { permanent_uuid: "26eb14918f6e46babdd2e377c7635f6b" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 36803 } }
I20260808 14:50:21.060351 831 leader_election.cc:288] T ed3b8ae24c514c09aa4b11859f191a7c P 7ded9c782a1a4cc5b70f8e72b588c974 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe6b9796306f4c5890ba6fd86b4b1eed (127.26.206.195:39779), 26eb14918f6e46babdd2e377c7635f6b (127.26.206.194:36803)
I20260808 14:50:21.063608 821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:21.060724 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.193:56185 (local address 127.26.206.195:39779)
0808 14:50:21.060956 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:21.060965 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:21.061587 (+ 622us) server_negotiation.cc:407] Connection header received
0808 14:50:21.061758 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:21.061764 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:21.061832 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:21.061930 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:21.062897 (+ 967us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:50:21.062902 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:50:21.062906 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:50:21.062923 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:50:21.062961 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:50:21.062972 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:50:21.063090 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:21.063229 (+ 139us) server_negotiation.cc:299] Negotiation successful
0808 14:50:21.063303 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260808 14:50:21.063831 833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:21.060508 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.195:39779 (local address 127.26.206.193:56185)
0808 14:50:21.061436 (+ 928us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:21.061463 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0808 14:50:21.061607 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:50:21.061954 (+ 347us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:50:21.061958 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:50:21.061995 (+ 37us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:50:21.062705 (+ 710us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 14:50:21.062708 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:50:21.062721 (+ 13us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 14:50:21.062758 (+ 37us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:50:21.063074 (+ 316us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:50:21.063078 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:50:21.063083 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 14:50:21.063262 (+ 179us) client_negotiation.cc:240] Negotiation successful
0808 14:50:21.063312 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":685,"thread_start_us":440,"threads_started":1}
I20260808 14:50:21.063858 823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:21.061267 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.193:43061 (local address 127.26.206.194:36803)
0808 14:50:21.061474 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:21.061480 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:21.061768 (+ 288us) server_negotiation.cc:407] Connection header received
0808 14:50:21.061931 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:21.061936 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:21.062005 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:21.062112 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:21.063170 (+ 1058us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:50:21.063175 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:50:21.063179 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:50:21.063196 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:50:21.063236 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:50:21.063247 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:50:21.063380 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:21.063476 (+ 96us) server_negotiation.cc:299] Negotiation successful
0808 14:50:21.063541 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260808 14:50:21.064091 834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:21.060842 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.194:36803 (local address 127.26.206.193:43061)
0808 14:50:21.061617 (+ 775us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:21.061634 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 14:50:21.061793 (+ 159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:50:21.062150 (+ 357us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:50:21.062154 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:50:21.062180 (+ 26us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:50:21.062962 (+ 782us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 14:50:21.062964 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:50:21.062978 (+ 14us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 14:50:21.063013 (+ 35us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:50:21.063349 (+ 336us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:50:21.063357 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:50:21.063363 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 14:50:21.063522 (+ 159us) client_negotiation.cc:240] Negotiation successful
0808 14:50:21.063597 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":637,"thread_start_us":481,"threads_started":1}
I20260808 14:50:21.064952 753 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed3b8ae24c514c09aa4b11859f191a7c" candidate_uuid: "7ded9c782a1a4cc5b70f8e72b588c974" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe6b9796306f4c5890ba6fd86b4b1eed" is_pre_election: true
I20260808 14:50:21.064951 601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed3b8ae24c514c09aa4b11859f191a7c" candidate_uuid: "7ded9c782a1a4cc5b70f8e72b588c974" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26eb14918f6e46babdd2e377c7635f6b" is_pre_election: true
I20260808 14:50:21.065413 753 raft_consensus.cc:2454] T ed3b8ae24c514c09aa4b11859f191a7c P fe6b9796306f4c5890ba6fd86b4b1eed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ded9c782a1a4cc5b70f8e72b588c974 in term 0.
I20260808 14:50:21.065474 601 raft_consensus.cc:2454] T ed3b8ae24c514c09aa4b11859f191a7c P 26eb14918f6e46babdd2e377c7635f6b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ded9c782a1a4cc5b70f8e72b588c974 in term 0.
I20260808 14:50:21.066054 382 leader_election.cc:302] T ed3b8ae24c514c09aa4b11859f191a7c P 7ded9c782a1a4cc5b70f8e72b588c974 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ded9c782a1a4cc5b70f8e72b588c974, fe6b9796306f4c5890ba6fd86b4b1eed; no voters:
I20260808 14:50:21.066449 831 raft_consensus.cc:2781] T ed3b8ae24c514c09aa4b11859f191a7c P 7ded9c782a1a4cc5b70f8e72b588c974 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:50:21.066599 831 raft_consensus.cc:482] T ed3b8ae24c514c09aa4b11859f191a7c P 7ded9c782a1a4cc5b70f8e72b588c974 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:50:21.066702 831 raft_consensus.cc:3037] T ed3b8ae24c514c09aa4b11859f191a7c P 7ded9c782a1a4cc5b70f8e72b588c974 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:50:21.068966 831 raft_consensus.cc:504] T ed3b8ae24c514c09aa4b11859f191a7c P 7ded9c782a1a4cc5b70f8e72b588c974 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ded9c782a1a4cc5b70f8e72b588c974" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 41777 } } peers { permanent_uuid: "fe6b9796306f4c5890ba6fd86b4b1eed" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 39779 } } peers { permanent_uuid: "26eb14918f6e46babdd2e377c7635f6b" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 36803 } }
I20260808 14:50:21.069620 831 leader_election.cc:288] T ed3b8ae24c514c09aa4b11859f191a7c P 7ded9c782a1a4cc5b70f8e72b588c974 [CANDIDATE]: Term 1 election: Requested vote from peers fe6b9796306f4c5890ba6fd86b4b1eed (127.26.206.195:39779), 26eb14918f6e46babdd2e377c7635f6b (127.26.206.194:36803)
I20260808 14:50:21.070070 753 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed3b8ae24c514c09aa4b11859f191a7c" candidate_uuid: "7ded9c782a1a4cc5b70f8e72b588c974" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe6b9796306f4c5890ba6fd86b4b1eed"
I20260808 14:50:21.070188 601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed3b8ae24c514c09aa4b11859f191a7c" candidate_uuid: "7ded9c782a1a4cc5b70f8e72b588c974" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26eb14918f6e46babdd2e377c7635f6b"
I20260808 14:50:21.070294 753 raft_consensus.cc:3037] T ed3b8ae24c514c09aa4b11859f191a7c P fe6b9796306f4c5890ba6fd86b4b1eed [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:50:21.070434 601 raft_consensus.cc:3037] T ed3b8ae24c514c09aa4b11859f191a7c P 26eb14918f6e46babdd2e377c7635f6b [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:50:21.072613 753 raft_consensus.cc:2454] T ed3b8ae24c514c09aa4b11859f191a7c P fe6b9796306f4c5890ba6fd86b4b1eed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ded9c782a1a4cc5b70f8e72b588c974 in term 1.
I20260808 14:50:21.072752 601 raft_consensus.cc:2454] T ed3b8ae24c514c09aa4b11859f191a7c P 26eb14918f6e46babdd2e377c7635f6b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ded9c782a1a4cc5b70f8e72b588c974 in term 1.
I20260808 14:50:21.073030 382 leader_election.cc:302] T ed3b8ae24c514c09aa4b11859f191a7c P 7ded9c782a1a4cc5b70f8e72b588c974 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ded9c782a1a4cc5b70f8e72b588c974, fe6b9796306f4c5890ba6fd86b4b1eed; no voters:
I20260808 14:50:21.073319 831 raft_consensus.cc:2781] T ed3b8ae24c514c09aa4b11859f191a7c P 7ded9c782a1a4cc5b70f8e72b588c974 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:50:21.073805 831 raft_consensus.cc:686] T ed3b8ae24c514c09aa4b11859f191a7c P 7ded9c782a1a4cc5b70f8e72b588c974 [term 1 LEADER]: Becoming Leader. State: Replica: 7ded9c782a1a4cc5b70f8e72b588c974, State: Running, Role: LEADER
I20260808 14:50:21.074386 831 consensus_queue.cc:237] T ed3b8ae24c514c09aa4b11859f191a7c P 7ded9c782a1a4cc5b70f8e72b588c974 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ded9c782a1a4cc5b70f8e72b588c974" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 41777 } } peers { permanent_uuid: "fe6b9796306f4c5890ba6fd86b4b1eed" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 39779 } } peers { permanent_uuid: "26eb14918f6e46babdd2e377c7635f6b" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 36803 } }
I20260808 14:50:21.079041 32767 catalog_manager.cc:5495] T ed3b8ae24c514c09aa4b11859f191a7c P 7ded9c782a1a4cc5b70f8e72b588c974 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7ded9c782a1a4cc5b70f8e72b588c974 (127.26.206.193). New cstate: current_term: 1 leader_uuid: "7ded9c782a1a4cc5b70f8e72b588c974" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ded9c782a1a4cc5b70f8e72b588c974" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 41777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe6b9796306f4c5890ba6fd86b4b1eed" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 39779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "26eb14918f6e46babdd2e377c7635f6b" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 36803 } health_report { overall_health: UNKNOWN } } }
I20260808 14:50:21.113736 819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:21.111908 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38444 (local address 127.26.206.193:41777)
0808 14:50:21.112124 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:21.112129 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:21.112146 (+ 17us) server_negotiation.cc:407] Connection header received
0808 14:50:21.112270 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:21.112274 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:21.112352 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:21.112436 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:21.113227 (+ 791us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:50:21.113231 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:50:21.113234 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:50:21.113249 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:50:21.113287 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:50:21.113299 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:50:21.113386 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:21.113478 (+ 92us) server_negotiation.cc:299] Negotiation successful
0808 14:50:21.113523 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260808 14:50:21.122112 753 raft_consensus.cc:1261] T ed3b8ae24c514c09aa4b11859f191a7c P fe6b9796306f4c5890ba6fd86b4b1eed [term 1 FOLLOWER]: Refusing update from remote peer 7ded9c782a1a4cc5b70f8e72b588c974: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:50:21.122112 601 raft_consensus.cc:1261] T ed3b8ae24c514c09aa4b11859f191a7c P 26eb14918f6e46babdd2e377c7635f6b [term 1 FOLLOWER]: Refusing update from remote peer 7ded9c782a1a4cc5b70f8e72b588c974: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:50:21.123181 838 consensus_queue.cc:1035] T ed3b8ae24c514c09aa4b11859f191a7c P 7ded9c782a1a4cc5b70f8e72b588c974 [LEADER]: Connected to new peer: Peer: permanent_uuid: "26eb14918f6e46babdd2e377c7635f6b" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 36803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:50:21.123504 831 consensus_queue.cc:1035] T ed3b8ae24c514c09aa4b11859f191a7c P 7ded9c782a1a4cc5b70f8e72b588c974 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe6b9796306f4c5890ba6fd86b4b1eed" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 39779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:50:21.134832 841 mvcc.cc:205] Tried to move back new op lower bound from 7316277744105758720 to 7316277743924736000. Current Snapshot: MvccSnapshot[applied={T|T < 7316277744105758720}]
I20260808 14:50:21.137631 842 mvcc.cc:205] Tried to move back new op lower bound from 7316277744105758720 to 7316277743924736000. Current Snapshot: MvccSnapshot[applied={T|T < 7316277744105758720}]
I20260808 14:50:21.150099 32767 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:38550:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:50:21.150352 32767 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:38550:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:50:21.153796 32767 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 87ccf13c88c8433087c098b086930dda: Sending DeleteTablet for 3 replicas of tablet ed3b8ae24c514c09aa4b11859f191a7c
I20260808 14:50:21.155025 436 tablet_service.cc:1514] Processing DeleteTablet for tablet ed3b8ae24c514c09aa4b11859f191a7c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:50:21 UTC) from {username='slave'} at 127.0.0.1:38442
I20260808 14:50:21.155138 729 tablet_service.cc:1514] Processing DeleteTablet for tablet ed3b8ae24c514c09aa4b11859f191a7c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:50:21 UTC) from {username='slave'} at 127.0.0.1:43302
I20260808 14:50:21.156054 578 tablet_service.cc:1514] Processing DeleteTablet for tablet ed3b8ae24c514c09aa4b11859f191a7c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:50:21 UTC) from {username='slave'} at 127.0.0.1:53688
I20260808 14:50:21.156867 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 365
I20260808 14:50:21.156883 853 tablet_replica.cc:330] T ed3b8ae24c514c09aa4b11859f191a7c P fe6b9796306f4c5890ba6fd86b4b1eed: stopping tablet replica
I20260808 14:50:21.157528 853 raft_consensus.cc:2229] T ed3b8ae24c514c09aa4b11859f191a7c P fe6b9796306f4c5890ba6fd86b4b1eed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:50:21.158177 853 raft_consensus.cc:2258] T ed3b8ae24c514c09aa4b11859f191a7c P fe6b9796306f4c5890ba6fd86b4b1eed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:50:21.161437 852 tablet_replica.cc:330] T ed3b8ae24c514c09aa4b11859f191a7c P 7ded9c782a1a4cc5b70f8e72b588c974: stopping tablet replica
I20260808 14:50:21.162380 853 ts_tablet_manager.cc:1905] T ed3b8ae24c514c09aa4b11859f191a7c P fe6b9796306f4c5890ba6fd86b4b1eed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:50:21.164575 819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:21.158219 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38446 (local address 127.26.206.193:41777)
0808 14:50:21.158458 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:21.158467 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:21.161617 (+ 3150us) server_negotiation.cc:407] Connection header received
0808 14:50:21.161855 (+ 238us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:21.161860 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:21.161943 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:21.162015 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:21.163618 (+ 1603us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:50:21.163626 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:50:21.163634 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:50:21.163656 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:50:21.163703 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:50:21.163723 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:50:21.163836 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:21.164141 (+ 305us) server_negotiation.cc:299] Negotiation successful
0808 14:50:21.164200 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260808 14:50:21.162843 852 raft_consensus.cc:2229] T ed3b8ae24c514c09aa4b11859f191a7c P 7ded9c782a1a4cc5b70f8e72b588c974 [term 1 LEADER]: Raft consensus shutting down.
I20260808 14:50:21.173111 853 ts_tablet_manager.cc:1918] T ed3b8ae24c514c09aa4b11859f191a7c P fe6b9796306f4c5890ba6fd86b4b1eed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:50:21.173285 853 log.cc:1196] T ed3b8ae24c514c09aa4b11859f191a7c P fe6b9796306f4c5890ba6fd86b4b1eed: Deleting WAL directory at /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200577490656-27451-0/minicluster-data/ts-2/wal/wals/ed3b8ae24c514c09aa4b11859f191a7c
I20260808 14:50:21.173904 853 ts_tablet_manager.cc:1939] T ed3b8ae24c514c09aa4b11859f191a7c P fe6b9796306f4c5890ba6fd86b4b1eed: Deleting consensus metadata
I20260808 14:50:21.176108 852 raft_consensus.cc:2258] T ed3b8ae24c514c09aa4b11859f191a7c P 7ded9c782a1a4cc5b70f8e72b588c974 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:50:21.176039 32753 catalog_manager.cc:4841] TS fe6b9796306f4c5890ba6fd86b4b1eed (127.26.206.195:39779): tablet ed3b8ae24c514c09aa4b11859f191a7c (table test-table [id=8d72e5ef19864c819ccdd89c99b36c0a]) successfully deleted
I20260808 14:50:21.176715 501 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:50:21.177085 854 tablet_replica.cc:330] T ed3b8ae24c514c09aa4b11859f191a7c P 26eb14918f6e46babdd2e377c7635f6b: stopping tablet replica
I20260808 14:50:21.177544 854 raft_consensus.cc:2229] T ed3b8ae24c514c09aa4b11859f191a7c P 26eb14918f6e46babdd2e377c7635f6b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:50:21.178227 854 raft_consensus.cc:2258] T ed3b8ae24c514c09aa4b11859f191a7c P 26eb14918f6e46babdd2e377c7635f6b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:50:21.180383 854 ts_tablet_manager.cc:1905] T ed3b8ae24c514c09aa4b11859f191a7c P 26eb14918f6e46babdd2e377c7635f6b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:50:21.185840 854 ts_tablet_manager.cc:1918] T ed3b8ae24c514c09aa4b11859f191a7c P 26eb14918f6e46babdd2e377c7635f6b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:50:21.186029 854 log.cc:1196] T ed3b8ae24c514c09aa4b11859f191a7c P 26eb14918f6e46babdd2e377c7635f6b: Deleting WAL directory at /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200577490656-27451-0/minicluster-data/ts-1/wal/wals/ed3b8ae24c514c09aa4b11859f191a7c
I20260808 14:50:21.186470 854 ts_tablet_manager.cc:1939] T ed3b8ae24c514c09aa4b11859f191a7c P 26eb14918f6e46babdd2e377c7635f6b: Deleting consensus metadata
I20260808 14:50:21.187917 32754 catalog_manager.cc:4841] TS 26eb14918f6e46babdd2e377c7635f6b (127.26.206.194:36803): tablet ed3b8ae24c514c09aa4b11859f191a7c (table test-table [id=8d72e5ef19864c819ccdd89c99b36c0a]) successfully deleted
I20260808 14:50:21.273692 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 365
I20260808 14:50:21.294638 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 510
W20260808 14:50:21.294732 32754 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.26.206.193:41777 (error 108)
I20260808 14:50:21.297147 860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:21.296243 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.193:41777 (local address 127.0.0.1:38460)
0808 14:50:21.296732 (+ 489us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:21.296938 (+ 206us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.193:41777: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":332,"thread_start_us":236,"threads_started":1}
W20260808 14:50:21.297515 32754 catalog_manager.cc:4584] TS 7ded9c782a1a4cc5b70f8e72b588c974 (127.26.206.193:41777): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet ed3b8ae24c514c09aa4b11859f191a7c: Network error: Client connection negotiation failed: client connection to 127.26.206.193:41777: connect: Connection refused (error 111)
I20260808 14:50:21.298033 823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:21.295575 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53692 (local address 127.26.206.194:36803)
0808 14:50:21.295778 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:21.295784 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:21.295835 (+ 51us) server_negotiation.cc:407] Connection header received
0808 14:50:21.296090 (+ 255us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:21.296095 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:21.296197 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:21.296290 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:21.297399 (+ 1109us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:50:21.297410 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:50:21.297414 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:50:21.297435 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:50:21.297471 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:50:21.297482 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:50:21.297615 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:21.297714 (+ 99us) server_negotiation.cc:299] Negotiation successful
0808 14:50:21.297778 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260808 14:50:21.298655 647 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:50:21.351173 860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:21.350702 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.193:41777 (local address 127.0.0.1:38470)
0808 14:50:21.350921 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:21.351031 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.193:41777: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":89}
I20260808 14:50:21.352270 860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:21.351910 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.193:41777 (local address 127.0.0.1:38472)
0808 14:50:21.352060 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:21.352147 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.193:41777: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260808 14:50:21.390021 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 510
I20260808 14:50:21.410128 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 656
I20260808 14:50:21.412932 860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:21.412501 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.193:41777 (local address 127.0.0.1:38478)
0808 14:50:21.412670 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:21.412746 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.193:41777: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
I20260808 14:50:21.413144 821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:21.410922 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43304 (local address 127.26.206.195:39779)
0808 14:50:21.411133 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:21.411138 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:21.411156 (+ 18us) server_negotiation.cc:407] Connection header received
0808 14:50:21.411271 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:21.411284 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:21.411375 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:21.411461 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:21.412461 (+ 1000us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:50:21.412467 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:50:21.412473 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:50:21.412494 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:50:21.412532 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:50:21.412544 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:50:21.412680 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:21.412778 (+ 98us) server_negotiation.cc:299] Negotiation successful
0808 14:50:21.412844 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":93}
I20260808 14:50:21.413861 799 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:50:21.414551 860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:21.413564 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.193:41777 (local address 127.0.0.1:38484)
0808 14:50:21.414207 (+ 643us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:21.414352 (+ 145us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.193:41777: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":454}
I20260808 14:50:21.495393 860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:21.494899 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.193:41777 (local address 127.0.0.1:38500)
0808 14:50:21.495132 (+ 233us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:21.495231 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.193:41777: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":93}
I20260808 14:50:21.496531 860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:21.496131 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.193:41777 (local address 127.0.0.1:38510)
0808 14:50:21.496325 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:21.496392 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.193:41777: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":92}
I20260808 14:50:21.500968 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 656
I20260808 14:50:21.520206 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 32732
I20260808 14:50:21.521375 331 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:50:21.628324 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 32732
2026-08-08T14:50:21Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (2921 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260808 14:50:21.678586 27451 mini_oidc.cc:152] Starting JWKS server
I20260808 14:50:21.681528 27451 webserver.cc:460] Webserver started at https://127.0.0.1:39577/ using document root <none> and password file <none>
I20260808 14:50:21.681900 27451 mini_oidc.cc:189] Starting OIDC Discovery server
I20260808 14:50:21.682562 27451 webserver.cc:460] Webserver started at http://127.0.0.1:41015/ using document root <none> and password file <none>
2026-08-08T14:50:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:50:21Z Disabled control of system clock
I20260808 14:50:21.715885 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786200577490656-27451-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786200577490656-27451-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786200577490656-27451-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.206.254:42035
--webserver_interface=127.26.206.254
--webserver_port=0
--builtin_ntp_servers=127.26.206.212:34995
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.206.254:42035
--enable_jwt_token_auth=true
--jwks_url=https://localhost:39577/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786200577490656-27451-0/testchainca.cert with env {}
W20260808 14:50:22.054188 871 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:50:22.054499 871 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:50:22.054658 871 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:50:22.061777 871 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:50:22.061929 871 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:50:22.062012 871 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:50:22.062125 871 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:50:22.062199 871 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260808 14:50:22.062316 871 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260808 14:50:22.062384 871 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:39577/jwks.json
I20260808 14:50:22.071805 871 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:34995
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786200577490656-27451-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786200577490656-27451-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.206.254:42035
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.206.254:42035
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:39577/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.206.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786200577490656-27451-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786200577490656-27451-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:50:22.073097 871 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:50:22.074335 871 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:50:22.086567 879 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:50:22.086621 876 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:50:22.086751 877 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:50:22.087234 871 server_base.cc:1034] running on GCE node
I20260808 14:50:22.088117 871 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:50:22.089372 871 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:50:22.090570 871 hybrid_clock.cc:648] HybridClock initialized: now 1786200622090533 us; error 34 us; skew 500 ppm
I20260808 14:50:22.090873 871 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 14:50:22.097970 871 webserver.cc:460] Webserver started at http://127.26.206.254:33243/ using document root <none> and password file <none>
I20260808 14:50:22.098609 871 fs_manager.cc:359] Metadata directory not provided
I20260808 14:50:22.098701 871 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:50:22.098944 871 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:50:22.101728 871 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786200577490656-27451-0/minicluster-data/master-0/data/instance:
uuid: "5ef00c21a80f44e882f32c3f92c9d1f5"
format_stamp: "Formatted at 2026-08-08 14:50:22 on dist-test-slave-6k22"
server_key: "9b3ae01eb5524c7401fc455f0beaf835"
server_key_iv: "b6264819a940aad0c3d751ce266f304d"
server_key_version: "encryptionkey@0"
I20260808 14:50:22.102667 871 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786200577490656-27451-0/minicluster-data/master-0/wal/instance:
uuid: "5ef00c21a80f44e882f32c3f92c9d1f5"
format_stamp: "Formatted at 2026-08-08 14:50:22 on dist-test-slave-6k22"
server_key: "9b3ae01eb5524c7401fc455f0beaf835"
server_key_iv: "b6264819a940aad0c3d751ce266f304d"
server_key_version: "encryptionkey@0"
I20260808 14:50:22.107700 871 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.005s
I20260808 14:50:22.110882 887 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:50:22.112152 871 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 14:50:22.112318 871 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786200577490656-27451-0/minicluster-data/master-0/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786200577490656-27451-0/minicluster-data/master-0/wal
uuid: "5ef00c21a80f44e882f32c3f92c9d1f5"
format_stamp: "Formatted at 2026-08-08 14:50:22 on dist-test-slave-6k22"
server_key: "9b3ae01eb5524c7401fc455f0beaf835"
server_key_iv: "b6264819a940aad0c3d751ce266f304d"
server_key_version: "encryptionkey@0"
I20260808 14:50:22.112485 871 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786200577490656-27451-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786200577490656-27451-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786200577490656-27451-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:50:22.160193 871 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:50:22.161087 871 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:50:22.161362 871 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:50:22.181665 871 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.254:42035
I20260808 14:50:22.181694 946 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.254:42035 every 8 connection(s)
I20260808 14:50:22.183352 871 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
I20260808 14:50:22.184544 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 871
I20260808 14:50:22.184751 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786200577490656-27451-0/minicluster-data/master-0/wal/instance
I20260808 14:50:22.185433 27451 external_mini_cluster.cc:1428] Setting key b110ca349f78665e2bd66f7521c0d21f
I20260808 14:50:22.188154 947 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:50:22.200102 950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:22.187382 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44952 (local address 127.26.206.254:42035)
0808 14:50:22.189330 (+ 1948us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:22.189340 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:22.189380 (+ 40us) server_negotiation.cc:407] Connection header received
0808 14:50:22.190891 (+ 1511us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:22.190910 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:22.191395 (+ 485us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:22.191777 (+ 382us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:22.192442 (+ 665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:22.193771 (+ 1329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:22.195725 (+ 1954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:22.196352 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:22.196478 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:22.197770 (+ 1292us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:50:22.197777 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:50:22.197792 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:50:22.198351 (+ 559us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:50:22.198436 (+ 85us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:50:22.198459 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:50:22.198561 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:22.198783 (+ 222us) server_negotiation.cc:299] Negotiation successful
0808 14:50:22.199131 (+ 348us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1525,"thread_start_us":1306,"threads_started":1}
I20260808 14:50:22.201489 947 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5ef00c21a80f44e882f32c3f92c9d1f5: Bootstrap starting.
I20260808 14:50:22.204046 27451 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:50:22.204948 947 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5ef00c21a80f44e882f32c3f92c9d1f5: Neither blocks nor log segments found. Creating new log.
I20260808 14:50:22.205883 947 log.cc:824] T 00000000000000000000000000000000 P 5ef00c21a80f44e882f32c3f92c9d1f5: Log is configured to *not* fsync() on all Append() calls
I20260808 14:50:22.208752 947 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5ef00c21a80f44e882f32c3f92c9d1f5: No bootstrap required, opened a new log
I20260808 14:50:22.215755 947 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5ef00c21a80f44e882f32c3f92c9d1f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ef00c21a80f44e882f32c3f92c9d1f5" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 42035 } }
I20260808 14:50:22.216220 947 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5ef00c21a80f44e882f32c3f92c9d1f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:50:22.216359 947 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5ef00c21a80f44e882f32c3f92c9d1f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ef00c21a80f44e882f32c3f92c9d1f5, State: Initialized, Role: FOLLOWER
I20260808 14:50:22.216915 947 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5ef00c21a80f44e882f32c3f92c9d1f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ef00c21a80f44e882f32c3f92c9d1f5" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 42035 } }
I20260808 14:50:22.217137 947 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5ef00c21a80f44e882f32c3f92c9d1f5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:50:22.217290 947 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5ef00c21a80f44e882f32c3f92c9d1f5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:50:22.217487 947 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5ef00c21a80f44e882f32c3f92c9d1f5 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:50:22.219515 947 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5ef00c21a80f44e882f32c3f92c9d1f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ef00c21a80f44e882f32c3f92c9d1f5" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 42035 } }
I20260808 14:50:22.220074 947 leader_election.cc:302] T 00000000000000000000000000000000 P 5ef00c21a80f44e882f32c3f92c9d1f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5ef00c21a80f44e882f32c3f92c9d1f5; no voters:
I20260808 14:50:22.220624 947 leader_election.cc:288] T 00000000000000000000000000000000 P 5ef00c21a80f44e882f32c3f92c9d1f5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:50:22.220784 952 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5ef00c21a80f44e882f32c3f92c9d1f5 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:50:22.221529 952 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5ef00c21a80f44e882f32c3f92c9d1f5 [term 1 LEADER]: Becoming Leader. State: Replica: 5ef00c21a80f44e882f32c3f92c9d1f5, State: Running, Role: LEADER
I20260808 14:50:22.222041 952 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5ef00c21a80f44e882f32c3f92c9d1f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ef00c21a80f44e882f32c3f92c9d1f5" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 42035 } }
I20260808 14:50:22.222613 947 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5ef00c21a80f44e882f32c3f92c9d1f5 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:50:22.224807 954 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5ef00c21a80f44e882f32c3f92c9d1f5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5ef00c21a80f44e882f32c3f92c9d1f5. Latest consensus state: current_term: 1 leader_uuid: "5ef00c21a80f44e882f32c3f92c9d1f5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ef00c21a80f44e882f32c3f92c9d1f5" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 42035 } } }
I20260808 14:50:22.225267 954 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5ef00c21a80f44e882f32c3f92c9d1f5 [sys.catalog]: This master's current role is: LEADER
I20260808 14:50:22.225485 953 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5ef00c21a80f44e882f32c3f92c9d1f5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5ef00c21a80f44e882f32c3f92c9d1f5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ef00c21a80f44e882f32c3f92c9d1f5" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 42035 } } }
I20260808 14:50:22.225826 953 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5ef00c21a80f44e882f32c3f92c9d1f5 [sys.catalog]: This master's current role is: LEADER
I20260808 14:50:22.228194 962 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:50:22.232393 962 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:50:22.240809 962 catalog_manager.cc:1347] Generated new cluster ID: 8be66d55089d4b3e983c9ceb33e52c4e
I20260808 14:50:22.240953 962 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:50:22.251363 962 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:50:22.252616 962 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:50:22.258622 962 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5ef00c21a80f44e882f32c3f92c9d1f5: Generated new TSK 0
I20260808 14:50:22.259490 962 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260808 14:50:22.307893 980 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260808 14:50:22.308139 980 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260808 14:50:22.309062 950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:22.286645 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44962 (local address 127.26.206.254:42035)
0808 14:50:22.286889 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:22.286899 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:22.287406 (+ 507us) server_negotiation.cc:407] Connection header received
0808 14:50:22.287818 (+ 412us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:22.287823 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:22.287892 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:22.288014 (+ 122us) server_negotiation.cc:226] Negotiated authn=JWT
0808 14:50:22.288703 (+ 689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:22.289435 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:22.291627 (+ 2192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:22.292044 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:22.292134 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:22.292768 (+ 634us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0808 14:50:22.308572 (+ 15804us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39577/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0808 14:50:22.308832 (+ 260us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:44962: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39577/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":69}
W20260808 14:50:22.309204 950 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:44962: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39577/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260808 14:50:22.311285 979 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:50:22.286569 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:42035 (local address 127.0.0.1:44962)
0808 14:50:22.287294 (+ 725us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:22.287314 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 14:50:22.287503 (+ 189us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:50:22.288088 (+ 585us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:50:22.288093 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:50:22.288107 (+ 14us) client_negotiation.cc:189] Negotiated authn=JWT
0808 14:50:22.288530 (+ 423us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:22.288542 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:22.289580 (+ 1038us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:22.289586 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:22.291425 (+ 1839us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:22.291442 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:22.292227 (+ 785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:22.292234 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:22.292428 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:22.292498 (+ 70us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0808 14:50:22.308858 (+ 16360us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39577/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0808 14:50:22.309199 (+ 341us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.26.206.254:42035: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39577/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":514,"thread_start_us":357,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.26.206.254:42035: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39577/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260808 14:50:22.313130 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 871
I20260808 14:50:22.314244 941 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:50:22.410125 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 871
2026-08-08T14:50:22Z chronyd exiting
I20260808 14:50:22.464751 27451 test_util.cc:175] -----------------------------------------------
I20260808 14:50:22.464879 27451 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786200577490656-27451-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (791 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260808 14:50:22.468652 27451 mini_oidc.cc:152] Starting JWKS server
I20260808 14:50:22.470450 27451 webserver.cc:460] Webserver started at https://127.0.0.1:39739/ using document root <none> and password file <none>
I20260808 14:50:22.470669 27451 mini_oidc.cc:189] Starting OIDC Discovery server
I20260808 14:50:22.471251 27451 webserver.cc:460] Webserver started at http://127.0.0.1:40441/ using document root <none> and password file <none>
2026-08-08T14:50:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:50:22Z Disabled control of system clock
I20260808 14:50:22.503364 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786200577490656-27451-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786200577490656-27451-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786200577490656-27451-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.206.254:34049
--webserver_interface=127.26.206.254
--webserver_port=0
--builtin_ntp_servers=127.26.206.212:35465
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.206.254:34049
--enable_jwt_token_auth=true
--jwks_url=https://localhost:39739/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786200577490656-27451-0/testchainca.cert with env {}
W20260808 14:50:22.823330 987 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:50:22.823681 987 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:50:22.823838 987 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:50:22.830849 987 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:50:22.830986 987 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:50:22.831079 987 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:50:22.831188 987 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:50:22.831283 987 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260808 14:50:22.831375 987 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260808 14:50:22.831453 987 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:39739/jwks.json
I20260808 14:50:22.841392 987 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:35465
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786200577490656-27451-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786200577490656-27451-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.206.254:34049
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.206.254:34049
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:39739/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.206.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786200577490656-27451-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786200577490656-27451-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:50:22.842693 987 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:50:22.844025 987 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:50:22.855764 995 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:50:22.855841 993 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:50:22.855870 992 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:50:22.856686 987 server_base.cc:1034] running on GCE node
I20260808 14:50:22.857430 987 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:50:22.858762 987 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:50:22.859987 987 hybrid_clock.cc:648] HybridClock initialized: now 1786200622859949 us; error 48 us; skew 500 ppm
I20260808 14:50:22.860345 987 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 14:50:22.862591 987 webserver.cc:460] Webserver started at http://127.26.206.254:35491/ using document root <none> and password file <none>
I20260808 14:50:22.863246 987 fs_manager.cc:359] Metadata directory not provided
I20260808 14:50:22.863392 987 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:50:22.863822 987 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:50:22.866555 987 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786200577490656-27451-0/minicluster-data/master-0/data/instance:
uuid: "fecd3e76df18448da226d21cedad7782"
format_stamp: "Formatted at 2026-08-08 14:50:22 on dist-test-slave-6k22"
server_key: "c379b386ed7d7fdd9e8ed3b5ea02bd15"
server_key_iv: "5ec7bf64a8d80d43bbfa3b88516e5a11"
server_key_version: "encryptionkey@0"
I20260808 14:50:22.867357 987 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786200577490656-27451-0/minicluster-data/master-0/wal/instance:
uuid: "fecd3e76df18448da226d21cedad7782"
format_stamp: "Formatted at 2026-08-08 14:50:22 on dist-test-slave-6k22"
server_key: "c379b386ed7d7fdd9e8ed3b5ea02bd15"
server_key_iv: "5ec7bf64a8d80d43bbfa3b88516e5a11"
server_key_version: "encryptionkey@0"
I20260808 14:50:22.872421 987 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.003s
I20260808 14:50:22.875752 1002 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:50:22.876961 987 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260808 14:50:22.877159 987 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786200577490656-27451-0/minicluster-data/master-0/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786200577490656-27451-0/minicluster-data/master-0/wal
uuid: "fecd3e76df18448da226d21cedad7782"
format_stamp: "Formatted at 2026-08-08 14:50:22 on dist-test-slave-6k22"
server_key: "c379b386ed7d7fdd9e8ed3b5ea02bd15"
server_key_iv: "5ec7bf64a8d80d43bbfa3b88516e5a11"
server_key_version: "encryptionkey@0"
I20260808 14:50:22.877377 987 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786200577490656-27451-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786200577490656-27451-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786200577490656-27451-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:50:22.893812 987 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:50:22.894564 987 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:50:22.894874 987 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:50:22.914079 987 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.254:34049
I20260808 14:50:22.914085 1061 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.254:34049 every 8 connection(s)
I20260808 14:50:22.915480 987 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
I20260808 14:50:22.919153 1063 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:50:22.920786 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 987
I20260808 14:50:22.920997 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786200577490656-27451-0/minicluster-data/master-0/wal/instance
I20260808 14:50:22.921808 27451 external_mini_cluster.cc:1428] Setting key e95399acc75755f7b4a4f99fc028973f
I20260808 14:50:22.931236 1063 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fecd3e76df18448da226d21cedad7782: Bootstrap starting.
I20260808 14:50:22.934792 1063 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fecd3e76df18448da226d21cedad7782: Neither blocks nor log segments found. Creating new log.
I20260808 14:50:22.935850 1066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:22.923874 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49112 (local address 127.26.206.254:34049)
0808 14:50:22.925006 (+ 1132us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:22.925016 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:22.925069 (+ 53us) server_negotiation.cc:407] Connection header received
0808 14:50:22.926811 (+ 1742us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:22.926832 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:22.927268 (+ 436us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:22.927673 (+ 405us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:22.928171 (+ 498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:22.929580 (+ 1409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:22.931361 (+ 1781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:22.932124 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:22.932258 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:22.933459 (+ 1201us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:50:22.933467 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:50:22.933478 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:50:22.934008 (+ 530us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:50:22.934091 (+ 83us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:50:22.934111 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:50:22.934203 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:22.934439 (+ 236us) server_negotiation.cc:299] Negotiation successful
0808 14:50:22.934819 (+ 380us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":726,"thread_start_us":482,"threads_started":1}
I20260808 14:50:22.935853 1063 log.cc:824] T 00000000000000000000000000000000 P fecd3e76df18448da226d21cedad7782: Log is configured to *not* fsync() on all Append() calls
I20260808 14:50:22.938836 1063 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fecd3e76df18448da226d21cedad7782: No bootstrap required, opened a new log
I20260808 14:50:22.940045 27451 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:50:22.946861 1063 raft_consensus.cc:348] T 00000000000000000000000000000000 P fecd3e76df18448da226d21cedad7782 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fecd3e76df18448da226d21cedad7782" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 34049 } }
I20260808 14:50:22.947156 1063 raft_consensus.cc:374] T 00000000000000000000000000000000 P fecd3e76df18448da226d21cedad7782 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:50:22.947218 1063 raft_consensus.cc:729] T 00000000000000000000000000000000 P fecd3e76df18448da226d21cedad7782 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fecd3e76df18448da226d21cedad7782, State: Initialized, Role: FOLLOWER
I20260808 14:50:22.947748 1063 consensus_queue.cc:260] T 00000000000000000000000000000000 P fecd3e76df18448da226d21cedad7782 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fecd3e76df18448da226d21cedad7782" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 34049 } }
I20260808 14:50:22.947948 1063 raft_consensus.cc:388] T 00000000000000000000000000000000 P fecd3e76df18448da226d21cedad7782 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:50:22.948045 1063 raft_consensus.cc:482] T 00000000000000000000000000000000 P fecd3e76df18448da226d21cedad7782 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:50:22.948163 1063 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fecd3e76df18448da226d21cedad7782 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:50:22.950069 1063 raft_consensus.cc:504] T 00000000000000000000000000000000 P fecd3e76df18448da226d21cedad7782 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fecd3e76df18448da226d21cedad7782" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 34049 } }
I20260808 14:50:22.950525 1063 leader_election.cc:302] T 00000000000000000000000000000000 P fecd3e76df18448da226d21cedad7782 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fecd3e76df18448da226d21cedad7782; no voters:
I20260808 14:50:22.951134 1063 leader_election.cc:288] T 00000000000000000000000000000000 P fecd3e76df18448da226d21cedad7782 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:50:22.951256 1069 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fecd3e76df18448da226d21cedad7782 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:50:22.952028 1069 raft_consensus.cc:686] T 00000000000000000000000000000000 P fecd3e76df18448da226d21cedad7782 [term 1 LEADER]: Becoming Leader. State: Replica: fecd3e76df18448da226d21cedad7782, State: Running, Role: LEADER
I20260808 14:50:22.952538 1069 consensus_queue.cc:237] T 00000000000000000000000000000000 P fecd3e76df18448da226d21cedad7782 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fecd3e76df18448da226d21cedad7782" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 34049 } }
I20260808 14:50:22.953083 1063 sys_catalog.cc:564] T 00000000000000000000000000000000 P fecd3e76df18448da226d21cedad7782 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:50:22.955049 1070 sys_catalog.cc:455] T 00000000000000000000000000000000 P fecd3e76df18448da226d21cedad7782 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fecd3e76df18448da226d21cedad7782" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fecd3e76df18448da226d21cedad7782" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 34049 } } }
I20260808 14:50:22.955476 1070 sys_catalog.cc:458] T 00000000000000000000000000000000 P fecd3e76df18448da226d21cedad7782 [sys.catalog]: This master's current role is: LEADER
I20260808 14:50:22.955803 1071 sys_catalog.cc:455] T 00000000000000000000000000000000 P fecd3e76df18448da226d21cedad7782 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fecd3e76df18448da226d21cedad7782. Latest consensus state: current_term: 1 leader_uuid: "fecd3e76df18448da226d21cedad7782" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fecd3e76df18448da226d21cedad7782" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 34049 } } }
I20260808 14:50:22.956256 1071 sys_catalog.cc:458] T 00000000000000000000000000000000 P fecd3e76df18448da226d21cedad7782 [sys.catalog]: This master's current role is: LEADER
I20260808 14:50:22.962055 1074 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:50:22.966028 1074 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:50:22.975361 1074 catalog_manager.cc:1347] Generated new cluster ID: 58479e41e8594243bd19f74025c3658c
I20260808 14:50:22.975590 1074 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:50:22.994681 1074 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:50:22.996088 1074 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:50:23.005673 1074 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fecd3e76df18448da226d21cedad7782: Generated new TSK 0
I20260808 14:50:23.006722 1074 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260808 14:50:23.058568 1096 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260808 14:50:23.058797 1096 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260808 14:50:23.059489 1066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:23.032450 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49124 (local address 127.26.206.254:34049)
0808 14:50:23.032687 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:23.032696 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:23.033194 (+ 498us) server_negotiation.cc:407] Connection header received
0808 14:50:23.033444 (+ 250us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:23.033448 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:23.033517 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:23.033643 (+ 126us) server_negotiation.cc:226] Negotiated authn=JWT
0808 14:50:23.034160 (+ 517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:23.034858 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:23.036887 (+ 2029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:23.037334 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:23.037427 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:23.037978 (+ 551us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0808 14:50:23.058978 (+ 21000us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39739/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0808 14:50:23.059273 (+ 295us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:49124: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39739/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":67}
W20260808 14:50:23.059681 1066 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:49124: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39739/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260808 14:50:23.059911 1095 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:50:23.032445 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:34049 (local address 127.0.0.1:49124)
0808 14:50:23.033083 (+ 638us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:23.033108 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0808 14:50:23.033259 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:50:23.033686 (+ 427us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:50:23.033692 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:50:23.033705 (+ 13us) client_negotiation.cc:189] Negotiated authn=JWT
0808 14:50:23.033995 (+ 290us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:23.034006 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:23.034993 (+ 987us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:23.035000 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:23.036755 (+ 1755us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:23.036770 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:23.037497 (+ 727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:23.037503 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:23.037699 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:23.037743 (+ 44us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0808 14:50:23.059204 (+ 21461us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39739/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0808 14:50:23.059478 (+ 274us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.26.206.254:34049: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39739/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":496,"thread_start_us":342,"threads_started":1}
I20260808 14:50:23.061316 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 987
I20260808 14:50:23.062470 1054 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:50:23.154155 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 987
2026-08-08T14:50:23Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (744 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260808 14:50:23.212855 27451 mini_oidc.cc:152] Starting JWKS server
I20260808 14:50:23.214797 27451 webserver.cc:460] Webserver started at https://127.0.0.1:41589/ using document root <none> and password file <none>
I20260808 14:50:23.215018 27451 mini_oidc.cc:189] Starting OIDC Discovery server
I20260808 14:50:23.215742 27451 webserver.cc:460] Webserver started at http://127.0.0.1:32983/ using document root <none> and password file <none>
2026-08-08T14:50:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:50:23Z Disabled control of system clock
I20260808 14:50:23.246647 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786200577490656-27451-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786200577490656-27451-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786200577490656-27451-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.206.254:46549
--webserver_interface=127.26.206.254
--webserver_port=0
--builtin_ntp_servers=127.26.206.212:46205
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.206.254:46549
--enable_jwt_token_auth=true
--jwks_url=https://localhost:41589/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260808 14:50:23.579638 1104 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:50:23.580050 1104 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:50:23.580217 1104 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:50:23.587868 1104 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:50:23.588014 1104 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:50:23.588107 1104 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:50:23.588228 1104 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:50:23.588313 1104 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260808 14:50:23.588416 1104 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260808 14:50:23.588503 1104 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:41589/jwks.json
I20260808 14:50:23.597863 1104 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:46205
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786200577490656-27451-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786200577490656-27451-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.206.254:46549
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.206.254:46549
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:41589/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.206.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786200577490656-27451-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:50:23.599341 1104 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:50:23.601382 1104 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:50:23.613942 1110 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:50:23.614130 1111 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:50:23.614153 1113 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:50:23.615139 1104 server_base.cc:1034] running on GCE node
I20260808 14:50:23.616051 1104 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:50:23.617468 1104 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:50:23.618666 1104 hybrid_clock.cc:648] HybridClock initialized: now 1786200623618618 us; error 35 us; skew 500 ppm
I20260808 14:50:23.619026 1104 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 14:50:23.621387 1104 webserver.cc:460] Webserver started at http://127.26.206.254:39205/ using document root <none> and password file <none>
I20260808 14:50:23.622092 1104 fs_manager.cc:359] Metadata directory not provided
I20260808 14:50:23.622215 1104 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:50:23.622556 1104 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:50:23.625556 1104 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786200577490656-27451-0/minicluster-data/master-0/data/instance:
uuid: "9148aed7f7a24078975ca25201988a92"
format_stamp: "Formatted at 2026-08-08 14:50:23 on dist-test-slave-6k22"
server_key: "7eb22a16a178efb6e4a5969d9c65e4ad"
server_key_iv: "0e3cd250c45cf48bbd0c0f3cc8ba2179"
server_key_version: "encryptionkey@0"
I20260808 14:50:23.626394 1104 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786200577490656-27451-0/minicluster-data/master-0/wal/instance:
uuid: "9148aed7f7a24078975ca25201988a92"
format_stamp: "Formatted at 2026-08-08 14:50:23 on dist-test-slave-6k22"
server_key: "7eb22a16a178efb6e4a5969d9c65e4ad"
server_key_iv: "0e3cd250c45cf48bbd0c0f3cc8ba2179"
server_key_version: "encryptionkey@0"
I20260808 14:50:23.631705 1104 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.008s
I20260808 14:50:23.635254 1120 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:50:23.636626 1104 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.003s
I20260808 14:50:23.636838 1104 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786200577490656-27451-0/minicluster-data/master-0/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786200577490656-27451-0/minicluster-data/master-0/wal
uuid: "9148aed7f7a24078975ca25201988a92"
format_stamp: "Formatted at 2026-08-08 14:50:23 on dist-test-slave-6k22"
server_key: "7eb22a16a178efb6e4a5969d9c65e4ad"
server_key_iv: "0e3cd250c45cf48bbd0c0f3cc8ba2179"
server_key_version: "encryptionkey@0"
I20260808 14:50:23.637060 1104 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786200577490656-27451-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786200577490656-27451-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786200577490656-27451-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:50:23.656744 1104 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:50:23.657584 1104 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:50:23.657907 1104 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:50:23.676437 1104 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.254:46549
I20260808 14:50:23.676456 1174 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.254:46549 every 8 connection(s)
I20260808 14:50:23.677821 1104 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
I20260808 14:50:23.681517 1175 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:50:23.684942 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 1104
I20260808 14:50:23.685137 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786200577490656-27451-0/minicluster-data/master-0/wal/instance
I20260808 14:50:23.685993 27451 external_mini_cluster.cc:1428] Setting key 5498003c8b52c59cce8fbcb7b64fce87
I20260808 14:50:23.693729 1175 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9148aed7f7a24078975ca25201988a92: Bootstrap starting.
I20260808 14:50:23.696771 1175 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9148aed7f7a24078975ca25201988a92: Neither blocks nor log segments found. Creating new log.
I20260808 14:50:23.697794 1175 log.cc:824] T 00000000000000000000000000000000 P 9148aed7f7a24078975ca25201988a92: Log is configured to *not* fsync() on all Append() calls
I20260808 14:50:23.699045 1178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:23.687942 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39888 (local address 127.26.206.254:46549)
0808 14:50:23.688851 (+ 909us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:23.688861 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:23.688901 (+ 40us) server_negotiation.cc:407] Connection header received
0808 14:50:23.690537 (+ 1636us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:23.690559 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:23.691008 (+ 449us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:23.691395 (+ 387us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:23.692039 (+ 644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:23.693220 (+ 1181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:23.694602 (+ 1382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:23.695299 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:23.695489 (+ 190us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:23.696694 (+ 1205us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:50:23.696702 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:50:23.696715 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:50:23.697308 (+ 593us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:50:23.697396 (+ 88us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:50:23.697417 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:50:23.697544 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:23.697772 (+ 228us) server_negotiation.cc:299] Negotiation successful
0808 14:50:23.698087 (+ 315us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":527,"thread_start_us":353,"threads_started":1}
I20260808 14:50:23.700867 1175 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9148aed7f7a24078975ca25201988a92: No bootstrap required, opened a new log
I20260808 14:50:23.702911 27451 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:50:23.708940 1175 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9148aed7f7a24078975ca25201988a92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9148aed7f7a24078975ca25201988a92" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 46549 } }
I20260808 14:50:23.709245 1175 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9148aed7f7a24078975ca25201988a92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:50:23.709344 1175 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9148aed7f7a24078975ca25201988a92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9148aed7f7a24078975ca25201988a92, State: Initialized, Role: FOLLOWER
I20260808 14:50:23.709964 1175 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9148aed7f7a24078975ca25201988a92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9148aed7f7a24078975ca25201988a92" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 46549 } }
I20260808 14:50:23.710179 1175 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9148aed7f7a24078975ca25201988a92 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:50:23.710323 1175 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9148aed7f7a24078975ca25201988a92 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:50:23.710485 1175 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9148aed7f7a24078975ca25201988a92 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:50:23.712841 1175 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9148aed7f7a24078975ca25201988a92 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9148aed7f7a24078975ca25201988a92" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 46549 } }
I20260808 14:50:23.713320 1175 leader_election.cc:302] T 00000000000000000000000000000000 P 9148aed7f7a24078975ca25201988a92 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9148aed7f7a24078975ca25201988a92; no voters:
I20260808 14:50:23.713893 1175 leader_election.cc:288] T 00000000000000000000000000000000 P 9148aed7f7a24078975ca25201988a92 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:50:23.714021 1180 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9148aed7f7a24078975ca25201988a92 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:50:23.714779 1180 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9148aed7f7a24078975ca25201988a92 [term 1 LEADER]: Becoming Leader. State: Replica: 9148aed7f7a24078975ca25201988a92, State: Running, Role: LEADER
I20260808 14:50:23.715315 1180 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9148aed7f7a24078975ca25201988a92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9148aed7f7a24078975ca25201988a92" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 46549 } }
I20260808 14:50:23.716054 1175 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9148aed7f7a24078975ca25201988a92 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:50:23.718071 1181 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9148aed7f7a24078975ca25201988a92 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9148aed7f7a24078975ca25201988a92" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9148aed7f7a24078975ca25201988a92" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 46549 } } }
I20260808 14:50:23.718384 1181 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9148aed7f7a24078975ca25201988a92 [sys.catalog]: This master's current role is: LEADER
I20260808 14:50:23.719242 1187 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:50:23.720082 1183 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9148aed7f7a24078975ca25201988a92 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9148aed7f7a24078975ca25201988a92. Latest consensus state: current_term: 1 leader_uuid: "9148aed7f7a24078975ca25201988a92" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9148aed7f7a24078975ca25201988a92" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 46549 } } }
I20260808 14:50:23.720396 1183 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9148aed7f7a24078975ca25201988a92 [sys.catalog]: This master's current role is: LEADER
I20260808 14:50:23.724591 1187 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:50:23.734372 1187 catalog_manager.cc:1347] Generated new cluster ID: c476bf99eccf4cb795cbd7560d8466bb
I20260808 14:50:23.734493 1187 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:50:23.746701 1187 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:50:23.748077 1187 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:50:23.759439 1187 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9148aed7f7a24078975ca25201988a92: Generated new TSK 0
I20260808 14:50:23.760507 1187 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:50:23.789172 1178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:23.780460 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39898 (local address 127.26.206.254:46549)
0808 14:50:23.780701 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:23.780709 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:23.781207 (+ 498us) server_negotiation.cc:407] Connection header received
0808 14:50:23.781468 (+ 261us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:23.781472 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:23.781539 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:23.781669 (+ 130us) server_negotiation.cc:226] Negotiated authn=JWT
0808 14:50:23.782220 (+ 551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:23.782981 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:23.785028 (+ 2047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:23.785473 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:23.785568 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:23.786169 (+ 601us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0808 14:50:23.788551 (+ 2382us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41589/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0808 14:50:23.788873 (+ 322us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:39898: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41589/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":60}
W20260808 14:50:23.789304 1178 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:39898: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41589/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260808 14:50:23.791317 1211 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:50:23.780327 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:46549 (local address 127.0.0.1:39898)
0808 14:50:23.781097 (+ 770us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:23.781118 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 14:50:23.781285 (+ 167us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:50:23.781717 (+ 432us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:50:23.781723 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:50:23.781739 (+ 16us) client_negotiation.cc:189] Negotiated authn=JWT
0808 14:50:23.782072 (+ 333us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:23.782085 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:23.783121 (+ 1036us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:23.783127 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:23.784892 (+ 1765us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:23.784907 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:23.785668 (+ 761us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:23.785677 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:23.785881 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:23.785928 (+ 47us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0808 14:50:23.788773 (+ 2845us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41589/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0808 14:50:23.790856 (+ 2083us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.26.206.254:46549: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41589/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":631,"mutex_wait_us":1772,"thread_start_us":347,"threads_started":1}
I20260808 14:50:23.792981 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 1104
I20260808 14:50:23.794112 1169 generic_service.cc:196] Checking for leaks (request via RPC)
E20260808 14:50:23.801712 1212 webserver.cc:533] Webserver: sslize failed:
E20260808 14:50:23.801802 1212 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260808 14:50:23.886873 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 1104
2026-08-08T14:50:23Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (731 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-08T14:50:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:50:23Z Disabled control of system clock
I20260808 14:50:23.977252 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786200577490656-27451-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786200577490656-27451-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786200577490656-27451-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.206.254:39293
--webserver_interface=127.26.206.254
--webserver_port=0
--builtin_ntp_servers=127.26.206.212:38791
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.206.254:39293
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786200577490656-27451-0/testchainca.cert with env {}
W20260808 14:50:24.312580 1217 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:50:24.313020 1217 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:50:24.313202 1217 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:50:24.320621 1217 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:50:24.320760 1217 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:50:24.320851 1217 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:50:24.320968 1217 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:50:24.321055 1217 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260808 14:50:24.321156 1217 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260808 14:50:24.321234 1217 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260808 14:50:24.331143 1217 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:38791
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786200577490656-27451-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786200577490656-27451-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.206.254:39293
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.206.254:39293
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.206.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786200577490656-27451-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786200577490656-27451-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:50:24.332454 1217 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:50:24.333837 1217 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:50:24.346148 1223 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:50:24.346205 1226 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:50:24.346470 1224 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:50:24.347187 1217 server_base.cc:1034] running on GCE node
I20260808 14:50:24.348027 1217 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:50:24.349366 1217 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:50:24.350607 1217 hybrid_clock.cc:648] HybridClock initialized: now 1786200624350546 us; error 56 us; skew 500 ppm
I20260808 14:50:24.350948 1217 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 14:50:24.353305 1217 webserver.cc:460] Webserver started at http://127.26.206.254:38029/ using document root <none> and password file <none>
I20260808 14:50:24.353997 1217 fs_manager.cc:359] Metadata directory not provided
I20260808 14:50:24.354130 1217 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:50:24.354442 1217 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:50:24.357338 1217 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786200577490656-27451-0/minicluster-data/master-0/data/instance:
uuid: "ec929e0fc2354d00b4915c44d69459e8"
format_stamp: "Formatted at 2026-08-08 14:50:24 on dist-test-slave-6k22"
server_key: "93a1deef3a00f344adfb2f94215c9b3c"
server_key_iv: "90b6a4166683def91a2489ccc42867bf"
server_key_version: "encryptionkey@0"
I20260808 14:50:24.358147 1217 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786200577490656-27451-0/minicluster-data/master-0/wal/instance:
uuid: "ec929e0fc2354d00b4915c44d69459e8"
format_stamp: "Formatted at 2026-08-08 14:50:24 on dist-test-slave-6k22"
server_key: "93a1deef3a00f344adfb2f94215c9b3c"
server_key_iv: "90b6a4166683def91a2489ccc42867bf"
server_key_version: "encryptionkey@0"
I20260808 14:50:24.363106 1217 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.002s
I20260808 14:50:24.366551 1233 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:50:24.368096 1217 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 14:50:24.368286 1217 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786200577490656-27451-0/minicluster-data/master-0/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786200577490656-27451-0/minicluster-data/master-0/wal
uuid: "ec929e0fc2354d00b4915c44d69459e8"
format_stamp: "Formatted at 2026-08-08 14:50:24 on dist-test-slave-6k22"
server_key: "93a1deef3a00f344adfb2f94215c9b3c"
server_key_iv: "90b6a4166683def91a2489ccc42867bf"
server_key_version: "encryptionkey@0"
I20260808 14:50:24.368502 1217 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786200577490656-27451-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786200577490656-27451-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786200577490656-27451-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:50:24.390291 1217 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:50:24.391202 1217 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:50:24.391498 1217 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:50:24.409641 1217 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.254:39293
I20260808 14:50:24.409684 1288 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.254:39293 every 8 connection(s)
I20260808 14:50:24.410971 1217 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
I20260808 14:50:24.414958 1289 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:50:24.418095 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 1217
I20260808 14:50:24.418342 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786200577490656-27451-0/minicluster-data/master-0/wal/instance
I20260808 14:50:24.418996 27451 external_mini_cluster.cc:1428] Setting key b98bf4c5102ad96e87d105be0b76b116
I20260808 14:50:24.427421 1289 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ec929e0fc2354d00b4915c44d69459e8: Bootstrap starting.
I20260808 14:50:24.430831 1289 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ec929e0fc2354d00b4915c44d69459e8: Neither blocks nor log segments found. Creating new log.
I20260808 14:50:24.432160 1289 log.cc:824] T 00000000000000000000000000000000 P ec929e0fc2354d00b4915c44d69459e8: Log is configured to *not* fsync() on all Append() calls
I20260808 14:50:24.432438 1292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:24.421084 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48370 (local address 127.26.206.254:39293)
0808 14:50:24.422105 (+ 1021us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:24.422116 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:24.422158 (+ 42us) server_negotiation.cc:407] Connection header received
0808 14:50:24.423893 (+ 1735us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:24.423916 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:24.424384 (+ 468us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:24.424783 (+ 399us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:24.425364 (+ 581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:24.426647 (+ 1283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:24.428024 (+ 1377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:24.428714 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:24.428947 (+ 233us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:24.430102 (+ 1155us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:50:24.430110 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:50:24.430123 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:50:24.430683 (+ 560us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:50:24.430780 (+ 97us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:50:24.430819 (+ 39us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:50:24.430943 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:24.431165 (+ 222us) server_negotiation.cc:299] Negotiation successful
0808 14:50:24.431463 (+ 298us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":632,"thread_start_us":372,"threads_started":1}
I20260808 14:50:24.435240 1289 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ec929e0fc2354d00b4915c44d69459e8: No bootstrap required, opened a new log
I20260808 14:50:24.436241 27451 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:50:24.443526 1289 raft_consensus.cc:348] T 00000000000000000000000000000000 P ec929e0fc2354d00b4915c44d69459e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec929e0fc2354d00b4915c44d69459e8" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 39293 } }
I20260808 14:50:24.443962 1289 raft_consensus.cc:374] T 00000000000000000000000000000000 P ec929e0fc2354d00b4915c44d69459e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:50:24.444094 1289 raft_consensus.cc:729] T 00000000000000000000000000000000 P ec929e0fc2354d00b4915c44d69459e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec929e0fc2354d00b4915c44d69459e8, State: Initialized, Role: FOLLOWER
I20260808 14:50:24.444730 1289 consensus_queue.cc:260] T 00000000000000000000000000000000 P ec929e0fc2354d00b4915c44d69459e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec929e0fc2354d00b4915c44d69459e8" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 39293 } }
I20260808 14:50:24.444979 1289 raft_consensus.cc:388] T 00000000000000000000000000000000 P ec929e0fc2354d00b4915c44d69459e8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:50:24.445147 1289 raft_consensus.cc:482] T 00000000000000000000000000000000 P ec929e0fc2354d00b4915c44d69459e8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:50:24.445330 1289 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ec929e0fc2354d00b4915c44d69459e8 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:50:24.448045 1289 raft_consensus.cc:504] T 00000000000000000000000000000000 P ec929e0fc2354d00b4915c44d69459e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec929e0fc2354d00b4915c44d69459e8" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 39293 } }
I20260808 14:50:24.448572 1289 leader_election.cc:302] T 00000000000000000000000000000000 P ec929e0fc2354d00b4915c44d69459e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ec929e0fc2354d00b4915c44d69459e8; no voters:
I20260808 14:50:24.449183 1289 leader_election.cc:288] T 00000000000000000000000000000000 P ec929e0fc2354d00b4915c44d69459e8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:50:24.449332 1295 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ec929e0fc2354d00b4915c44d69459e8 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:50:24.451136 1295 raft_consensus.cc:686] T 00000000000000000000000000000000 P ec929e0fc2354d00b4915c44d69459e8 [term 1 LEADER]: Becoming Leader. State: Replica: ec929e0fc2354d00b4915c44d69459e8, State: Running, Role: LEADER
I20260808 14:50:24.451409 1289 sys_catalog.cc:564] T 00000000000000000000000000000000 P ec929e0fc2354d00b4915c44d69459e8 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:50:24.451738 1295 consensus_queue.cc:237] T 00000000000000000000000000000000 P ec929e0fc2354d00b4915c44d69459e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec929e0fc2354d00b4915c44d69459e8" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 39293 } }
I20260808 14:50:24.454015 1297 sys_catalog.cc:455] T 00000000000000000000000000000000 P ec929e0fc2354d00b4915c44d69459e8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ec929e0fc2354d00b4915c44d69459e8. Latest consensus state: current_term: 1 leader_uuid: "ec929e0fc2354d00b4915c44d69459e8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec929e0fc2354d00b4915c44d69459e8" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 39293 } } }
I20260808 14:50:24.454295 1297 sys_catalog.cc:458] T 00000000000000000000000000000000 P ec929e0fc2354d00b4915c44d69459e8 [sys.catalog]: This master's current role is: LEADER
I20260808 14:50:24.454152 1296 sys_catalog.cc:455] T 00000000000000000000000000000000 P ec929e0fc2354d00b4915c44d69459e8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ec929e0fc2354d00b4915c44d69459e8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec929e0fc2354d00b4915c44d69459e8" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 39293 } } }
I20260808 14:50:24.454670 1296 sys_catalog.cc:458] T 00000000000000000000000000000000 P ec929e0fc2354d00b4915c44d69459e8 [sys.catalog]: This master's current role is: LEADER
I20260808 14:50:24.466229 1302 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:50:24.470798 1302 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:50:24.479864 1302 catalog_manager.cc:1347] Generated new cluster ID: e2d1a204186c416db63747a0141b894b
I20260808 14:50:24.479987 1302 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:50:24.496608 1302 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:50:24.498538 1302 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:50:24.507715 1302 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ec929e0fc2354d00b4915c44d69459e8: Generated new TSK 0
I20260808 14:50:24.508684 1302 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:50:25.045491 1292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:24.523447 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48376 (local address 127.26.206.254:39293)
0808 14:50:24.523670 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:24.523678 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:24.523980 (+ 302us) server_negotiation.cc:407] Connection header received
0808 14:50:24.524243 (+ 263us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:24.524247 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:24.524319 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:24.524475 (+ 156us) server_negotiation.cc:226] Negotiated authn=JWT
0808 14:50:24.524945 (+ 470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:24.525653 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:24.527093 (+ 1440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:24.527617 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:24.527756 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:24.528240 (+ 484us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0808 14:50:25.044650 (+516410us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0808 14:50:25.045162 (+ 512us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:48376: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":55}
W20260808 14:50:25.045658 1292 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:48376: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260808 14:50:25.045809 1321 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:50:24.523258 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:39293 (local address 127.0.0.1:48376)
0808 14:50:24.523861 (+ 603us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:24.523881 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 14:50:24.524057 (+ 176us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:50:24.524493 (+ 436us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:50:24.524497 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:50:24.524509 (+ 12us) client_negotiation.cc:189] Negotiated authn=JWT
0808 14:50:24.524797 (+ 288us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:24.524806 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:24.525851 (+ 1045us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:24.525859 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:24.526948 (+ 1089us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:24.526958 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:24.527807 (+ 849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:24.527817 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:24.527952 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:24.527983 (+ 31us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0808 14:50:25.044990 (+517007us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0808 14:50:25.045362 (+ 372us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.26.206.254:39293: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":449,"thread_start_us":438,"threads_started":1}
I20260808 14:50:25.047072 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 1217
I20260808 14:50:25.048267 1284 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:50:25.149987 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 1217
2026-08-08T14:50:25Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (1246 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (412 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (408 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200577490656-27451-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:50:26 dist-test-slave-6k22 krb5kdc[1340](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:50:26 dist-test-slave-6k22 krb5kdc[1340](info): set up 2 sockets
Aug 08 14:50:26 dist-test-slave-6k22 krb5kdc[1340](info): commencing operation
krb5kdc: starting...
W20260808 14:50:27.136883 27451 mini_kdc.cc:121] Time spent starting KDC: real 1.124s user 0.005s sys 0.022s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200577490656-27451-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200577490656-27451-0/krb5kdc/test-user.keytab.
Aug 08 14:50:27 dist-test-slave-6k22 krb5kdc[1340](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200627, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:50:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:50:27Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.206.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.206.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.206.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.254.keytab.
Entry for principal kudu/127.26.206.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.254.keytab.
I20260808 14:50:27.359774 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200577490656-27451-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200577490656-27451-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200577490656-27451-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.206.254:40159
--webserver_interface=127.26.206.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.254.keytab
--principal=kudu/127.26.206.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.206.212:44421
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.206.254:40159
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:50:27.683605 1357 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:50:27.683979 1357 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:50:27.684165 1357 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:50:27.691469 1357 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:50:27.691640 1357 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:50:27.691749 1357 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:50:27.691852 1357 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:50:27.691921 1357 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:50:27.701469 1357 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:44421
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200577490656-27451-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200577490656-27451-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.206.254:40159
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.254.keytab
--principal=kudu/127.26.206.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.206.254:40159
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.206.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200577490656-27451-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:50:27.702760 1357 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:50:27.704087 1357 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:50:27.715903 1367 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:50:27.716045 1363 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:50:27.715952 1364 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:50:27.717057 1357 server_base.cc:1034] running on GCE node
I20260808 14:50:27.717792 1357 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:50:27.719115 1357 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:50:27.720345 1357 hybrid_clock.cc:648] HybridClock initialized: now 1786200627720293 us; error 37 us; skew 500 ppm
I20260808 14:50:27.720677 1357 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:50:27 dist-test-slave-6k22 krb5kdc[1340](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200627, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:50:27.727039 1357 init.cc:377] Logged in from keytab as kudu/127.26.206.254@KRBTEST.COM (short username kudu)
I20260808 14:50:27.728575 1357 webserver.cc:460] Webserver started at http://127.26.206.254:38869/ using document root <none> and password file <none>
I20260808 14:50:27.729249 1357 fs_manager.cc:359] Metadata directory not provided
I20260808 14:50:27.729408 1357 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:50:27.729732 1357 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:50:27.732781 1357 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200577490656-27451-0/minicluster-data/master-0/data/instance:
uuid: "fd46905ec5964dd3af83a3da85a3297b"
format_stamp: "Formatted at 2026-08-08 14:50:27 on dist-test-slave-6k22"
server_key: "fd5ed67ab23fa789fe5a41a0d4a03375"
server_key_iv: "7fafa0f2ac1ee582320b2bf36bfd80aa"
server_key_version: "encryptionkey@0"
I20260808 14:50:27.733563 1357 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200577490656-27451-0/minicluster-data/master-0/wal/instance:
uuid: "fd46905ec5964dd3af83a3da85a3297b"
format_stamp: "Formatted at 2026-08-08 14:50:27 on dist-test-slave-6k22"
server_key: "fd5ed67ab23fa789fe5a41a0d4a03375"
server_key_iv: "7fafa0f2ac1ee582320b2bf36bfd80aa"
server_key_version: "encryptionkey@0"
I20260808 14:50:27.738569 1357 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.005s
I20260808 14:50:27.741879 1375 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:50:27.743100 1357 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260808 14:50:27.743292 1357 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200577490656-27451-0/minicluster-data/master-0/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200577490656-27451-0/minicluster-data/master-0/wal
uuid: "fd46905ec5964dd3af83a3da85a3297b"
format_stamp: "Formatted at 2026-08-08 14:50:27 on dist-test-slave-6k22"
server_key: "fd5ed67ab23fa789fe5a41a0d4a03375"
server_key_iv: "7fafa0f2ac1ee582320b2bf36bfd80aa"
server_key_version: "encryptionkey@0"
I20260808 14:50:27.743482 1357 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200577490656-27451-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200577490656-27451-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200577490656-27451-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:50:27.758834 1357 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:50:27.762537 1357 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:50:27.762821 1357 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:50:27.781530 1357 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.254:40159
I20260808 14:50:27.781564 1436 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.254:40159 every 8 connection(s)
I20260808 14:50:27.782909 1357 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
I20260808 14:50:27.786424 1437 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:50:27.791262 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 1357
I20260808 14:50:27.791512 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200577490656-27451-0/minicluster-data/master-0/wal/instance
I20260808 14:50:27.792322 27451 external_mini_cluster.cc:1428] Setting key d774fc5098158da3d4706b8afe8a195f
I20260808 14:50:27.797910 1437 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fd46905ec5964dd3af83a3da85a3297b: Bootstrap starting.
I20260808 14:50:27.801625 1437 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fd46905ec5964dd3af83a3da85a3297b: Neither blocks nor log segments found. Creating new log.
I20260808 14:50:27.802783 1437 log.cc:824] T 00000000000000000000000000000000 P fd46905ec5964dd3af83a3da85a3297b: Log is configured to *not* fsync() on all Append() calls
I20260808 14:50:27.805567 1437 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fd46905ec5964dd3af83a3da85a3297b: No bootstrap required, opened a new log
Aug 08 14:50:27 dist-test-slave-6k22 krb5kdc[1340](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200627, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.206.254@KRBTEST.COM
I20260808 14:50:27.815953 1441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:27.794303 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58108 (local address 127.26.206.254:40159)
0808 14:50:27.795190 (+ 887us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:27.795201 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:27.795245 (+ 44us) server_negotiation.cc:407] Connection header received
0808 14:50:27.797026 (+ 1781us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:27.797047 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:27.797417 (+ 370us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:27.797726 (+ 309us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:27.799524 (+ 1798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:27.800861 (+ 1337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:27.802574 (+ 1713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:27.803416 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:27.803640 (+ 224us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:27.807433 (+ 3793us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:50:27.807447 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:50:27.807470 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:50:27.807532 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:50:27.811622 (+ 4090us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:27.812271 (+ 649us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:27.812279 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:27.812287 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:27.812500 (+ 213us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:27.812871 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:27.812875 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:27.812879 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:27.813537 (+ 658us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:50:27.813827 (+ 290us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:27.814160 (+ 333us) server_negotiation.cc:299] Negotiation successful
0808 14:50:27.814600 (+ 440us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":657,"thread_start_us":453,"threads_started":1}
I20260808 14:50:27.816115 1437 raft_consensus.cc:348] T 00000000000000000000000000000000 P fd46905ec5964dd3af83a3da85a3297b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd46905ec5964dd3af83a3da85a3297b" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 40159 } }
I20260808 14:50:27.816545 1437 raft_consensus.cc:374] T 00000000000000000000000000000000 P fd46905ec5964dd3af83a3da85a3297b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:50:27.816682 1437 raft_consensus.cc:729] T 00000000000000000000000000000000 P fd46905ec5964dd3af83a3da85a3297b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd46905ec5964dd3af83a3da85a3297b, State: Initialized, Role: FOLLOWER
I20260808 14:50:27.817265 1437 consensus_queue.cc:260] T 00000000000000000000000000000000 P fd46905ec5964dd3af83a3da85a3297b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd46905ec5964dd3af83a3da85a3297b" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 40159 } }
I20260808 14:50:27.817579 1437 raft_consensus.cc:388] T 00000000000000000000000000000000 P fd46905ec5964dd3af83a3da85a3297b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:50:27.817734 1437 raft_consensus.cc:482] T 00000000000000000000000000000000 P fd46905ec5964dd3af83a3da85a3297b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:50:27.817937 1437 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fd46905ec5964dd3af83a3da85a3297b [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:50:27.820506 1437 raft_consensus.cc:504] T 00000000000000000000000000000000 P fd46905ec5964dd3af83a3da85a3297b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd46905ec5964dd3af83a3da85a3297b" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 40159 } }
I20260808 14:50:27.821108 1437 leader_election.cc:302] T 00000000000000000000000000000000 P fd46905ec5964dd3af83a3da85a3297b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fd46905ec5964dd3af83a3da85a3297b; no voters:
I20260808 14:50:27.821660 1437 leader_election.cc:288] T 00000000000000000000000000000000 P fd46905ec5964dd3af83a3da85a3297b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:50:27.821791 1443 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fd46905ec5964dd3af83a3da85a3297b [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:50:27.822533 1443 raft_consensus.cc:686] T 00000000000000000000000000000000 P fd46905ec5964dd3af83a3da85a3297b [term 1 LEADER]: Becoming Leader. State: Replica: fd46905ec5964dd3af83a3da85a3297b, State: Running, Role: LEADER
I20260808 14:50:27.823081 1443 consensus_queue.cc:237] T 00000000000000000000000000000000 P fd46905ec5964dd3af83a3da85a3297b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd46905ec5964dd3af83a3da85a3297b" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 40159 } }
I20260808 14:50:27.823841 1437 sys_catalog.cc:564] T 00000000000000000000000000000000 P fd46905ec5964dd3af83a3da85a3297b [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:50:27.826128 1445 sys_catalog.cc:455] T 00000000000000000000000000000000 P fd46905ec5964dd3af83a3da85a3297b [sys.catalog]: SysCatalogTable state changed. Reason: New leader fd46905ec5964dd3af83a3da85a3297b. Latest consensus state: current_term: 1 leader_uuid: "fd46905ec5964dd3af83a3da85a3297b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd46905ec5964dd3af83a3da85a3297b" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 40159 } } }
I20260808 14:50:27.826506 1445 sys_catalog.cc:458] T 00000000000000000000000000000000 P fd46905ec5964dd3af83a3da85a3297b [sys.catalog]: This master's current role is: LEADER
I20260808 14:50:27.826311 1444 sys_catalog.cc:455] T 00000000000000000000000000000000 P fd46905ec5964dd3af83a3da85a3297b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fd46905ec5964dd3af83a3da85a3297b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd46905ec5964dd3af83a3da85a3297b" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 40159 } } }
I20260808 14:50:27.826701 1444 sys_catalog.cc:458] T 00000000000000000000000000000000 P fd46905ec5964dd3af83a3da85a3297b [sys.catalog]: This master's current role is: LEADER
I20260808 14:50:27.829746 1451 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:50:27.835002 1451 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:50:27.843813 1451 catalog_manager.cc:1347] Generated new cluster ID: f432ea714e3847199338c00acd647f65
I20260808 14:50:27.843924 1451 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:50:27.878512 1451 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:50:27.879901 1451 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:50:27.890601 1451 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fd46905ec5964dd3af83a3da85a3297b: Generated new TSK 0
I20260808 14:50:27.891430 1451 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.206.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.206.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.206.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.193.keytab.
Entry for principal kudu/127.26.206.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.193.keytab.
I20260808 14:50:27.955405 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200577490656-27451-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200577490656-27451-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200577490656-27451-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200577490656-27451-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.206.193:0
--local_ip_for_outbound_sockets=127.26.206.193
--webserver_interface=127.26.206.193
--webserver_port=0
--tserver_master_addrs=127.26.206.254:40159
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.193.keytab
--principal=kudu/127.26.206.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.206.212:44421
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:50:28.297202 1465 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:50:28.297468 1465 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:50:28.297569 1465 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:50:28.304814 1465 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:50:28.304919 1465 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:50:28.305037 1465 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.206.193
I20260808 14:50:28.314718 1465 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:44421
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200577490656-27451-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200577490656-27451-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.193.keytab
--principal=kudu/127.26.206.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.206.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200577490656-27451-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.206.193
--webserver_port=0
--tserver_master_addrs=127.26.206.254:40159
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.206.193
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200577490656-27451-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:50:28.316049 1465 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:50:28.317363 1465 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:50:28.332019 1472 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:50:28.332077 1474 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:50:28.332129 1471 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:50:28.332665 1465 server_base.cc:1034] running on GCE node
I20260808 14:50:28.333253 1465 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:50:28.334601 1465 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:50:28.335834 1465 hybrid_clock.cc:648] HybridClock initialized: now 1786200628335779 us; error 50 us; skew 500 ppm
I20260808 14:50:28.336144 1465 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:50:28 dist-test-slave-6k22 krb5kdc[1340](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200628, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:50:28.339327 1465 init.cc:377] Logged in from keytab as kudu/127.26.206.193@KRBTEST.COM (short username kudu)
I20260808 14:50:28.340796 1465 webserver.cc:460] Webserver started at http://127.26.206.193:38659/ using document root <none> and password file <none>
I20260808 14:50:28.341454 1465 fs_manager.cc:359] Metadata directory not provided
I20260808 14:50:28.341605 1465 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:50:28.341921 1465 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:50:28.344763 1465 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200577490656-27451-0/minicluster-data/ts-0/data/instance:
uuid: "eca379218eeb41e4b56f5c3e2f45ac74"
format_stamp: "Formatted at 2026-08-08 14:50:28 on dist-test-slave-6k22"
server_key: "b889589d0dbf6cf71639b2661f9215aa"
server_key_iv: "5b316a0eadb796131a949ab681036c5d"
server_key_version: "encryptionkey@0"
I20260808 14:50:28.345563 1465 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200577490656-27451-0/minicluster-data/ts-0/wal/instance:
uuid: "eca379218eeb41e4b56f5c3e2f45ac74"
format_stamp: "Formatted at 2026-08-08 14:50:28 on dist-test-slave-6k22"
server_key: "b889589d0dbf6cf71639b2661f9215aa"
server_key_iv: "5b316a0eadb796131a949ab681036c5d"
server_key_version: "encryptionkey@0"
I20260808 14:50:28.350365 1465 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260808 14:50:28.353905 1484 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:50:28.355207 1465 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260808 14:50:28.355370 1465 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200577490656-27451-0/minicluster-data/ts-0/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200577490656-27451-0/minicluster-data/ts-0/wal
uuid: "eca379218eeb41e4b56f5c3e2f45ac74"
format_stamp: "Formatted at 2026-08-08 14:50:28 on dist-test-slave-6k22"
server_key: "b889589d0dbf6cf71639b2661f9215aa"
server_key_iv: "5b316a0eadb796131a949ab681036c5d"
server_key_version: "encryptionkey@0"
I20260808 14:50:28.355561 1465 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200577490656-27451-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200577490656-27451-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200577490656-27451-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:50:28.371847 1465 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:50:28.376135 1465 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:50:28.376434 1465 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:50:28.377373 1465 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:50:28.378734 1465 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:50:28.378841 1465 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:50:28.378989 1465 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:50:28.379060 1465 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:50:28.412159 1465 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.193:38825
I20260808 14:50:28.412216 1615 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.193:38825 every 8 connection(s)
I20260808 14:50:28.413450 1465 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200577490656-27451-0/minicluster-data/ts-0/data/info.pb
I20260808 14:50:28.416793 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 1465
I20260808 14:50:28.417026 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200577490656-27451-0/minicluster-data/ts-0/wal/instance
I20260808 14:50:28.417716 27451 external_mini_cluster.cc:1428] Setting key 92a372b7279546dd3c13984c35b83f80
Aug 08 14:50:28 dist-test-slave-6k22 krb5kdc[1340](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200628, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.193@KRBTEST.COM for kudu/127.26.206.254@KRBTEST.COM
I20260808 14:50:28.434113 1619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:28.416010 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.193:58629 (local address 127.26.206.254:40159)
0808 14:50:28.416527 (+ 517us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:28.416534 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:28.417600 (+ 1066us) server_negotiation.cc:407] Connection header received
0808 14:50:28.419687 (+ 2087us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:28.419692 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:28.419786 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:28.419899 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:28.421345 (+ 1446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:28.422075 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:28.423614 (+ 1539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:28.424044 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:28.424172 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:28.428295 (+ 4123us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:50:28.428300 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:50:28.428303 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:50:28.428334 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:50:28.431064 (+ 2730us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:28.431865 (+ 801us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:28.431872 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:28.431878 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:28.432005 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:28.432449 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:28.432454 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:28.432459 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:28.432705 (+ 246us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:50:28.432866 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:28.433536 (+ 670us) server_negotiation.cc:299] Negotiation successful
0808 14:50:28.433751 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":364,"thread_start_us":237,"threads_started":1}
I20260808 14:50:28.434978 1620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:28.416587 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:40159 (local address 127.26.206.193:58629)
0808 14:50:28.417423 (+ 836us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:28.417476 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0808 14:50:28.419380 (+ 1904us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:50:28.420138 (+ 758us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:50:28.420146 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:50:28.420640 (+ 494us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:50:28.421171 (+ 531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:28.421188 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:28.422245 (+ 1057us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:28.422249 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:28.423455 (+ 1206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:28.423466 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:28.424281 (+ 815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:28.424289 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:28.424595 (+ 306us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:28.425391 (+ 796us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:50:28.425429 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:50:28.428067 (+ 2638us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:50:28.431223 (+ 3156us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:50:28.431231 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:50:28.431264 (+ 33us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:50:28.431745 (+ 481us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:50:28.432127 (+ 382us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:50:28.432132 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:50:28.432136 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:50:28.432318 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:50:28.432842 (+ 524us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:50:28.432849 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:50:28.433149 (+ 300us) client_negotiation.cc:769] Sending connection context
0808 14:50:28.433426 (+ 277us) client_negotiation.cc:240] Negotiation successful
0808 14:50:28.433941 (+ 515us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":559,"thread_start_us":374,"threads_started":1}
I20260808 14:50:28.436628 1616 heartbeater.cc:347] Connected to a master server at 127.26.206.254:40159
I20260808 14:50:28.436923 1616 heartbeater.cc:464] Registering TS with master...
I20260808 14:50:28.437609 1616 heartbeater.cc:511] Master 127.26.206.254:40159 requested a full tablet report, sending...
I20260808 14:50:28.439973 1395 ts_manager.cc:194] Registered new tserver with Master: eca379218eeb41e4b56f5c3e2f45ac74 (127.26.206.193:38825)
WARNING: no policy specified for kudu/127.26.206.194@KRBTEST.COM; defaulting to no policy
I20260808 14:50:28.442096 1395 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.206.193@KRBTEST.COM'} at 127.26.206.193:58629
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.206.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.206.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.194.keytab.
Entry for principal kudu/127.26.206.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.194.keytab.
I20260808 14:50:28.470407 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200577490656-27451-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200577490656-27451-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200577490656-27451-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200577490656-27451-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.206.194:0
--local_ip_for_outbound_sockets=127.26.206.194
--webserver_interface=127.26.206.194
--webserver_port=0
--tserver_master_addrs=127.26.206.254:40159
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.194.keytab
--principal=kudu/127.26.206.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.206.212:44421
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:50:28.807371 1624 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:50:28.807708 1624 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:50:28.807813 1624 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:50:28.814924 1624 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:50:28.815018 1624 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:50:28.815135 1624 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.206.194
I20260808 14:50:28.824523 1624 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:44421
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200577490656-27451-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200577490656-27451-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.194.keytab
--principal=kudu/127.26.206.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.206.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200577490656-27451-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.206.194
--webserver_port=0
--tserver_master_addrs=127.26.206.254:40159
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.206.194
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200577490656-27451-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:50:28.825768 1624 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:50:28.826979 1624 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:50:28.839666 1630 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:50:28.839941 1631 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:50:28.840021 1634 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:50:28.840878 1624 server_base.cc:1034] running on GCE node
I20260808 14:50:28.841424 1624 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:50:28.842252 1624 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:50:28.843456 1624 hybrid_clock.cc:648] HybridClock initialized: now 1786200628843384 us; error 48 us; skew 500 ppm
I20260808 14:50:28.843812 1624 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:50:28 dist-test-slave-6k22 krb5kdc[1340](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200628, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:50:28.847178 1624 init.cc:377] Logged in from keytab as kudu/127.26.206.194@KRBTEST.COM (short username kudu)
I20260808 14:50:28.848677 1624 webserver.cc:460] Webserver started at http://127.26.206.194:33279/ using document root <none> and password file <none>
I20260808 14:50:28.849298 1624 fs_manager.cc:359] Metadata directory not provided
I20260808 14:50:28.849400 1624 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:50:28.849647 1624 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:50:28.852564 1624 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200577490656-27451-0/minicluster-data/ts-1/data/instance:
uuid: "070a22971c9b42d5b2a8f253a596d4a0"
format_stamp: "Formatted at 2026-08-08 14:50:28 on dist-test-slave-6k22"
server_key: "9d4e5f57267ac2bd115557e11c73eac4"
server_key_iv: "3b7806b6fc939fff89834d8375279aa3"
server_key_version: "encryptionkey@0"
I20260808 14:50:28.853322 1624 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200577490656-27451-0/minicluster-data/ts-1/wal/instance:
uuid: "070a22971c9b42d5b2a8f253a596d4a0"
format_stamp: "Formatted at 2026-08-08 14:50:28 on dist-test-slave-6k22"
server_key: "9d4e5f57267ac2bd115557e11c73eac4"
server_key_iv: "3b7806b6fc939fff89834d8375279aa3"
server_key_version: "encryptionkey@0"
I20260808 14:50:28.858225 1624 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260808 14:50:28.861644 1641 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:50:28.862974 1624 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 14:50:28.863157 1624 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200577490656-27451-0/minicluster-data/ts-1/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200577490656-27451-0/minicluster-data/ts-1/wal
uuid: "070a22971c9b42d5b2a8f253a596d4a0"
format_stamp: "Formatted at 2026-08-08 14:50:28 on dist-test-slave-6k22"
server_key: "9d4e5f57267ac2bd115557e11c73eac4"
server_key_iv: "3b7806b6fc939fff89834d8375279aa3"
server_key_version: "encryptionkey@0"
I20260808 14:50:28.863353 1624 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200577490656-27451-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200577490656-27451-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200577490656-27451-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:50:28.875164 1624 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:50:28.878952 1624 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:50:28.879236 1624 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:50:28.880203 1624 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:50:28.881417 1624 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:50:28.881505 1624 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:50:28.881666 1624 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:50:28.881716 1624 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:50:28.914227 1624 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.194:36825
I20260808 14:50:28.914263 1772 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.194:36825 every 8 connection(s)
I20260808 14:50:28.915450 1624 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200577490656-27451-0/minicluster-data/ts-1/data/info.pb
I20260808 14:50:28.923260 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 1624
I20260808 14:50:28.923530 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200577490656-27451-0/minicluster-data/ts-1/wal/instance
I20260808 14:50:28.923980 27451 external_mini_cluster.cc:1428] Setting key b764757d0c50e8973b7f7dcb3659c0ee
Aug 08 14:50:28 dist-test-slave-6k22 krb5kdc[1340](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200628, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.194@KRBTEST.COM for kudu/127.26.206.254@KRBTEST.COM
I20260808 14:50:28.936666 1619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:28.918016 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.194:41043 (local address 127.26.206.254:40159)
0808 14:50:28.918258 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:28.918263 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:28.919420 (+ 1157us) server_negotiation.cc:407] Connection header received
0808 14:50:28.921588 (+ 2168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:28.921594 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:28.921700 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:28.921823 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:28.923362 (+ 1539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:28.924369 (+ 1007us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:28.926368 (+ 1999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:28.926839 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:28.926976 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:28.930867 (+ 3891us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:50:28.930872 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:50:28.930875 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:50:28.930906 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:50:28.933545 (+ 2639us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:28.934377 (+ 832us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:28.934383 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:28.934387 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:28.934514 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:28.934938 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:28.934943 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:28.934946 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:28.935276 (+ 330us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:50:28.935496 (+ 220us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:28.936130 (+ 634us) server_negotiation.cc:299] Negotiation successful
0808 14:50:28.936345 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":111}
I20260808 14:50:28.937865 1775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:28.918497 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:40159 (local address 127.26.206.194:41043)
0808 14:50:28.919239 (+ 742us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:28.919283 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 14:50:28.921303 (+ 2020us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:50:28.922058 (+ 755us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:50:28.922067 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:50:28.922590 (+ 523us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:50:28.923180 (+ 590us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:28.923198 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:28.924534 (+ 1336us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:28.924538 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:28.926218 (+ 1680us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:28.926236 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:28.927114 (+ 878us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:28.927122 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:28.927356 (+ 234us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:28.928123 (+ 767us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:50:28.928144 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:50:28.930639 (+ 2495us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:50:28.933760 (+ 3121us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:50:28.933768 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:50:28.933782 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:50:28.934264 (+ 482us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:50:28.934623 (+ 359us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:50:28.934628 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:50:28.934632 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:50:28.934808 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:50:28.935470 (+ 662us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:50:28.935477 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:50:28.935810 (+ 333us) client_negotiation.cc:769] Sending connection context
0808 14:50:28.936050 (+ 240us) client_negotiation.cc:240] Negotiation successful
0808 14:50:28.936508 (+ 458us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":505,"thread_start_us":299,"threads_started":1}
I20260808 14:50:28.939246 1773 heartbeater.cc:347] Connected to a master server at 127.26.206.254:40159
I20260808 14:50:28.939601 1773 heartbeater.cc:464] Registering TS with master...
I20260808 14:50:28.940443 1773 heartbeater.cc:511] Master 127.26.206.254:40159 requested a full tablet report, sending...
I20260808 14:50:28.941913 1395 ts_manager.cc:194] Registered new tserver with Master: 070a22971c9b42d5b2a8f253a596d4a0 (127.26.206.194:36825)
I20260808 14:50:28.942705 1395 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.206.194@KRBTEST.COM'} at 127.26.206.194:41043
WARNING: no policy specified for kudu/127.26.206.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.206.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.206.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.195.keytab.
Entry for principal kudu/127.26.206.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.195.keytab.
I20260808 14:50:28.978386 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200577490656-27451-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200577490656-27451-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200577490656-27451-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200577490656-27451-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.206.195:0
--local_ip_for_outbound_sockets=127.26.206.195
--webserver_interface=127.26.206.195
--webserver_port=0
--tserver_master_addrs=127.26.206.254:40159
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.195.keytab
--principal=kudu/127.26.206.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.206.212:44421
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:50:29.302603 1778 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:50:29.302943 1778 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:50:29.303138 1778 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:50:29.310829 1778 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:50:29.310983 1778 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:50:29.311197 1778 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.206.195
I20260808 14:50:29.322873 1778 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:44421
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200577490656-27451-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200577490656-27451-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.195.keytab
--principal=kudu/127.26.206.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.206.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200577490656-27451-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.206.195
--webserver_port=0
--tserver_master_addrs=127.26.206.254:40159
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.206.195
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200577490656-27451-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:50:29.324180 1778 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:50:29.325531 1778 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:50:29.339107 1783 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:50:29.339190 1784 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:50:29.339255 1786 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:50:29.340497 1778 server_base.cc:1034] running on GCE node
I20260808 14:50:29.341055 1778 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:50:29.341928 1778 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:50:29.343165 1778 hybrid_clock.cc:648] HybridClock initialized: now 1786200629343099 us; error 55 us; skew 500 ppm
I20260808 14:50:29.343482 1778 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:50:29 dist-test-slave-6k22 krb5kdc[1340](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200629, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:50:29.346455 1778 init.cc:377] Logged in from keytab as kudu/127.26.206.195@KRBTEST.COM (short username kudu)
I20260808 14:50:29.347927 1778 webserver.cc:460] Webserver started at http://127.26.206.195:36381/ using document root <none> and password file <none>
I20260808 14:50:29.348601 1778 fs_manager.cc:359] Metadata directory not provided
I20260808 14:50:29.348747 1778 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:50:29.349063 1778 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:50:29.352015 1778 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200577490656-27451-0/minicluster-data/ts-2/data/instance:
uuid: "778256a0893c4beda2f424c5b15a3bf5"
format_stamp: "Formatted at 2026-08-08 14:50:29 on dist-test-slave-6k22"
server_key: "ac8ac13d6f710bc360f4b669b0375c4a"
server_key_iv: "2cec88edd30ed905242bea0e1f9f399d"
server_key_version: "encryptionkey@0"
I20260808 14:50:29.352773 1778 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200577490656-27451-0/minicluster-data/ts-2/wal/instance:
uuid: "778256a0893c4beda2f424c5b15a3bf5"
format_stamp: "Formatted at 2026-08-08 14:50:29 on dist-test-slave-6k22"
server_key: "ac8ac13d6f710bc360f4b669b0375c4a"
server_key_iv: "2cec88edd30ed905242bea0e1f9f399d"
server_key_version: "encryptionkey@0"
I20260808 14:50:29.357687 1778 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260808 14:50:29.361277 1793 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:50:29.362562 1778 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.001s
I20260808 14:50:29.362746 1778 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200577490656-27451-0/minicluster-data/ts-2/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200577490656-27451-0/minicluster-data/ts-2/wal
uuid: "778256a0893c4beda2f424c5b15a3bf5"
format_stamp: "Formatted at 2026-08-08 14:50:29 on dist-test-slave-6k22"
server_key: "ac8ac13d6f710bc360f4b669b0375c4a"
server_key_iv: "2cec88edd30ed905242bea0e1f9f399d"
server_key_version: "encryptionkey@0"
I20260808 14:50:29.362957 1778 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200577490656-27451-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200577490656-27451-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200577490656-27451-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:50:29.375465 1778 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:50:29.379647 1778 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:50:29.379946 1778 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:50:29.380882 1778 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:50:29.382244 1778 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:50:29.382354 1778 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:50:29.382498 1778 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:50:29.382575 1778 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:50:29.419924 1778 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.195:46179
I20260808 14:50:29.419977 1919 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.195:46179 every 8 connection(s)
I20260808 14:50:29.421177 1778 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200577490656-27451-0/minicluster-data/ts-2/data/info.pb
I20260808 14:50:29.431092 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 1778
I20260808 14:50:29.431300 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200577490656-27451-0/minicluster-data/ts-2/wal/instance
I20260808 14:50:29.431806 27451 external_mini_cluster.cc:1428] Setting key 86a0eb17455b21e94ade9c439a1d7660
Aug 08 14:50:29 dist-test-slave-6k22 krb5kdc[1340](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200629, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.195@KRBTEST.COM for kudu/127.26.206.254@KRBTEST.COM
I20260808 14:50:29.440874 1619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:29.423714 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.195:60241 (local address 127.26.206.254:40159)
0808 14:50:29.423895 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:29.423899 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:29.425056 (+ 1157us) server_negotiation.cc:407] Connection header received
0808 14:50:29.426795 (+ 1739us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:29.426800 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:29.426894 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:29.427004 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:29.428511 (+ 1507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:29.429370 (+ 859us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:29.430986 (+ 1616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:29.431511 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:29.431692 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:29.435470 (+ 3778us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:50:29.435475 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:50:29.435478 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:50:29.435510 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:50:29.438227 (+ 2717us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:29.438971 (+ 744us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:29.438974 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:29.438976 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:29.439099 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:29.439453 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:29.439456 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:29.439458 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:29.439770 (+ 312us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:50:29.439881 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:29.440463 (+ 582us) server_negotiation.cc:299] Negotiation successful
0808 14:50:29.440615 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260808 14:50:29.441757 1922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:29.424128 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:40159 (local address 127.26.206.195:60241)
0808 14:50:29.424891 (+ 763us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:29.424933 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 14:50:29.426530 (+ 1597us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:50:29.427228 (+ 698us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:50:29.427237 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:50:29.427787 (+ 550us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:50:29.428341 (+ 554us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:29.428358 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:29.429546 (+ 1188us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:29.429553 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:29.430841 (+ 1288us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:29.430852 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:29.431792 (+ 940us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:29.431799 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:29.432089 (+ 290us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:29.432768 (+ 679us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:50:29.432795 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:50:29.435293 (+ 2498us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:50:29.438367 (+ 3074us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:50:29.438374 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:50:29.438387 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:50:29.438873 (+ 486us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:50:29.439191 (+ 318us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:50:29.439194 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:50:29.439196 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:50:29.439363 (+ 167us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:50:29.439875 (+ 512us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:50:29.439880 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:50:29.440159 (+ 279us) client_negotiation.cc:769] Sending connection context
0808 14:50:29.440374 (+ 215us) client_negotiation.cc:240] Negotiation successful
0808 14:50:29.440715 (+ 341us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":536,"thread_start_us":350,"threads_started":1}
I20260808 14:50:29.443109 1920 heartbeater.cc:347] Connected to a master server at 127.26.206.254:40159
I20260808 14:50:29.443385 1920 heartbeater.cc:464] Registering TS with master...
I20260808 14:50:29.444087 1920 heartbeater.cc:511] Master 127.26.206.254:40159 requested a full tablet report, sending...
I20260808 14:50:29.444849 1616 heartbeater.cc:503] Master 127.26.206.254:40159 was elected leader, sending a full tablet report...
I20260808 14:50:29.445658 1395 ts_manager.cc:194] Registered new tserver with Master: 778256a0893c4beda2f424c5b15a3bf5 (127.26.206.195:46179)
I20260808 14:50:29.446858 1395 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.206.195@KRBTEST.COM'} at 127.26.206.195:60241
I20260808 14:50:29.447341 27451 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200577490656-27451-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200577490656-27451-0/krb5kdc/test-admin.keytab.
Aug 08 14:50:29 dist-test-slave-6k22 krb5kdc[1340](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200629, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:50:29.480561 27451 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260808 14:50:29.485803 1928 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:50:29.483259 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45386 (local address 127.26.206.193:38825)
0808 14:50:29.483933 (+ 674us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:29.483940 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:29.483967 (+ 27us) server_negotiation.cc:407] Connection header received
0808 14:50:29.484027 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:29.484034 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:29.484245 (+ 211us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:29.484417 (+ 172us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:29.485339 (+ 922us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45386: BlockingRecv error: recv got EOF from 127.0.0.1:45386 (error 108)
Metrics: {"server-negotiator.queue_time_us":531,"thread_start_us":362,"threads_started":1}
W20260808 14:50:29.485795 27451 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200577490656-27451-0/krb5kdc/krb5cc' of type FILE
Aug 08 14:50:29 dist-test-slave-6k22 krb5kdc[1340](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200629, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:50:29.487344 27451 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 08 14:50:29 dist-test-slave-6k22 krb5kdc[1340](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200629, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:50:29.488754 27451 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 08 14:50:29 dist-test-slave-6k22 krb5kdc[1340](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200629, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.206.193@KRBTEST.COM
I20260808 14:50:29.503837 1928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:29.490420 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45398 (local address 127.26.206.193:38825)
0808 14:50:29.490609 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:29.490615 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:29.490774 (+ 159us) server_negotiation.cc:407] Connection header received
0808 14:50:29.490910 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:29.490914 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:29.490971 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:29.491052 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:29.492069 (+ 1017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:29.493033 (+ 964us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:29.494253 (+ 1220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:29.494806 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:29.494941 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:29.498387 (+ 3446us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:50:29.498410 (+ 23us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:50:29.498424 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:50:29.498454 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:50:29.501126 (+ 2672us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:29.501795 (+ 669us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:29.501803 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:29.501805 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:29.501922 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:29.502286 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:29.502296 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:29.502299 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:29.502638 (+ 339us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:50:29.502943 (+ 305us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:29.503285 (+ 342us) server_negotiation.cc:299] Negotiation successful
0808 14:50:29.503539 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
W20260808 14:50:29.509431 1928 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:50:29.507741 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45404 (local address 127.26.206.193:38825)
0808 14:50:29.507888 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:29.507891 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:29.508274 (+ 383us) server_negotiation.cc:407] Connection header received
0808 14:50:29.508381 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:29.508384 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:29.508444 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:29.508519 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:29.509149 (+ 630us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45404: BlockingRecv error: recv got EOF from 127.0.0.1:45404 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
W20260808 14:50:29.509999 27451 init.cc:244] Error while opening credential cache '/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200577490656-27451-0/krb5kdc/krb5cc' of type FILE: Runtime error: End of credential cache reached (filename: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200577490656-27451-0/krb5kdc/krb5cc)
Aug 08 14:50:29 dist-test-slave-6k22 krb5kdc[1340](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200629, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:50:29.511493 27451 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 08 14:50:29 dist-test-slave-6k22 krb5kdc[1340](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200629, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:50:29.512799 27451 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 08 14:50:29 dist-test-slave-6k22 krb5kdc[1340](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200629, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.206.193@KRBTEST.COM
I20260808 14:50:29.526121 1928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:29.514094 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45406 (local address 127.26.206.193:38825)
0808 14:50:29.514222 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:29.514226 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:29.514471 (+ 245us) server_negotiation.cc:407] Connection header received
0808 14:50:29.514569 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:29.514572 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:29.514618 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:29.514686 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:29.515472 (+ 786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:29.516202 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:29.517350 (+ 1148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:29.517805 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:29.517893 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:29.521279 (+ 3386us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:50:29.521283 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:50:29.521286 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:50:29.521325 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:50:29.524103 (+ 2778us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:29.524662 (+ 559us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:29.524666 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:29.524668 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:29.524786 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:29.525122 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:29.525125 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:29.525127 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:29.525369 (+ 242us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:50:29.525602 (+ 233us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:29.525780 (+ 178us) server_negotiation.cc:299] Negotiation successful
0808 14:50:29.525919 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
W20260808 14:50:29.530546 1928 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:50:29.528711 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45420 (local address 127.26.206.193:38825)
0808 14:50:29.528915 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:29.528923 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:29.529173 (+ 250us) server_negotiation.cc:407] Connection header received
0808 14:50:29.529345 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:29.529350 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:29.529434 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:29.529521 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:29.530302 (+ 781us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45420: BlockingRecv error: recv got EOF from 127.0.0.1:45420 (error 108)
Metrics: {"server-negotiator.queue_time_us":72}
W20260808 14:50:29.530725 27451 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200577490656-27451-0/krb5kdc/krb5cc' of type FILE
Aug 08 14:50:29 dist-test-slave-6k22 krb5kdc[1340](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200629, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:50:29.532136 27451 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 08 14:50:29 dist-test-slave-6k22 krb5kdc[1340](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200629, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:50:29.533658 27451 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 08 14:50:29 dist-test-slave-6k22 krb5kdc[1340](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200629, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.206.193@KRBTEST.COM
I20260808 14:50:29.546849 1928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:29.534919 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45426 (local address 127.26.206.193:38825)
0808 14:50:29.535111 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:29.535117 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:29.535300 (+ 183us) server_negotiation.cc:407] Connection header received
0808 14:50:29.535409 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:29.535413 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:29.535464 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:29.535537 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:29.536483 (+ 946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:29.537137 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:29.538300 (+ 1163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:29.538704 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:29.538793 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:29.542160 (+ 3367us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:50:29.542165 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:50:29.542168 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:50:29.542195 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:50:29.544593 (+ 2398us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:29.545157 (+ 564us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:29.545160 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:29.545163 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:29.545309 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:29.545615 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:29.545618 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:29.545620 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:29.545870 (+ 250us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:50:29.546088 (+ 218us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:29.546333 (+ 245us) server_negotiation.cc:299] Negotiation successful
0808 14:50:29.546484 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260808 14:50:29.548398 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 1465
I20260808 14:50:29.559176 1928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:29.549055 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45440 (local address 127.26.206.193:38825)
0808 14:50:29.549189 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:29.549193 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:29.549570 (+ 377us) server_negotiation.cc:407] Connection header received
0808 14:50:29.549675 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:29.549678 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:29.549726 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:29.549806 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:29.550626 (+ 820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:29.551306 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:29.552539 (+ 1233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:29.552939 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:29.553051 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:29.554840 (+ 1789us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:50:29.554844 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:50:29.554848 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:50:29.554873 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:50:29.557137 (+ 2264us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:29.557663 (+ 526us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:29.557666 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:29.557668 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:29.557794 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:29.558111 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:29.558114 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:29.558116 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:29.558340 (+ 224us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:50:29.558584 (+ 244us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:29.558780 (+ 196us) server_negotiation.cc:299] Negotiation successful
0808 14:50:29.558928 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260808 14:50:29.559834 1611 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:50:29.643527 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 1465
I20260808 14:50:29.663921 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 1624
Aug 08 14:50:29 dist-test-slave-6k22 krb5kdc[1340](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200629, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.206.194@KRBTEST.COM
I20260808 14:50:29.678812 1942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:29.664793 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46228 (local address 127.26.206.194:36825)
0808 14:50:29.665394 (+ 601us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:29.665402 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:29.665427 (+ 25us) server_negotiation.cc:407] Connection header received
0808 14:50:29.665488 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:29.665494 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:29.665717 (+ 223us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:29.665849 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:29.666938 (+ 1089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:29.668305 (+ 1367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:29.669489 (+ 1184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:29.670006 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:29.670106 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:29.673871 (+ 3765us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:50:29.673881 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:50:29.673895 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:50:29.673924 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:50:29.676519 (+ 2595us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:29.677090 (+ 571us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:29.677096 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:29.677098 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:29.677210 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:29.677534 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:29.677537 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:29.677539 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:29.677844 (+ 305us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:50:29.678072 (+ 228us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:29.678324 (+ 252us) server_negotiation.cc:299] Negotiation successful
0808 14:50:29.678526 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":451,"thread_start_us":313,"threads_started":1}
I20260808 14:50:29.680090 1768 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:50:29.761636 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 1624
I20260808 14:50:29.780354 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 1778
Aug 08 14:50:29 dist-test-slave-6k22 krb5kdc[1340](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200629, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.206.195@KRBTEST.COM
I20260808 14:50:29.796978 1944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:29.781309 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40396 (local address 127.26.206.195:46179)
0808 14:50:29.782077 (+ 768us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:29.782083 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:29.782111 (+ 28us) server_negotiation.cc:407] Connection header received
0808 14:50:29.782173 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:29.782180 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:29.782391 (+ 211us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:29.782517 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:29.783858 (+ 1341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:29.784876 (+ 1018us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:29.786767 (+ 1891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:29.787334 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:29.787432 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:29.791970 (+ 4538us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:50:29.791981 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:50:29.791995 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:50:29.792027 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:50:29.794672 (+ 2645us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:29.795268 (+ 596us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:29.795275 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:29.795277 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:29.795395 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:29.795752 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:29.795756 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:29.795766 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:29.796081 (+ 315us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:50:29.796309 (+ 228us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:29.796503 (+ 194us) server_negotiation.cc:299] Negotiation successful
0808 14:50:29.796689 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":619,"thread_start_us":423,"threads_started":1}
I20260808 14:50:29.798282 1914 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:50:29.880182 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 1778
I20260808 14:50:29.898739 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 1357
I20260808 14:50:29.900007 1432 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:50:30.003806 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 1357
2026-08-08T14:50:30Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (4038 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:50:30 dist-test-slave-6k22 krb5kdc[1949](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:50:30 dist-test-slave-6k22 krb5kdc[1949](info): set up 2 sockets
Aug 08 14:50:30 dist-test-slave-6k22 krb5kdc[1949](info): commencing operation
krb5kdc: starting...
W20260808 14:50:31.187155 27451 mini_kdc.cc:121] Time spent starting KDC: real 1.136s user 0.000s sys 0.030s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/krb5kdc/test-user.keytab.
Aug 08 14:50:31 dist-test-slave-6k22 krb5kdc[1949](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200631, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:50:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:50:31Z Disabled control of system clock
WARNING: no policy specified for oryx/127.26.206.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.206.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.206.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/krb5kdc/oryx_127.26.206.254.keytab.
Entry for principal oryx/127.26.206.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/krb5kdc/oryx_127.26.206.254.keytab.
I20260808 14:50:31.421191 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.206.254:40317
--webserver_interface=127.26.206.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/krb5kdc/oryx_127.26.206.254.keytab
--principal=oryx/127.26.206.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.206.212:41683
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.206.254:40317
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:50:31.749920 1966 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:50:31.750204 1966 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:50:31.750301 1966 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:50:31.757194 1966 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:50:31.757309 1966 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:50:31.757368 1966 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:50:31.757436 1966 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:50:31.757484 1966 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:50:31.766850 1966 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:41683
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.206.254:40317
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/krb5kdc/oryx_127.26.206.254.keytab
--principal=oryx/127.26.206.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.206.254:40317
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.206.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:50:31.768036 1966 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:50:31.769305 1966 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:50:31.781394 1972 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:50:31.781360 1976 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:50:31.781376 1973 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:50:31.782079 1966 server_base.cc:1034] running on GCE node
I20260808 14:50:31.782914 1966 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:50:31.784346 1966 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:50:31.785573 1966 hybrid_clock.cc:648] HybridClock initialized: now 1786200631785537 us; error 53 us; skew 500 ppm
I20260808 14:50:31.785913 1966 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:50:31 dist-test-slave-6k22 krb5kdc[1949](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200631, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.206.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:50:31.789156 1966 init.cc:377] Logged in from keytab as oryx/127.26.206.254@KRBTEST.COM (short username oryx)
I20260808 14:50:31.790678 1966 webserver.cc:460] Webserver started at http://127.26.206.254:46733/ using document root <none> and password file <none>
I20260808 14:50:31.791371 1966 fs_manager.cc:359] Metadata directory not provided
I20260808 14:50:31.791586 1966 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:50:31.791944 1966 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:50:31.794783 1966 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/master-0/data/instance:
uuid: "7ec633ac085e4b5aa53213a2f91b43fa"
format_stamp: "Formatted at 2026-08-08 14:50:31 on dist-test-slave-6k22"
server_key: "806f66978007680f2e335660bca9c839"
server_key_iv: "4357eb6d3962284827d603dcf432e8f0"
server_key_version: "encryptionkey@0"
I20260808 14:50:31.795601 1966 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/master-0/wal/instance:
uuid: "7ec633ac085e4b5aa53213a2f91b43fa"
format_stamp: "Formatted at 2026-08-08 14:50:31 on dist-test-slave-6k22"
server_key: "806f66978007680f2e335660bca9c839"
server_key_iv: "4357eb6d3962284827d603dcf432e8f0"
server_key_version: "encryptionkey@0"
I20260808 14:50:31.800593 1966 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260808 14:50:31.803805 1983 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:50:31.805030 1966 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260808 14:50:31.805227 1966 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/master-0/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/master-0/wal
uuid: "7ec633ac085e4b5aa53213a2f91b43fa"
format_stamp: "Formatted at 2026-08-08 14:50:31 on dist-test-slave-6k22"
server_key: "806f66978007680f2e335660bca9c839"
server_key_iv: "4357eb6d3962284827d603dcf432e8f0"
server_key_version: "encryptionkey@0"
I20260808 14:50:31.805421 1966 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:50:31.830629 1966 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:50:31.834650 1966 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:50:31.834965 1966 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:50:31.853439 1966 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.254:40317
I20260808 14:50:31.853473 2041 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.254:40317 every 8 connection(s)
I20260808 14:50:31.854775 1966 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
I20260808 14:50:31.858263 2042 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:50:31.862416 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 1966
I20260808 14:50:31.862641 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/master-0/wal/instance
I20260808 14:50:31.863538 27451 external_mini_cluster.cc:1428] Setting key aa454cbdaa2d422504197c4a9683e213
I20260808 14:50:31.872575 2042 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7ec633ac085e4b5aa53213a2f91b43fa: Bootstrap starting.
I20260808 14:50:31.876235 2042 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7ec633ac085e4b5aa53213a2f91b43fa: Neither blocks nor log segments found. Creating new log.
I20260808 14:50:31.877522 2042 log.cc:824] T 00000000000000000000000000000000 P 7ec633ac085e4b5aa53213a2f91b43fa: Log is configured to *not* fsync() on all Append() calls
I20260808 14:50:31.880853 2042 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7ec633ac085e4b5aa53213a2f91b43fa: No bootstrap required, opened a new log
Aug 08 14:50:31 dist-test-slave-6k22 krb5kdc[1949](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200631, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.26.206.254@KRBTEST.COM
I20260808 14:50:31.892755 2042 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7ec633ac085e4b5aa53213a2f91b43fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ec633ac085e4b5aa53213a2f91b43fa" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 40317 } }
I20260808 14:50:31.893157 2042 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7ec633ac085e4b5aa53213a2f91b43fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:50:31.893363 2042 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7ec633ac085e4b5aa53213a2f91b43fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ec633ac085e4b5aa53213a2f91b43fa, State: Initialized, Role: FOLLOWER
I20260808 14:50:31.894002 2042 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7ec633ac085e4b5aa53213a2f91b43fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ec633ac085e4b5aa53213a2f91b43fa" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 40317 } }
I20260808 14:50:31.894196 2046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:31.866779 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43420 (local address 127.26.206.254:40317)
0808 14:50:31.869577 (+ 2798us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:31.869594 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:31.869656 (+ 62us) server_negotiation.cc:407] Connection header received
0808 14:50:31.872399 (+ 2743us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:31.872441 (+ 42us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:31.872936 (+ 495us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:31.875080 (+ 2144us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:31.875650 (+ 570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:31.877704 (+ 2054us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:31.879717 (+ 2013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:31.880521 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:31.880725 (+ 204us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:31.885275 (+ 4550us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:50:31.885286 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:50:31.885303 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:50:31.885360 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:50:31.888944 (+ 3584us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:31.889761 (+ 817us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:31.889769 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:31.889777 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:31.889982 (+ 205us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:31.890480 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:31.890485 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:31.890488 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:31.891186 (+ 698us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:50:31.891507 (+ 321us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:31.892290 (+ 783us) server_negotiation.cc:299] Negotiation successful
0808 14:50:31.892733 (+ 443us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2460,"thread_start_us":2155,"threads_started":1}
I20260808 14:50:31.894304 2042 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7ec633ac085e4b5aa53213a2f91b43fa [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:50:31.894434 2042 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7ec633ac085e4b5aa53213a2f91b43fa [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:50:31.894599 2042 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7ec633ac085e4b5aa53213a2f91b43fa [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:50:31.897748 2042 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7ec633ac085e4b5aa53213a2f91b43fa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ec633ac085e4b5aa53213a2f91b43fa" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 40317 } }
I20260808 14:50:31.898377 2042 leader_election.cc:302] T 00000000000000000000000000000000 P 7ec633ac085e4b5aa53213a2f91b43fa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7ec633ac085e4b5aa53213a2f91b43fa; no voters:
I20260808 14:50:31.899067 2042 leader_election.cc:288] T 00000000000000000000000000000000 P 7ec633ac085e4b5aa53213a2f91b43fa [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:50:31.899191 2048 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7ec633ac085e4b5aa53213a2f91b43fa [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:50:31.901417 2042 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7ec633ac085e4b5aa53213a2f91b43fa [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:50:31.904397 2048 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7ec633ac085e4b5aa53213a2f91b43fa [term 1 LEADER]: Becoming Leader. State: Replica: 7ec633ac085e4b5aa53213a2f91b43fa, State: Running, Role: LEADER
I20260808 14:50:31.905066 2048 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7ec633ac085e4b5aa53213a2f91b43fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ec633ac085e4b5aa53213a2f91b43fa" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 40317 } }
I20260808 14:50:31.908047 2049 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7ec633ac085e4b5aa53213a2f91b43fa [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7ec633ac085e4b5aa53213a2f91b43fa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ec633ac085e4b5aa53213a2f91b43fa" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 40317 } } }
I20260808 14:50:31.908497 2049 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7ec633ac085e4b5aa53213a2f91b43fa [sys.catalog]: This master's current role is: LEADER
I20260808 14:50:31.908119 2050 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7ec633ac085e4b5aa53213a2f91b43fa [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7ec633ac085e4b5aa53213a2f91b43fa. Latest consensus state: current_term: 1 leader_uuid: "7ec633ac085e4b5aa53213a2f91b43fa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ec633ac085e4b5aa53213a2f91b43fa" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 40317 } } }
I20260808 14:50:31.908895 2050 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7ec633ac085e4b5aa53213a2f91b43fa [sys.catalog]: This master's current role is: LEADER
I20260808 14:50:31.910820 2058 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:50:31.917207 2058 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:50:31.917826 2066 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260808 14:50:31.927320 2058 catalog_manager.cc:1347] Generated new cluster ID: 9483185052154f6b952efaccfd87fc9f
I20260808 14:50:31.927434 2058 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:50:31.939529 2058 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:50:31.941421 2058 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:50:31.955907 2058 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7ec633ac085e4b5aa53213a2f91b43fa: Generated new TSK 0
I20260808 14:50:31.956908 2058 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.26.206.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.206.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.206.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/krb5kdc/oryx_127.26.206.193.keytab.
Entry for principal oryx/127.26.206.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/krb5kdc/oryx_127.26.206.193.keytab.
I20260808 14:50:32.017019 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.206.193:0
--local_ip_for_outbound_sockets=127.26.206.193
--webserver_interface=127.26.206.193
--webserver_port=0
--tserver_master_addrs=127.26.206.254:40317
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/krb5kdc/oryx_127.26.206.193.keytab
--principal=oryx/127.26.206.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.206.212:41683
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:50:32.349720 2070 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:50:32.349973 2070 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:50:32.350143 2070 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:50:32.356997 2070 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:50:32.357116 2070 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:50:32.357292 2070 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.206.193
I20260808 14:50:32.366853 2070 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:41683
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/krb5kdc/oryx_127.26.206.193.keytab
--principal=oryx/127.26.206.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.206.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.206.193
--webserver_port=0
--tserver_master_addrs=127.26.206.254:40317
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.206.193
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:50:32.368141 2070 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:50:32.369509 2070 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:50:32.382301 2076 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:50:32.382351 2079 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:50:32.382330 2077 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:50:32.383419 2070 server_base.cc:1034] running on GCE node
I20260808 14:50:32.384030 2070 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:50:32.384963 2070 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:50:32.386205 2070 hybrid_clock.cc:648] HybridClock initialized: now 1786200632386144 us; error 39 us; skew 500 ppm
I20260808 14:50:32.386529 2070 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:50:32 dist-test-slave-6k22 krb5kdc[1949](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200632, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.206.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:50:32.389817 2070 init.cc:377] Logged in from keytab as oryx/127.26.206.193@KRBTEST.COM (short username oryx)
I20260808 14:50:32.391249 2070 webserver.cc:460] Webserver started at http://127.26.206.193:39741/ using document root <none> and password file <none>
I20260808 14:50:32.391987 2070 fs_manager.cc:359] Metadata directory not provided
I20260808 14:50:32.392148 2070 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:50:32.392448 2070 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:50:32.395334 2070 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/ts-0/data/instance:
uuid: "97ede4953e344ddaa50fe48bebd2c6e1"
format_stamp: "Formatted at 2026-08-08 14:50:32 on dist-test-slave-6k22"
server_key: "9c5029197aacce1754c09c15c42c283b"
server_key_iv: "93e473ece97577489c7e842384994e12"
server_key_version: "encryptionkey@0"
I20260808 14:50:32.396206 2070 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/ts-0/wal/instance:
uuid: "97ede4953e344ddaa50fe48bebd2c6e1"
format_stamp: "Formatted at 2026-08-08 14:50:32 on dist-test-slave-6k22"
server_key: "9c5029197aacce1754c09c15c42c283b"
server_key_iv: "93e473ece97577489c7e842384994e12"
server_key_version: "encryptionkey@0"
I20260808 14:50:32.401454 2070 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.003s
I20260808 14:50:32.404894 2088 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:50:32.406505 2070 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 14:50:32.406672 2070 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/ts-0/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/ts-0/wal
uuid: "97ede4953e344ddaa50fe48bebd2c6e1"
format_stamp: "Formatted at 2026-08-08 14:50:32 on dist-test-slave-6k22"
server_key: "9c5029197aacce1754c09c15c42c283b"
server_key_iv: "93e473ece97577489c7e842384994e12"
server_key_version: "encryptionkey@0"
I20260808 14:50:32.406865 2070 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:50:32.456245 2070 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:50:32.460377 2070 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:50:32.460669 2070 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:50:32.461630 2070 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:50:32.463042 2070 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:50:32.463167 2070 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:50:32.463317 2070 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:50:32.463389 2070 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:50:32.496565 2070 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.193:36989
I20260808 14:50:32.496618 2217 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.193:36989 every 8 connection(s)
I20260808 14:50:32.497889 2070 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/ts-0/data/info.pb
I20260808 14:50:32.503230 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 2070
I20260808 14:50:32.503495 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/ts-0/wal/instance
I20260808 14:50:32.504347 27451 external_mini_cluster.cc:1428] Setting key b67a03335086e43d7eeab63fee060211
Aug 08 14:50:32 dist-test-slave-6k22 krb5kdc[1949](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200632, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.206.193@KRBTEST.COM for oryx/127.26.206.254@KRBTEST.COM
I20260808 14:50:32.521214 2220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:32.500827 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.193:35543 (local address 127.26.206.254:40317)
0808 14:50:32.505412 (+ 4585us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:32.505417 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:32.505444 (+ 27us) server_negotiation.cc:407] Connection header received
0808 14:50:32.505495 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:32.505502 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:32.505575 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:32.505672 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:32.507489 (+ 1817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:32.508755 (+ 1266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:32.510626 (+ 1871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:32.511385 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:32.511525 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:32.515198 (+ 3673us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:50:32.515208 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:50:32.515215 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:50:32.515260 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:50:32.518174 (+ 2914us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:32.518898 (+ 724us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:32.518906 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:32.518912 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:32.519036 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:32.519459 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:32.519465 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:32.519469 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:32.519793 (+ 324us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:50:32.519949 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:32.520609 (+ 660us) server_negotiation.cc:299] Negotiation successful
0808 14:50:32.520843 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4453,"thread_start_us":4315,"threads_started":1}
I20260808 14:50:32.522107 2221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:32.501303 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:40317 (local address 127.26.206.193:35543)
0808 14:50:32.502191 (+ 888us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:32.502245 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0808 14:50:32.504714 (+ 2469us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:50:32.505977 (+ 1263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:50:32.505989 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:50:32.506750 (+ 761us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:50:32.507303 (+ 553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:32.507321 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:32.508928 (+ 1607us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:32.508932 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:32.510461 (+ 1529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:32.510478 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:32.511630 (+ 1152us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:32.511636 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:32.511945 (+ 309us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:32.512629 (+ 684us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:50:32.512672 (+ 43us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:50:32.514986 (+ 2314us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:50:32.518345 (+ 3359us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:50:32.518353 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:50:32.518373 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:50:32.518769 (+ 396us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:50:32.519149 (+ 380us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:50:32.519154 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:50:32.519158 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:50:32.519345 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:50:32.519923 (+ 578us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:50:32.519930 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:50:32.520239 (+ 309us) client_negotiation.cc:769] Sending connection context
0808 14:50:32.520509 (+ 270us) client_negotiation.cc:240] Negotiation successful
0808 14:50:32.521016 (+ 507us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":610,"thread_start_us":376,"threads_started":1}
I20260808 14:50:32.523648 2218 heartbeater.cc:347] Connected to a master server at 127.26.206.254:40317
I20260808 14:50:32.524000 2218 heartbeater.cc:464] Registering TS with master...
I20260808 14:50:32.524730 2218 heartbeater.cc:511] Master 127.26.206.254:40317 requested a full tablet report, sending...
I20260808 14:50:32.527103 2003 ts_manager.cc:194] Registered new tserver with Master: 97ede4953e344ddaa50fe48bebd2c6e1 (127.26.206.193:36989)
I20260808 14:50:32.529304 2003 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.26.206.193@KRBTEST.COM'} at 127.26.206.193:35543
WARNING: no policy specified for oryx/127.26.206.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.206.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.206.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/krb5kdc/oryx_127.26.206.194.keytab.
Entry for principal oryx/127.26.206.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/krb5kdc/oryx_127.26.206.194.keytab.
I20260808 14:50:32.560271 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.206.194:0
--local_ip_for_outbound_sockets=127.26.206.194
--webserver_interface=127.26.206.194
--webserver_port=0
--tserver_master_addrs=127.26.206.254:40317
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/krb5kdc/oryx_127.26.206.194.keytab
--principal=oryx/127.26.206.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.206.212:41683
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:50:32.885924 2224 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:50:32.886173 2224 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:50:32.886368 2224 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:50:32.893371 2224 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:50:32.893494 2224 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:50:32.893682 2224 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.206.194
I20260808 14:50:32.903415 2224 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:41683
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/krb5kdc/oryx_127.26.206.194.keytab
--principal=oryx/127.26.206.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.206.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.206.194
--webserver_port=0
--tserver_master_addrs=127.26.206.254:40317
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.206.194
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:50:32.904742 2224 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:50:32.905992 2224 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:50:32.919057 2230 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:50:32.919118 2233 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:50:32.919153 2231 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:50:32.920185 2224 server_base.cc:1034] running on GCE node
I20260808 14:50:32.920754 2224 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:50:32.921614 2224 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:50:32.922837 2224 hybrid_clock.cc:648] HybridClock initialized: now 1786200632922789 us; error 59 us; skew 500 ppm
I20260808 14:50:32.923122 2224 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:50:32 dist-test-slave-6k22 krb5kdc[1949](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200632, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.206.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:50:32.934315 2224 init.cc:377] Logged in from keytab as oryx/127.26.206.194@KRBTEST.COM (short username oryx)
I20260808 14:50:32.936070 2224 webserver.cc:460] Webserver started at http://127.26.206.194:45799/ using document root <none> and password file <none>
I20260808 14:50:32.936946 2224 fs_manager.cc:359] Metadata directory not provided
I20260808 14:50:32.937139 2224 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:50:32.937572 2224 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:50:32.941396 2224 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/ts-1/data/instance:
uuid: "3883b0f2f9f7452aa7784ad7f79ed570"
format_stamp: "Formatted at 2026-08-08 14:50:32 on dist-test-slave-6k22"
server_key: "ed9b9c43128357e6fc99da42e5e5b370"
server_key_iv: "47bcc149203f3f45938adb9818b54614"
server_key_version: "encryptionkey@0"
I20260808 14:50:32.942291 2224 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/ts-1/wal/instance:
uuid: "3883b0f2f9f7452aa7784ad7f79ed570"
format_stamp: "Formatted at 2026-08-08 14:50:32 on dist-test-slave-6k22"
server_key: "ed9b9c43128357e6fc99da42e5e5b370"
server_key_iv: "47bcc149203f3f45938adb9818b54614"
server_key_version: "encryptionkey@0"
I20260808 14:50:32.948290 2224 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.004s
I20260808 14:50:32.951808 2243 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:50:32.953148 2224 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260808 14:50:32.953331 2224 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/ts-1/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/ts-1/wal
uuid: "3883b0f2f9f7452aa7784ad7f79ed570"
format_stamp: "Formatted at 2026-08-08 14:50:32 on dist-test-slave-6k22"
server_key: "ed9b9c43128357e6fc99da42e5e5b370"
server_key_iv: "47bcc149203f3f45938adb9818b54614"
server_key_version: "encryptionkey@0"
I20260808 14:50:32.953529 2224 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:50:32.972414 2224 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:50:32.976797 2224 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:50:32.977108 2224 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:50:32.978199 2224 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:50:32.979519 2224 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:50:32.979678 2224 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:50:32.979830 2224 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:50:32.979902 2224 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:50:33.017966 2224 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.194:34835
I20260808 14:50:33.018018 2370 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.194:34835 every 8 connection(s)
I20260808 14:50:33.019341 2224 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/ts-1/data/info.pb
I20260808 14:50:33.022509 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 2224
I20260808 14:50:33.022819 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/ts-1/wal/instance
I20260808 14:50:33.023415 27451 external_mini_cluster.cc:1428] Setting key c7b1b66938a97dccd6b3f068cfcf995a
Aug 08 14:50:33 dist-test-slave-6k22 krb5kdc[1949](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200632, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.206.194@KRBTEST.COM for oryx/127.26.206.254@KRBTEST.COM
I20260808 14:50:33.040436 2373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:33.021945 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.194:40803 (local address 127.26.206.254:40317)
0808 14:50:33.022463 (+ 518us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:33.022470 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:33.023622 (+ 1152us) server_negotiation.cc:407] Connection header received
0808 14:50:33.025584 (+ 1962us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:33.025589 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:33.025673 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:33.025792 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:33.027208 (+ 1416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:33.028425 (+ 1217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:33.029900 (+ 1475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:33.030612 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:33.030756 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:33.034019 (+ 3263us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:50:33.034028 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:50:33.034035 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:50:33.034078 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:50:33.037129 (+ 3051us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:33.037844 (+ 715us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:33.037852 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:33.037859 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:33.038018 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:33.038428 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:33.038436 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:33.038443 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:33.038843 (+ 400us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:50:33.038996 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:33.039686 (+ 690us) server_negotiation.cc:299] Negotiation successful
0808 14:50:33.039964 (+ 278us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":384,"thread_start_us":272,"threads_started":1}
I20260808 14:50:33.041011 2374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:33.022523 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:40317 (local address 127.26.206.194:40803)
0808 14:50:33.023396 (+ 873us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:33.023442 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0808 14:50:33.025289 (+ 1847us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:50:33.025978 (+ 689us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:50:33.025986 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:50:33.026465 (+ 479us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:50:33.027025 (+ 560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:33.027042 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:33.028559 (+ 1517us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:33.028563 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:33.029759 (+ 1196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:33.029770 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:33.030815 (+ 1045us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:33.030819 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:33.031005 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:33.031692 (+ 687us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:50:33.031718 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:50:33.033807 (+ 2089us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:50:33.037267 (+ 3460us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:50:33.037273 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:50:33.037284 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:50:33.037716 (+ 432us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:50:33.038130 (+ 414us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:50:33.038133 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:50:33.038136 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:50:33.038309 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:50:33.038965 (+ 656us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:50:33.038970 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:50:33.039268 (+ 298us) client_negotiation.cc:769] Sending connection context
0808 14:50:33.039492 (+ 224us) client_negotiation.cc:240] Negotiation successful
0808 14:50:33.039931 (+ 439us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":571,"thread_start_us":379,"threads_started":1}
I20260808 14:50:33.042466 2371 heartbeater.cc:347] Connected to a master server at 127.26.206.254:40317
I20260808 14:50:33.042753 2371 heartbeater.cc:464] Registering TS with master...
I20260808 14:50:33.043462 2371 heartbeater.cc:511] Master 127.26.206.254:40317 requested a full tablet report, sending...
I20260808 14:50:33.044939 2003 ts_manager.cc:194] Registered new tserver with Master: 3883b0f2f9f7452aa7784ad7f79ed570 (127.26.206.194:34835)
I20260808 14:50:33.045724 2003 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.26.206.194@KRBTEST.COM'} at 127.26.206.194:40803
WARNING: no policy specified for oryx/127.26.206.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.206.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.206.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/krb5kdc/oryx_127.26.206.195.keytab.
Entry for principal oryx/127.26.206.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/krb5kdc/oryx_127.26.206.195.keytab.
I20260808 14:50:33.080034 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.206.195:0
--local_ip_for_outbound_sockets=127.26.206.195
--webserver_interface=127.26.206.195
--webserver_port=0
--tserver_master_addrs=127.26.206.254:40317
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/krb5kdc/oryx_127.26.206.195.keytab
--principal=oryx/127.26.206.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.206.212:41683
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:50:33.409372 2377 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:50:33.409649 2377 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:50:33.409745 2377 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:50:33.417258 2377 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:50:33.417367 2377 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:50:33.417482 2377 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.206.195
I20260808 14:50:33.426993 2377 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:41683
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/krb5kdc/oryx_127.26.206.195.keytab
--principal=oryx/127.26.206.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.206.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.206.195
--webserver_port=0
--tserver_master_addrs=127.26.206.254:40317
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.206.195
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:50:33.428318 2377 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:50:33.429557 2377 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:50:33.441973 2382 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:50:33.442016 2383 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:50:33.442013 2385 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:50:33.443259 2377 server_base.cc:1034] running on GCE node
I20260808 14:50:33.444033 2377 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:50:33.445003 2377 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:50:33.446203 2377 hybrid_clock.cc:648] HybridClock initialized: now 1786200633446159 us; error 29 us; skew 500 ppm
I20260808 14:50:33.446503 2377 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:50:33 dist-test-slave-6k22 krb5kdc[1949](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200633, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.206.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:50:33.449607 2377 init.cc:377] Logged in from keytab as oryx/127.26.206.195@KRBTEST.COM (short username oryx)
I20260808 14:50:33.450971 2377 webserver.cc:460] Webserver started at http://127.26.206.195:41495/ using document root <none> and password file <none>
I20260808 14:50:33.451709 2377 fs_manager.cc:359] Metadata directory not provided
I20260808 14:50:33.451857 2377 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:50:33.452152 2377 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:50:33.454892 2377 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/ts-2/data/instance:
uuid: "5baab2df33494b8cb20296450685fed3"
format_stamp: "Formatted at 2026-08-08 14:50:33 on dist-test-slave-6k22"
server_key: "c110284a599b60a61730637c1b01035f"
server_key_iv: "2b10de888752b21cabc808e9b310b73e"
server_key_version: "encryptionkey@0"
I20260808 14:50:33.455727 2377 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/ts-2/wal/instance:
uuid: "5baab2df33494b8cb20296450685fed3"
format_stamp: "Formatted at 2026-08-08 14:50:33 on dist-test-slave-6k22"
server_key: "c110284a599b60a61730637c1b01035f"
server_key_iv: "2b10de888752b21cabc808e9b310b73e"
server_key_version: "encryptionkey@0"
I20260808 14:50:33.460924 2377 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260808 14:50:33.464242 2392 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:50:33.465504 2377 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.004s
I20260808 14:50:33.465716 2377 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/ts-2/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/ts-2/wal
uuid: "5baab2df33494b8cb20296450685fed3"
format_stamp: "Formatted at 2026-08-08 14:50:33 on dist-test-slave-6k22"
server_key: "c110284a599b60a61730637c1b01035f"
server_key_iv: "2b10de888752b21cabc808e9b310b73e"
server_key_version: "encryptionkey@0"
I20260808 14:50:33.465920 2377 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:50:33.484076 2377 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:50:33.487833 2377 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:50:33.488114 2377 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:50:33.489022 2377 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:50:33.490388 2377 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:50:33.490499 2377 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:50:33.490653 2377 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:50:33.490734 2377 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:50:33.525525 2377 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.195:43699
I20260808 14:50:33.525566 2528 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.195:43699 every 8 connection(s)
I20260808 14:50:33.526775 2377 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/ts-2/data/info.pb
I20260808 14:50:33.532287 2218 heartbeater.cc:503] Master 127.26.206.254:40317 was elected leader, sending a full tablet report...
I20260808 14:50:33.533033 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 2377
I20260808 14:50:33.533245 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/ts-2/wal/instance
I20260808 14:50:33.533826 27451 external_mini_cluster.cc:1428] Setting key eb3a026073b14a8c3d1a4956312b2975
Aug 08 14:50:33 dist-test-slave-6k22 krb5kdc[1949](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200633, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.206.195@KRBTEST.COM for oryx/127.26.206.254@KRBTEST.COM
I20260808 14:50:33.546829 2373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:33.529290 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.195:45607 (local address 127.26.206.254:40317)
0808 14:50:33.529505 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:33.529512 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:33.530650 (+ 1138us) server_negotiation.cc:407] Connection header received
0808 14:50:33.532577 (+ 1927us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:33.532598 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:33.532708 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:33.532828 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:33.534699 (+ 1871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:33.535864 (+ 1165us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:33.537801 (+ 1937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:33.538192 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:33.538287 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:33.541704 (+ 3417us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:50:33.541713 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:50:33.541719 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:50:33.541764 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:50:33.544202 (+ 2438us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:33.544822 (+ 620us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:33.544825 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:33.544827 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:33.544947 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:33.545356 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:33.545361 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:33.545363 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:33.545660 (+ 297us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:50:33.545820 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:33.546373 (+ 553us) server_negotiation.cc:299] Negotiation successful
0808 14:50:33.546552 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260808 14:50:33.547796 2531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:33.529762 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:40317 (local address 127.26.206.195:45607)
0808 14:50:33.530475 (+ 713us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:33.530528 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0808 14:50:33.532226 (+ 1698us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:50:33.533069 (+ 843us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:50:33.533078 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:50:33.533705 (+ 627us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:50:33.534519 (+ 814us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:33.534550 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:33.536039 (+ 1489us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:33.536046 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:33.537667 (+ 1621us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:33.537679 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:33.538386 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:33.538390 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:33.538581 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:33.539249 (+ 668us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:50:33.539283 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:50:33.541490 (+ 2207us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:50:33.544324 (+ 2834us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:50:33.544330 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:50:33.544340 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:50:33.544722 (+ 382us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:50:33.545043 (+ 321us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:50:33.545046 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:50:33.545048 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:50:33.545217 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:50:33.545781 (+ 564us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:50:33.545786 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:50:33.546056 (+ 270us) client_negotiation.cc:769] Sending connection context
0808 14:50:33.546289 (+ 233us) client_negotiation.cc:240] Negotiation successful
0808 14:50:33.546627 (+ 338us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":490,"thread_start_us":288,"threads_started":1}
I20260808 14:50:33.549465 2529 heartbeater.cc:347] Connected to a master server at 127.26.206.254:40317
I20260808 14:50:33.549746 2529 heartbeater.cc:464] Registering TS with master...
I20260808 14:50:33.550406 2529 heartbeater.cc:511] Master 127.26.206.254:40317 requested a full tablet report, sending...
I20260808 14:50:33.551857 2002 ts_manager.cc:194] Registered new tserver with Master: 5baab2df33494b8cb20296450685fed3 (127.26.206.195:43699)
I20260808 14:50:33.552664 2002 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.26.206.195@KRBTEST.COM'} at 127.26.206.195:45607
I20260808 14:50:33.561646 27451 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.26.206.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.206.253@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.206.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/krb5kdc/oryx_127.26.206.253.keytab.
Entry for principal oryx/127.26.206.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/krb5kdc/oryx_127.26.206.253.keytab.
I20260808 14:50:33.619104 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.206.253:39527
--webserver_interface=127.26.206.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/krb5kdc/oryx_127.26.206.253.keytab
--principal=oryx/127.26.206.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.206.212:41683
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.206.254:40317,127.26.206.253:39527
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:50:33.952190 2534 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:50:33.952507 2534 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:50:33.952664 2534 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:50:33.960088 2534 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:50:33.960223 2534 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:50:33.960327 2534 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:50:33.960429 2534 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:50:33.960513 2534 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:50:33.970281 2534 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:41683
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.26.206.254:40317,127.26.206.253:39527
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/krb5kdc/oryx_127.26.206.253.keytab
--principal=oryx/127.26.206.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.206.253:39527
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.26.206.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
W20260808 14:50:33.970638 2534 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.26.206.254:40317,127.26.206.253:39527'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260808 14:50:33.971764 2534 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:50:33.973037 2534 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:50:33.984855 2539 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:50:33.985018 2540 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:50:33.985030 2542 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:50:33.985981 2534 server_base.cc:1034] running on GCE node
I20260808 14:50:33.986743 2534 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:50:33.988186 2534 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:50:33.989441 2534 hybrid_clock.cc:648] HybridClock initialized: now 1786200633989385 us; error 36 us; skew 500 ppm
I20260808 14:50:33.989773 2534 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:50:33 dist-test-slave-6k22 krb5kdc[1949](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200633, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.206.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:50:33.993038 2534 init.cc:377] Logged in from keytab as oryx/127.26.206.253@KRBTEST.COM (short username oryx)
I20260808 14:50:33.994506 2534 webserver.cc:460] Webserver started at http://127.26.206.253:33731/ using document root <none> and password file <none>
I20260808 14:50:33.995141 2534 fs_manager.cc:359] Metadata directory not provided
I20260808 14:50:33.995231 2534 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:50:33.995493 2534 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:50:33.998382 2534 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/master-1/data/instance:
uuid: "7c552da230014669b01423a8c5d26637"
format_stamp: "Formatted at 2026-08-08 14:50:33 on dist-test-slave-6k22"
server_key: "2ecabc3485470ba55a501ab3544daee5"
server_key_iv: "e76a77391c21a0e2606f5a745bc14ed9"
server_key_version: "encryptionkey@0"
I20260808 14:50:33.999135 2534 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/master-1/wal/instance:
uuid: "7c552da230014669b01423a8c5d26637"
format_stamp: "Formatted at 2026-08-08 14:50:33 on dist-test-slave-6k22"
server_key: "2ecabc3485470ba55a501ab3544daee5"
server_key_iv: "e76a77391c21a0e2606f5a745bc14ed9"
server_key_version: "encryptionkey@0"
I20260808 14:50:34.004347 2534 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.008s sys 0.000s
I20260808 14:50:34.007499 2549 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:50:34.008872 2534 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260808 14:50:34.009047 2534 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/master-1/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/master-1/wal
uuid: "7c552da230014669b01423a8c5d26637"
format_stamp: "Formatted at 2026-08-08 14:50:33 on dist-test-slave-6k22"
server_key: "2ecabc3485470ba55a501ab3544daee5"
server_key_iv: "e76a77391c21a0e2606f5a745bc14ed9"
server_key_version: "encryptionkey@0"
I20260808 14:50:34.009302 2534 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:50:34.031450 2534 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:50:34.035869 2534 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:50:34.036089 2534 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:50:34.048163 2371 heartbeater.cc:503] Master 127.26.206.254:40317 was elected leader, sending a full tablet report...
I20260808 14:50:34.055030 2534 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.253:39527
I20260808 14:50:34.055120 2611 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.253:39527 every 8 connection(s)
I20260808 14:50:34.056424 2534 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/master-1/data/info.pb
I20260808 14:50:34.060177 2612 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:50:34.062615 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 2534
I20260808 14:50:34.067974 2612 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.206.254" port: 40317 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 14:50:34 dist-test-slave-6k22 krb5kdc[1949](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200631, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.26.206.253@KRBTEST.COM
Aug 08 14:50:34 dist-test-slave-6k22 krb5kdc[1949](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200633, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.206.253@KRBTEST.COM for oryx/127.26.206.254@KRBTEST.COM
I20260808 14:50:34.087657 2615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:34.065014 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53932 (local address 127.26.206.253:39527)
0808 14:50:34.065733 (+ 719us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:34.065743 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:34.065782 (+ 39us) server_negotiation.cc:407] Connection header received
0808 14:50:34.067525 (+ 1743us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:34.067558 (+ 33us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:34.068024 (+ 466us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:34.068444 (+ 420us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:34.069953 (+ 1509us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:34.071870 (+ 1917us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:34.073697 (+ 1827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:34.074660 (+ 963us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:34.074861 (+ 201us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:34.079908 (+ 5047us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:50:34.079921 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:50:34.079936 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:50:34.079978 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:50:34.083687 (+ 3709us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:34.084288 (+ 601us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:34.084297 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:34.084307 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:34.084517 (+ 210us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:34.084873 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:34.084877 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:34.084880 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:34.085521 (+ 641us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:50:34.085862 (+ 341us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:34.086165 (+ 303us) server_negotiation.cc:299] Negotiation successful
0808 14:50:34.086502 (+ 337us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":39,"server-negotiator.queue_time_us":529,"thread_start_us":307,"threads_started":1}
I20260808 14:50:34.087770 2616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:34.070589 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43426 (local address 127.26.206.254:40317)
0808 14:50:34.071951 (+ 1362us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:34.071960 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:34.071979 (+ 19us) server_negotiation.cc:407] Connection header received
0808 14:50:34.072045 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:34.072049 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:34.072115 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:34.072197 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:34.073699 (+ 1502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:34.074780 (+ 1081us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:34.076848 (+ 2068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:34.077286 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:34.077378 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:34.081259 (+ 3881us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:50:34.081265 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:50:34.081270 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:50:34.081309 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:50:34.084509 (+ 3200us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:34.085401 (+ 892us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:34.085404 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:34.085406 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:34.085527 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:34.085987 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:34.085992 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:34.085995 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:34.086419 (+ 424us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:50:34.086566 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:34.087111 (+ 545us) server_negotiation.cc:299] Negotiation successful
0808 14:50:34.087354 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1236,"thread_start_us":1128,"threads_started":1}
I20260808 14:50:34.087821 2617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:34.070584 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:40317 (local address 127.0.0.1:43426)
0808 14:50:34.071290 (+ 706us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:34.071337 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0808 14:50:34.071495 (+ 158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:50:34.072310 (+ 815us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:50:34.072317 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:50:34.073158 (+ 841us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:50:34.073489 (+ 331us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:34.073502 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:34.074909 (+ 1407us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:34.074914 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:34.076680 (+ 1766us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:34.076699 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:34.077509 (+ 810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:34.077516 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:34.077703 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:34.078338 (+ 635us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:50:34.078359 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:50:34.081029 (+ 2670us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:50:34.084679 (+ 3650us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:50:34.084687 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:50:34.084691 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:50:34.085263 (+ 572us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:50:34.085643 (+ 380us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:50:34.085647 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:50:34.085651 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:50:34.085851 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:50:34.086628 (+ 777us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:50:34.086634 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:50:34.086768 (+ 134us) client_negotiation.cc:769] Sending connection context
0808 14:50:34.087008 (+ 240us) client_negotiation.cc:240] Negotiation successful
0808 14:50:34.087330 (+ 322us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":444,"mutex_wait_us":40,"thread_start_us":294,"threads_started":1}
I20260808 14:50:34.089742 2612 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.206.253" port: 39527 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 14:50:34 dist-test-slave-6k22 krb5kdc[1949](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200633, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.206.253@KRBTEST.COM for oryx/127.26.206.253@KRBTEST.COM
I20260808 14:50:34.101284 2617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:34.090540 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.253:39527 (local address 127.0.0.1:53948)
0808 14:50:34.090750 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:34.090769 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 14:50:34.090898 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:50:34.091253 (+ 355us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:50:34.091255 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:50:34.091536 (+ 281us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:50:34.091718 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:34.091726 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:34.092576 (+ 850us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:34.092579 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:34.093363 (+ 784us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:34.093373 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:34.093972 (+ 599us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:34.093976 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:34.094107 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:34.094529 (+ 422us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:50:34.094544 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:50:34.096315 (+ 1771us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:50:34.099023 (+ 2708us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:50:34.099029 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:50:34.099033 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:50:34.099385 (+ 352us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:50:34.099796 (+ 411us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:50:34.099803 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:50:34.099807 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:50:34.099933 (+ 126us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:50:34.100408 (+ 475us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:50:34.100412 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:50:34.100539 (+ 127us) client_negotiation.cc:769] Sending connection context
0808 14:50:34.100672 (+ 133us) client_negotiation.cc:240] Negotiation successful
0808 14:50:34.100941 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":68}
I20260808 14:50:34.101354 2615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:34.090773 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53948 (local address 127.26.206.253:39527)
0808 14:50:34.090899 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:34.090902 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:34.090917 (+ 15us) server_negotiation.cc:407] Connection header received
0808 14:50:34.091070 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:34.091075 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:34.091138 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:34.091236 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:34.091827 (+ 591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:34.092457 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:34.093471 (+ 1014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:34.093856 (+ 385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:34.093945 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:34.096477 (+ 2532us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:50:34.096481 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:50:34.096484 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:50:34.096506 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:50:34.098882 (+ 2376us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:34.099504 (+ 622us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:34.099512 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:34.099515 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:34.099696 (+ 181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:34.100032 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:34.100038 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:34.100041 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:34.100281 (+ 240us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:50:34.100425 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:34.100748 (+ 323us) server_negotiation.cc:299] Negotiation successful
0808 14:50:34.101063 (+ 315us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":141,"server-negotiator.queue_time_us":47}
I20260808 14:50:34.105921 2612 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7c552da230014669b01423a8c5d26637: Bootstrap starting.
I20260808 14:50:34.108974 2612 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7c552da230014669b01423a8c5d26637: Neither blocks nor log segments found. Creating new log.
I20260808 14:50:34.110157 2612 log.cc:824] T 00000000000000000000000000000000 P 7c552da230014669b01423a8c5d26637: Log is configured to *not* fsync() on all Append() calls
I20260808 14:50:34.112910 2612 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7c552da230014669b01423a8c5d26637: No bootstrap required, opened a new log
I20260808 14:50:34.119971 2612 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7c552da230014669b01423a8c5d26637 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ec633ac085e4b5aa53213a2f91b43fa" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 40317 } } peers { permanent_uuid: "7c552da230014669b01423a8c5d26637" member_type: VOTER last_known_addr { host: "127.26.206.253" port: 39527 } }
I20260808 14:50:34.120414 2612 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7c552da230014669b01423a8c5d26637 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:50:34.120512 2612 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7c552da230014669b01423a8c5d26637 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c552da230014669b01423a8c5d26637, State: Initialized, Role: FOLLOWER
I20260808 14:50:34.121145 2612 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7c552da230014669b01423a8c5d26637 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ec633ac085e4b5aa53213a2f91b43fa" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 40317 } } peers { permanent_uuid: "7c552da230014669b01423a8c5d26637" member_type: VOTER last_known_addr { host: "127.26.206.253" port: 39527 } }
I20260808 14:50:34.121958 2619 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7c552da230014669b01423a8c5d26637 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ec633ac085e4b5aa53213a2f91b43fa" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 40317 } } peers { permanent_uuid: "7c552da230014669b01423a8c5d26637" member_type: VOTER last_known_addr { host: "127.26.206.253" port: 39527 } } }
I20260808 14:50:34.122244 2619 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7c552da230014669b01423a8c5d26637 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 14:50:34.122859 2612 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7c552da230014669b01423a8c5d26637 [sys.catalog]: configured and running, proceeding with master startup.
W20260808 14:50:34.131158 2632 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 7c552da230014669b01423a8c5d26637: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 14:50:34.131287 2632 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 14:50:34.133795 2534 master_runner.cc:428] Detected that this master 7c552da230014669b01423a8c5d26637 is joining an existing cluster
I20260808 14:50:34.133913 2534 master_runner.cc:432] Initiating AddMaster RPC to add 127.26.206.253:39527
I20260808 14:50:34.155579 2615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:34.137854 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53962 (local address 127.26.206.253:39527)
0808 14:50:34.138031 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:34.138039 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:34.139153 (+ 1114us) server_negotiation.cc:407] Connection header received
0808 14:50:34.139338 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:34.139342 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:34.139405 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:34.139499 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:34.140773 (+ 1274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:34.141959 (+ 1186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:34.144263 (+ 2304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:34.144957 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:34.145037 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:34.148113 (+ 3076us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:50:34.148120 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:50:34.148124 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:50:34.148154 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:50:34.152023 (+ 3869us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:34.153005 (+ 982us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:34.153010 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:34.153012 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:34.153144 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:34.153639 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:34.153644 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:34.153649 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:34.154030 (+ 381us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:50:34.154190 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:34.154769 (+ 579us) server_negotiation.cc:299] Negotiation successful
0808 14:50:34.155087 (+ 318us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":78,"server-negotiator.queue_time_us":60}
I20260808 14:50:34.155952 2616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:34.137550 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43436 (local address 127.26.206.254:40317)
0808 14:50:34.137721 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:34.137729 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:34.138850 (+ 1121us) server_negotiation.cc:407] Connection header received
0808 14:50:34.139113 (+ 263us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:34.139119 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:34.139235 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:34.139350 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:34.140864 (+ 1514us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:34.141948 (+ 1084us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:34.144277 (+ 2329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:34.144937 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:34.145038 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:34.148130 (+ 3092us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:50:34.148135 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:50:34.148140 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:50:34.148174 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:50:34.152023 (+ 3849us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:34.153016 (+ 993us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:34.153021 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:34.153024 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:34.153144 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:34.153793 (+ 649us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:34.153798 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:34.153802 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:34.154158 (+ 356us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:50:34.154308 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:34.155314 (+ 1006us) server_negotiation.cc:299] Negotiation successful
0808 14:50:34.155547 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260808 14:50:34.156899 2638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:34.137895 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.253:39527 (local address 127.0.0.1:53962)
0808 14:50:34.139062 (+ 1167us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:34.139084 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 14:50:34.139207 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:50:34.139685 (+ 478us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:50:34.139687 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:50:34.140232 (+ 545us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:50:34.140645 (+ 413us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:34.140654 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:34.142156 (+ 1502us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:34.142162 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:34.144105 (+ 1943us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:34.144120 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:34.145354 (+ 1234us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:34.145360 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:34.145557 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:34.146441 (+ 884us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:50:34.146472 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:50:34.147934 (+ 1462us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:50:34.152166 (+ 4232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:50:34.152171 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:50:34.152176 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:50:34.152894 (+ 718us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:50:34.153266 (+ 372us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:50:34.153270 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:50:34.153274 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:50:34.153474 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:50:34.154260 (+ 786us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:50:34.154267 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:50:34.154424 (+ 157us) client_negotiation.cc:769] Sending connection context
0808 14:50:34.154610 (+ 186us) client_negotiation.cc:240] Negotiation successful
0808 14:50:34.156269 (+ 1659us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1031,"mutex_wait_us":200,"spinlock_wait_cycles":25600,"thread_start_us":428,"threads_started":1}
I20260808 14:50:34.156941 2640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:34.137853 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:40317 (local address 127.0.0.1:43436)
0808 14:50:34.138720 (+ 867us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:34.138747 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0808 14:50:34.138967 (+ 220us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:50:34.139381 (+ 414us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:50:34.139385 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:50:34.140168 (+ 783us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:50:34.140670 (+ 502us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:34.140685 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:34.142117 (+ 1432us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:34.142127 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:34.144106 (+ 1979us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:34.144120 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:34.145321 (+ 1201us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:34.145336 (+ 15us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:34.145559 (+ 223us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:34.146511 (+ 952us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:50:34.146529 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:50:34.147934 (+ 1405us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:50:34.152166 (+ 4232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:50:34.152171 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:50:34.152176 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:50:34.152894 (+ 718us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:50:34.153266 (+ 372us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:50:34.153270 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:50:34.153274 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:50:34.153632 (+ 358us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:50:34.154388 (+ 756us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:50:34.154393 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:50:34.154933 (+ 540us) client_negotiation.cc:769] Sending connection context
0808 14:50:34.156144 (+ 1211us) client_negotiation.cc:240] Negotiation successful
0808 14:50:34.156476 (+ 332us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":686,"mutex_wait_us":151,"spinlock_wait_cycles":36864,"thread_start_us":902,"threads_started":1}
I20260808 14:50:34.166705 2619 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7c552da230014669b01423a8c5d26637 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:50:34.166958 2619 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7c552da230014669b01423a8c5d26637 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ec633ac085e4b5aa53213a2f91b43fa" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 40317 } } peers { permanent_uuid: "7c552da230014669b01423a8c5d26637" member_type: VOTER last_known_addr { host: "127.26.206.253" port: 39527 } }
I20260808 14:50:34.168433 2619 leader_election.cc:288] T 00000000000000000000000000000000 P 7c552da230014669b01423a8c5d26637 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ec633ac085e4b5aa53213a2f91b43fa (127.26.206.254:40317)
I20260808 14:50:34.169332 2013 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7c552da230014669b01423a8c5d26637" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ec633ac085e4b5aa53213a2f91b43fa" is_pre_election: true
I20260808 14:50:34.170571 2554 leader_election.cc:302] T 00000000000000000000000000000000 P 7c552da230014669b01423a8c5d26637 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 2 responses out of 2 voters: 1 yes votes; 1 no votes. yes voters: 7c552da230014669b01423a8c5d26637; no voters: 7ec633ac085e4b5aa53213a2f91b43fa
I20260808 14:50:34.171175 2619 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 7c552da230014669b01423a8c5d26637 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
WARNING: no policy specified for oryx/127.26.206.252@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.206.252@KRBTEST.COM" created.
Aug 08 14:50:34 dist-test-slave-6k22 krb5kdc[1949](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200631, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.206.254@KRBTEST.COM for oryx/127.26.206.253@KRBTEST.COM
I20260808 14:50:34.187855 2615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:34.164193 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53972 (local address 127.26.206.253:39527)
0808 14:50:34.164360 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:34.164365 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:34.164545 (+ 180us) server_negotiation.cc:407] Connection header received
0808 14:50:34.164990 (+ 445us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:34.164998 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:34.165119 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:34.165191 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:34.167030 (+ 1839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:34.168311 (+ 1281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:34.171063 (+ 2752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:34.171858 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:34.171990 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:34.179211 (+ 7221us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:50:34.179217 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:50:34.179224 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:50:34.179266 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:50:34.185036 (+ 5770us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:34.185727 (+ 691us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:34.185734 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:34.185738 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:34.185885 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:34.186273 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:34.186279 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:34.186282 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:34.186571 (+ 289us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:50:34.186730 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:34.187217 (+ 487us) server_negotiation.cc:299] Negotiation successful
0808 14:50:34.187450 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260808 14:50:34.187915 2643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:34.163847 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.253:39527 (local address 127.0.0.1:53972)
0808 14:50:34.164405 (+ 558us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:34.164448 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 14:50:34.164726 (+ 278us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:50:34.165516 (+ 790us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:50:34.165527 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:50:34.166442 (+ 915us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:50:34.166765 (+ 323us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:34.166779 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:34.168627 (+ 1848us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:34.168635 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:34.170891 (+ 2256us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:34.170906 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:34.172052 (+ 1146us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:34.172061 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:34.172287 (+ 226us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:34.175850 (+ 3563us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:50:34.175875 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:50:34.178989 (+ 3114us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:50:34.185194 (+ 6205us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:50:34.185207 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:50:34.185215 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:50:34.185608 (+ 393us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:50:34.186009 (+ 401us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:50:34.186014 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:50:34.186018 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:50:34.186149 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:50:34.186726 (+ 577us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:50:34.186735 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:50:34.186916 (+ 181us) client_negotiation.cc:769] Sending connection context
0808 14:50:34.187100 (+ 184us) client_negotiation.cc:240] Negotiation successful
0808 14:50:34.187455 (+ 355us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":340,"thread_start_us":513,"threads_started":1}
I20260808 14:50:34.190183 2002 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.26.206.253:39527: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "7c552da230014669b01423a8c5d26637"
member_type: NON_VOTER
last_known_addr {
host: "127.26.206.253"
port: 39527
}
attrs {
promote: true
}
}
dest_uuid: "7ec633ac085e4b5aa53213a2f91b43fa"
cas_config_opid_index: -1
I20260808 14:50:34.191781 2002 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7ec633ac085e4b5aa53213a2f91b43fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "7ec633ac085e4b5aa53213a2f91b43fa" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 40317 } } peers { permanent_uuid: "7c552da230014669b01423a8c5d26637" member_type: NON_VOTER last_known_addr { host: "127.26.206.253" port: 39527 } attrs { promote: true } }
I20260808 14:50:34.206719 2583 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7c552da230014669b01423a8c5d26637 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:50:34.210865 2583 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 7c552da230014669b01423a8c5d26637 [term 1 FOLLOWER]: Refusing update from remote peer 7ec633ac085e4b5aa53213a2f91b43fa: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260808 14:50:34.210983 2647 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 7ec633ac085e4b5aa53213a2f91b43fa [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 7c552da230014669b01423a8c5d26637 (127.26.206.253) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "7ec633ac085e4b5aa53213a2f91b43fa" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 40317 } } peers { permanent_uuid: "7c552da230014669b01423a8c5d26637" member_type: NON_VOTER last_known_addr { host: "127.26.206.253" port: 39527 } attrs { promote: true } } }
I20260808 14:50:34.211944 2646 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 7ec633ac085e4b5aa53213a2f91b43fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c552da230014669b01423a8c5d26637" member_type: NON_VOTER last_known_addr { host: "127.26.206.253" port: 39527 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.206.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/krb5kdc/oryx_127.26.206.252.keytab.
Entry for principal oryx/127.26.206.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/krb5kdc/oryx_127.26.206.252.keytab.
I20260808 14:50:34.216326 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.206.252:46475
--webserver_interface=127.26.206.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/krb5kdc/oryx_127.26.206.252.keytab
--principal=oryx/127.26.206.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.206.212:41683
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.206.254:40317,127.26.206.253:39527,127.26.206.252:46475
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 14:50:34.220497 2647 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.26.206.253:39527
I20260808 14:50:34.221597 2534 master.cc:537] Master@127.26.206.253:39527 shutting down...
I20260808 14:50:34.221874 2648 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7ec633ac085e4b5aa53213a2f91b43fa [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "7ec633ac085e4b5aa53213a2f91b43fa" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "7ec633ac085e4b5aa53213a2f91b43fa" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 40317 } } peers { permanent_uuid: "7c552da230014669b01423a8c5d26637" member_type: NON_VOTER last_known_addr { host: "127.26.206.253" port: 39527 } attrs { promote: true } } }
I20260808 14:50:34.222216 2648 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7ec633ac085e4b5aa53213a2f91b43fa [sys.catalog]: This master's current role is: LEADER
I20260808 14:50:34.246510 2583 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 7c552da230014669b01423a8c5d26637 [term 1 LEARNER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 7c552da230014669b01423a8c5d26637 (127.26.206.253) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "7ec633ac085e4b5aa53213a2f91b43fa" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 40317 } } peers { permanent_uuid: "7c552da230014669b01423a8c5d26637" member_type: NON_VOTER last_known_addr { host: "127.26.206.253" port: 39527 } attrs { promote: true } } }
I20260808 14:50:34.268141 2619 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7c552da230014669b01423a8c5d26637 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7ec633ac085e4b5aa53213a2f91b43fa. Latest consensus state: current_term: 1 leader_uuid: "7ec633ac085e4b5aa53213a2f91b43fa" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "7ec633ac085e4b5aa53213a2f91b43fa" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 40317 } } peers { permanent_uuid: "7c552da230014669b01423a8c5d26637" member_type: NON_VOTER last_known_addr { host: "127.26.206.253" port: 39527 } attrs { promote: true } } }
I20260808 14:50:34.268458 2619 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7c552da230014669b01423a8c5d26637 [sys.catalog]: This master's current role is: LEARNER
I20260808 14:50:34.268652 2662 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7c552da230014669b01423a8c5d26637 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "7ec633ac085e4b5aa53213a2f91b43fa" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "7ec633ac085e4b5aa53213a2f91b43fa" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 40317 } } peers { permanent_uuid: "7c552da230014669b01423a8c5d26637" member_type: NON_VOTER last_known_addr { host: "127.26.206.253" port: 39527 } attrs { promote: true } } }
I20260808 14:50:34.268455 2658 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7c552da230014669b01423a8c5d26637 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "7ec633ac085e4b5aa53213a2f91b43fa" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "7ec633ac085e4b5aa53213a2f91b43fa" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 40317 } } peers { permanent_uuid: "7c552da230014669b01423a8c5d26637" member_type: NON_VOTER last_known_addr { host: "127.26.206.253" port: 39527 } attrs { promote: true } } }
I20260808 14:50:34.269043 2662 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7c552da230014669b01423a8c5d26637 [sys.catalog]: This master's current role is: LEARNER
I20260808 14:50:34.269083 2658 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7c552da230014669b01423a8c5d26637 [sys.catalog]: This master's current role is: LEARNER
I20260808 14:50:34.271819 2534 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 7c552da230014669b01423a8c5d26637 [term 1 LEARNER]: Raft consensus shutting down.
I20260808 14:50:34.272286 2534 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 7c552da230014669b01423a8c5d26637 [term 1 LEARNER]: Raft consensus is shut down!
I20260808 14:50:34.272469 2534 tablet_replica.cc:330] T 00000000000000000000000000000000 P 7c552da230014669b01423a8c5d26637: stopping tablet replica
I20260808 14:50:34.280470 2534 master.cc:552] Master@127.26.206.253:39527 shutdown complete.
I20260808 14:50:34.280655 2534 master_runner.cc:305] Clearing existing system tablet
I20260808 14:50:34.281123 2534 fs_manager.cc:359] Metadata directory not provided
I20260808 14:50:34.281252 2534 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:50:34.283792 2534 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.001s
I20260808 14:50:34.285518 2664 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:50:34.285849 2534 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:50:34.286180 2534 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.001s
I20260808 14:50:34.286278 2534 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/master-1/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/master-1/wal
uuid: "7c552da230014669b01423a8c5d26637"
format_stamp: "Formatted at 2026-08-08 14:50:33 on dist-test-slave-6k22"
server_key: "2ecabc3485470ba55a501ab3544daee5"
server_key_iv: "e76a77391c21a0e2606f5a745bc14ed9"
server_key_version: "encryptionkey@0"
I20260808 14:50:34.289847 2534 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 7c552da230014669b01423a8c5d26637: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:50:34.294740 2534 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 7c552da230014669b01423a8c5d26637: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260808 14:50:34.294962 2534 log.cc:1196] T 00000000000000000000000000000000 P 7c552da230014669b01423a8c5d26637: Deleting WAL directory at /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260808 14:50:34.295527 2534 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 7c552da230014669b01423a8c5d26637: Deleting consensus metadata
I20260808 14:50:34.295858 2534 master_runner.cc:315] Copying system tablet from 127.26.206.254:40317
I20260808 14:50:34.301533 2534 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 7c552da230014669b01423a8c5d26637: tablet copy: Beginning tablet copy session from remote peer at address 127.26.206.254:40317
I20260808 14:50:34.316249 2616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:34.302687 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43450 (local address 127.26.206.254:40317)
0808 14:50:34.303068 (+ 381us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:34.303080 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:34.303736 (+ 656us) server_negotiation.cc:407] Connection header received
0808 14:50:34.303997 (+ 261us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:34.304003 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:34.304087 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:34.304214 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:34.305110 (+ 896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:34.306014 (+ 904us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:34.307348 (+ 1334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:34.307879 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:34.308042 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:34.310278 (+ 2236us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:50:34.310283 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:50:34.310287 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:50:34.310320 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:50:34.313306 (+ 2986us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:34.313995 (+ 689us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:34.314005 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:34.314007 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:34.314140 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:34.314590 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:34.314597 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:34.314601 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:34.314921 (+ 320us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:50:34.315097 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:34.315535 (+ 438us) server_negotiation.cc:299] Negotiation successful
0808 14:50:34.315793 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":218}
I20260808 14:50:34.316891 2671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:34.302776 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:40317 (local address 127.0.0.1:43450)
0808 14:50:34.303526 (+ 750us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:34.303613 (+ 87us) client_negotiation.cc:174] Beginning negotiation
0808 14:50:34.303809 (+ 196us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:50:34.304243 (+ 434us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:50:34.304248 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:50:34.304704 (+ 456us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:50:34.304942 (+ 238us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:34.304954 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:34.306174 (+ 1220us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:34.306180 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:34.307189 (+ 1009us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:34.307201 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:34.308061 (+ 860us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:34.308068 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:34.308303 (+ 235us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:34.309071 (+ 768us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:50:34.309096 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:50:34.309992 (+ 896us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:50:34.313456 (+ 3464us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:50:34.313462 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:50:34.313467 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:50:34.313852 (+ 385us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:50:34.314274 (+ 422us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:50:34.314280 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:50:34.314284 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:50:34.314459 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:50:34.315058 (+ 599us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:50:34.315064 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:50:34.315265 (+ 201us) client_negotiation.cc:769] Sending connection context
0808 14:50:34.315424 (+ 159us) client_negotiation.cc:240] Negotiation successful
0808 14:50:34.316363 (+ 939us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":603,"thread_start_us":437,"threads_started":1}
I20260808 14:50:34.317876 2026 tablet_copy_service.cc:140] P 7ec633ac085e4b5aa53213a2f91b43fa: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 7c552da230014669b01423a8c5d26637 ({username='oryx', principal='oryx/127.26.206.253@KRBTEST.COM'} at 127.0.0.1:43450)
I20260808 14:50:34.318256 2026 tablet_copy_service.cc:161] P 7ec633ac085e4b5aa53213a2f91b43fa: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 7c552da230014669b01423a8c5d26637 at {username='oryx', principal='oryx/127.26.206.253@KRBTEST.COM'} at 127.0.0.1:43450: session id = 7c552da230014669b01423a8c5d26637-00000000000000000000000000000000
I20260808 14:50:34.321792 2026 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 7ec633ac085e4b5aa53213a2f91b43fa: Tablet Copy: opened 0 blocks and 1 log segments
I20260808 14:50:34.324231 2534 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260808 14:50:34.329466 2534 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 7c552da230014669b01423a8c5d26637: tablet copy: Starting download of 0 data blocks...
I20260808 14:50:34.329850 2534 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 7c552da230014669b01423a8c5d26637: tablet copy: Starting download of 1 WAL segments...
I20260808 14:50:34.333019 2534 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 7c552da230014669b01423a8c5d26637: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260808 14:50:34.336874 2026 tablet_copy_service.cc:342] P 7ec633ac085e4b5aa53213a2f91b43fa: Request end of tablet copy session 7c552da230014669b01423a8c5d26637-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.26.206.253@KRBTEST.COM'} at 127.0.0.1:43450
I20260808 14:50:34.337108 2026 tablet_copy_service.cc:433] P 7ec633ac085e4b5aa53213a2f91b43fa: ending tablet copy session 7c552da230014669b01423a8c5d26637-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 7c552da230014669b01423a8c5d26637
I20260808 14:50:34.352027 2534 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:50:34.354683 2672 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:50:34.355851 2673 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:50:34.364578 2534 server_base.cc:1034] running on GCE node
W20260808 14:50:34.364928 2675 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:50:34.365391 2534 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:50:34.366056 2534 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:50:34.367295 2534 hybrid_clock.cc:648] HybridClock initialized: now 1786200634367227 us; error 33 us; skew 500 ppm
I20260808 14:50:34.367614 2534 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:50:34 dist-test-slave-6k22 krb5kdc[1949](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200634, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.206.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:50:34.370081 2534 init.cc:377] Logged in from keytab as oryx/127.26.206.253@KRBTEST.COM (short username oryx)
I20260808 14:50:34.371522 2534 webserver.cc:460] Webserver started at http://127.26.206.253:39343/ using document root <none> and password file <none>
I20260808 14:50:34.371974 2534 fs_manager.cc:359] Metadata directory not provided
I20260808 14:50:34.372076 2534 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:50:34.375494 2534 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260808 14:50:34.377645 2682 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:50:34.378129 2534 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.002s
I20260808 14:50:34.378295 2534 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/master-1/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/master-1/wal
uuid: "7c552da230014669b01423a8c5d26637"
format_stamp: "Formatted at 2026-08-08 14:50:33 on dist-test-slave-6k22"
server_key: "2ecabc3485470ba55a501ab3544daee5"
server_key_iv: "e76a77391c21a0e2606f5a745bc14ed9"
server_key_version: "encryptionkey@0"
I20260808 14:50:34.378485 2534 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:50:34.403282 2534 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:50:34.407877 2534 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:50:34.440034 2534 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.253:39527
I20260808 14:50:34.440058 2738 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.253:39527 every 8 connection(s)
I20260808 14:50:34.441216 2534 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/master-1/data/info.pb
I20260808 14:50:34.446866 2739 sys_catalog.cc:263] Verifying existing consensus state
I20260808 14:50:34.451297 2739 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7c552da230014669b01423a8c5d26637: Bootstrap starting.
I20260808 14:50:34.466825 2739 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7c552da230014669b01423a8c5d26637: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 14:50:34.467396 2739 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7c552da230014669b01423a8c5d26637: Bootstrap complete.
I20260808 14:50:34.468575 2739 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7c552da230014669b01423a8c5d26637 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "7ec633ac085e4b5aa53213a2f91b43fa" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 40317 } } peers { permanent_uuid: "7c552da230014669b01423a8c5d26637" member_type: NON_VOTER last_known_addr { host: "127.26.206.253" port: 39527 } attrs { promote: true } }
I20260808 14:50:34.469017 2739 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7c552da230014669b01423a8c5d26637 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 7c552da230014669b01423a8c5d26637, State: Initialized, Role: LEARNER
I20260808 14:50:34.469393 2739 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7c552da230014669b01423a8c5d26637 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "7ec633ac085e4b5aa53213a2f91b43fa" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 40317 } } peers { permanent_uuid: "7c552da230014669b01423a8c5d26637" member_type: NON_VOTER last_known_addr { host: "127.26.206.253" port: 39527 } attrs { promote: true } }
I20260808 14:50:34.470386 2742 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7c552da230014669b01423a8c5d26637 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "7ec633ac085e4b5aa53213a2f91b43fa" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 40317 } } peers { permanent_uuid: "7c552da230014669b01423a8c5d26637" member_type: NON_VOTER last_known_addr { host: "127.26.206.253" port: 39527 } attrs { promote: true } } }
I20260808 14:50:34.470913 2739 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7c552da230014669b01423a8c5d26637 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:50:34.470950 2742 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7c552da230014669b01423a8c5d26637 [sys.catalog]: This master's current role is: LEARNER
I20260808 14:50:34.484194 2754 catalog_manager.cc:1259] Loaded cluster ID: 9483185052154f6b952efaccfd87fc9f
I20260808 14:50:34.484298 2754 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 7c552da230014669b01423a8c5d26637: loading cluster ID for follower catalog manager: success
I20260808 14:50:34.487671 2754 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 7c552da230014669b01423a8c5d26637: acquiring CA information for follower catalog manager: success
I20260808 14:50:34.490181 2754 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 7c552da230014669b01423a8c5d26637: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 14:50:34.555048 2529 heartbeater.cc:503] Master 127.26.206.254:40317 was elected leader, sending a full tablet report...
W20260808 14:50:34.629367 2655 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:50:34.629653 2655 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:50:34.629812 2655 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:50:34.637176 2655 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:50:34.637282 2655 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:50:34.637439 2655 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:50:34.637540 2655 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:50:34.637609 2655 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:50:34.647894 2655 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:41683
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.26.206.254:40317,127.26.206.253:39527,127.26.206.252:46475
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/krb5kdc/oryx_127.26.206.252.keytab
--principal=oryx/127.26.206.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.206.252:46475
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.26.206.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:50:34.649294 2655 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:50:34.650664 2655 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:50:34.662881 2760 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:50:34.662920 2764 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:50:34.662828 2761 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:50:34.663765 2655 server_base.cc:1034] running on GCE node
I20260808 14:50:34.664582 2655 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:50:34.665951 2655 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:50:34.667222 2655 hybrid_clock.cc:648] HybridClock initialized: now 1786200634667170 us; error 59 us; skew 500 ppm
I20260808 14:50:34.667874 2655 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:50:34 dist-test-slave-6k22 krb5kdc[1949](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200634, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.206.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:50:34.671350 2655 init.cc:377] Logged in from keytab as oryx/127.26.206.252@KRBTEST.COM (short username oryx)
I20260808 14:50:34.673081 2655 webserver.cc:460] Webserver started at http://127.26.206.252:44741/ using document root <none> and password file <none>
I20260808 14:50:34.673818 2655 fs_manager.cc:359] Metadata directory not provided
I20260808 14:50:34.673976 2655 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:50:34.674309 2655 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:50:34.677421 2655 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/master-2/data/instance:
uuid: "aa9f091538e44434a211c36698df9e04"
format_stamp: "Formatted at 2026-08-08 14:50:34 on dist-test-slave-6k22"
server_key: "184c345fa4a570d9d22dff7d9716aed5"
server_key_iv: "0781ace5a2cc0e6ec7fdac4abbc9d31e"
server_key_version: "encryptionkey@0"
I20260808 14:50:34.678231 2655 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/master-2/wal/instance:
uuid: "aa9f091538e44434a211c36698df9e04"
format_stamp: "Formatted at 2026-08-08 14:50:34 on dist-test-slave-6k22"
server_key: "184c345fa4a570d9d22dff7d9716aed5"
server_key_iv: "0781ace5a2cc0e6ec7fdac4abbc9d31e"
server_key_version: "encryptionkey@0"
I20260808 14:50:34.683678 2655 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260808 14:50:34.687216 2771 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:50:34.688587 2655 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 14:50:34.688799 2655 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/master-2/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/master-2/wal
uuid: "aa9f091538e44434a211c36698df9e04"
format_stamp: "Formatted at 2026-08-08 14:50:34 on dist-test-slave-6k22"
server_key: "184c345fa4a570d9d22dff7d9716aed5"
server_key_iv: "0781ace5a2cc0e6ec7fdac4abbc9d31e"
server_key_version: "encryptionkey@0"
I20260808 14:50:34.688997 2655 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:50:34.713992 2655 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:50:34.718253 2655 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:50:34.718549 2655 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:50:34.738019 2655 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.252:46475
I20260808 14:50:34.738077 2829 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.252:46475 every 8 connection(s)
I20260808 14:50:34.739399 2655 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/master-2/data/info.pb
I20260808 14:50:34.743139 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 2655
I20260808 14:50:34.744091 2830 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:50:34.752542 2830 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.206.254" port: 40317 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 14:50:34 dist-test-slave-6k22 krb5kdc[1949](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200631, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.26.206.252@KRBTEST.COM
Aug 08 14:50:34 dist-test-slave-6k22 krb5kdc[1949](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200634, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.206.252@KRBTEST.COM for oryx/127.26.206.254@KRBTEST.COM
I20260808 14:50:34.768179 2835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:34.745492 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56686 (local address 127.26.206.252:46475)
0808 14:50:34.746282 (+ 790us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:34.746293 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:34.746332 (+ 39us) server_negotiation.cc:407] Connection header received
0808 14:50:34.748752 (+ 2420us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:34.748771 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:34.749195 (+ 424us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:34.749570 (+ 375us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:34.751069 (+ 1499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:34.752388 (+ 1319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:34.753712 (+ 1324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:34.754356 (+ 644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:34.754537 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:34.760028 (+ 5491us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:50:34.760038 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:50:34.760050 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:50:34.760089 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:50:34.763738 (+ 3649us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:34.764378 (+ 640us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:34.764386 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:34.764394 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:34.764548 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:34.764995 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:34.764999 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:34.765001 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:34.765698 (+ 697us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:50:34.765987 (+ 289us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:34.766531 (+ 544us) server_negotiation.cc:299] Negotiation successful
0808 14:50:34.766901 (+ 370us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":596,"thread_start_us":378,"threads_started":1}
I20260808 14:50:34.771226 2616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:34.754989 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43466 (local address 127.26.206.254:40317)
0808 14:50:34.755178 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:34.755182 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:34.755938 (+ 756us) server_negotiation.cc:407] Connection header received
0808 14:50:34.756099 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:34.756103 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:34.756165 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:34.756246 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:34.757701 (+ 1455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:34.758647 (+ 946us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:34.760186 (+ 1539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:34.760584 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:34.760674 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:34.764315 (+ 3641us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:50:34.764320 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:50:34.764323 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:50:34.764353 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:50:34.767519 (+ 3166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:34.768315 (+ 796us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:34.768320 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:34.768323 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:34.769348 (+ 1025us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:34.769830 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:34.769834 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:34.769836 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:34.770107 (+ 271us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:50:34.770216 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:34.770778 (+ 562us) server_negotiation.cc:299] Negotiation successful
0808 14:50:34.770993 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260808 14:50:34.771266 2836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:34.754905 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:40317 (local address 127.0.0.1:43466)
0808 14:50:34.755780 (+ 875us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:34.755833 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0808 14:50:34.755978 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:50:34.756348 (+ 370us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:50:34.756356 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:50:34.757188 (+ 832us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:50:34.757550 (+ 362us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:34.757564 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:34.758803 (+ 1239us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:34.758807 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:34.760056 (+ 1249us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:34.760067 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:34.760769 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:34.760778 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:34.760919 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:34.761506 (+ 587us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:50:34.761534 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:50:34.764135 (+ 2601us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:50:34.767726 (+ 3591us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:50:34.767734 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:50:34.767738 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:50:34.768176 (+ 438us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:50:34.769474 (+ 1298us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:50:34.769479 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:50:34.769483 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:50:34.769635 (+ 152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:50:34.770236 (+ 601us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:50:34.770242 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:50:34.770427 (+ 185us) client_negotiation.cc:769] Sending connection context
0808 14:50:34.770635 (+ 208us) client_negotiation.cc:240] Negotiation successful
0808 14:50:34.770940 (+ 305us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":612,"thread_start_us":465,"threads_started":1}
I20260808 14:50:34.772660 2830 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.206.253" port: 39527 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 14:50:34 dist-test-slave-6k22 krb5kdc[1949](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200634, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.206.252@KRBTEST.COM for oryx/127.26.206.253@KRBTEST.COM
I20260808 14:50:34.785689 2836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:34.773401 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.253:39527 (local address 127.0.0.1:53984)
0808 14:50:34.773606 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:34.773620 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 14:50:34.773730 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:50:34.774335 (+ 605us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:50:34.774342 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:50:34.774691 (+ 349us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:50:34.774817 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:34.774825 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:34.776174 (+ 1349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:34.776181 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:34.777112 (+ 931us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:34.777134 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:34.777838 (+ 704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:34.777844 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:34.778026 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:34.778562 (+ 536us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:50:34.778578 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:50:34.780522 (+ 1944us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:50:34.783840 (+ 3318us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:50:34.783843 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:50:34.783846 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:50:34.784191 (+ 345us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:50:34.784535 (+ 344us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:50:34.784538 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:50:34.784540 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:50:34.784672 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:50:34.785081 (+ 409us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:50:34.785084 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:50:34.785183 (+ 99us) client_negotiation.cc:769] Sending connection context
0808 14:50:34.785308 (+ 125us) client_negotiation.cc:240] Negotiation successful
0808 14:50:34.785491 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":53}
I20260808 14:50:34.785764 2837 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:34.773483 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53984 (local address 127.26.206.253:39527)
0808 14:50:34.774040 (+ 557us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:34.774044 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:34.774059 (+ 15us) server_negotiation.cc:407] Connection header received
0808 14:50:34.774106 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:34.774110 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:34.774165 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:34.774296 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:34.774972 (+ 676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:34.776036 (+ 1064us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:34.777280 (+ 1244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:34.777674 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:34.777803 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:34.780723 (+ 2920us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:50:34.780728 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:50:34.780731 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:50:34.780761 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:50:34.783720 (+ 2959us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:34.784308 (+ 588us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:34.784311 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:34.784314 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:34.784431 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:34.784757 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:34.784759 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:34.784761 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:34.784994 (+ 233us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:50:34.785109 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:34.785400 (+ 291us) server_negotiation.cc:299] Negotiation successful
0808 14:50:34.785541 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":455,"thread_start_us":305,"threads_started":1}
I20260808 14:50:34.786809 2830 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.206.252" port: 46475 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 14:50:34 dist-test-slave-6k22 krb5kdc[1949](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200634, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.206.252@KRBTEST.COM for oryx/127.26.206.252@KRBTEST.COM
I20260808 14:50:34.798602 2836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:34.787375 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.252:46475 (local address 127.0.0.1:56700)
0808 14:50:34.787514 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:34.787527 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 14:50:34.787679 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:50:34.787963 (+ 284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:50:34.787966 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:50:34.788264 (+ 298us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:50:34.788410 (+ 146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:34.788417 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:34.789317 (+ 900us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:34.789320 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:34.790144 (+ 824us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:34.790154 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:34.790970 (+ 816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:34.790976 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:34.791192 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:34.791787 (+ 595us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:50:34.791803 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:50:34.793661 (+ 1858us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:50:34.796298 (+ 2637us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:50:34.796303 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:50:34.796307 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:50:34.796638 (+ 331us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:50:34.796983 (+ 345us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:50:34.796987 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:50:34.796991 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:50:34.797136 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:50:34.797630 (+ 494us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:50:34.797634 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:50:34.797769 (+ 135us) client_negotiation.cc:769] Sending connection context
0808 14:50:34.797901 (+ 132us) client_negotiation.cc:240] Negotiation successful
0808 14:50:34.798155 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":47}
I20260808 14:50:34.798650 2835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:34.787522 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56700 (local address 127.26.206.252:46475)
0808 14:50:34.787730 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:34.787734 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:34.787747 (+ 13us) server_negotiation.cc:407] Connection header received
0808 14:50:34.787806 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:34.787809 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:34.787858 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:34.787931 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:34.788522 (+ 591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:34.789205 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:34.790285 (+ 1080us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:34.790671 (+ 386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:34.790861 (+ 190us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:34.793835 (+ 2974us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:50:34.793839 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:50:34.793842 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:50:34.793867 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:50:34.796162 (+ 2295us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:34.796749 (+ 587us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:34.796756 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:34.796760 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:34.796872 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:34.797238 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:34.797244 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:34.797248 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:34.797508 (+ 260us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:50:34.797650 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:34.797972 (+ 322us) server_negotiation.cc:299] Negotiation successful
0808 14:50:34.798308 (+ 336us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":124,"server-negotiator.queue_time_us":89}
I20260808 14:50:34.803203 2830 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aa9f091538e44434a211c36698df9e04: Bootstrap starting.
I20260808 14:50:34.806428 2830 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P aa9f091538e44434a211c36698df9e04: Neither blocks nor log segments found. Creating new log.
I20260808 14:50:34.807471 2830 log.cc:824] T 00000000000000000000000000000000 P aa9f091538e44434a211c36698df9e04: Log is configured to *not* fsync() on all Append() calls
I20260808 14:50:34.810263 2830 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aa9f091538e44434a211c36698df9e04: No bootstrap required, opened a new log
I20260808 14:50:34.818125 2830 raft_consensus.cc:348] T 00000000000000000000000000000000 P aa9f091538e44434a211c36698df9e04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ec633ac085e4b5aa53213a2f91b43fa" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 40317 } } peers { permanent_uuid: "7c552da230014669b01423a8c5d26637" member_type: VOTER last_known_addr { host: "127.26.206.253" port: 39527 } } peers { permanent_uuid: "aa9f091538e44434a211c36698df9e04" member_type: VOTER last_known_addr { host: "127.26.206.252" port: 46475 } }
I20260808 14:50:34.818457 2830 raft_consensus.cc:374] T 00000000000000000000000000000000 P aa9f091538e44434a211c36698df9e04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:50:34.818557 2830 raft_consensus.cc:729] T 00000000000000000000000000000000 P aa9f091538e44434a211c36698df9e04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa9f091538e44434a211c36698df9e04, State: Initialized, Role: FOLLOWER
I20260808 14:50:34.819085 2830 consensus_queue.cc:260] T 00000000000000000000000000000000 P aa9f091538e44434a211c36698df9e04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ec633ac085e4b5aa53213a2f91b43fa" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 40317 } } peers { permanent_uuid: "7c552da230014669b01423a8c5d26637" member_type: VOTER last_known_addr { host: "127.26.206.253" port: 39527 } } peers { permanent_uuid: "aa9f091538e44434a211c36698df9e04" member_type: VOTER last_known_addr { host: "127.26.206.252" port: 46475 } }
I20260808 14:50:34.819981 2840 sys_catalog.cc:455] T 00000000000000000000000000000000 P aa9f091538e44434a211c36698df9e04 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ec633ac085e4b5aa53213a2f91b43fa" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 40317 } } peers { permanent_uuid: "7c552da230014669b01423a8c5d26637" member_type: VOTER last_known_addr { host: "127.26.206.253" port: 39527 } } peers { permanent_uuid: "aa9f091538e44434a211c36698df9e04" member_type: VOTER last_known_addr { host: "127.26.206.252" port: 46475 } } }
I20260808 14:50:34.820313 2840 sys_catalog.cc:458] T 00000000000000000000000000000000 P aa9f091538e44434a211c36698df9e04 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 14:50:34.821082 2830 sys_catalog.cc:564] T 00000000000000000000000000000000 P aa9f091538e44434a211c36698df9e04 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:50:34.823648 2841 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7ec633ac085e4b5aa53213a2f91b43fa [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "7ec633ac085e4b5aa53213a2f91b43fa" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "7ec633ac085e4b5aa53213a2f91b43fa" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 40317 } } peers { permanent_uuid: "7c552da230014669b01423a8c5d26637" member_type: NON_VOTER last_known_addr { host: "127.26.206.253" port: 39527 } attrs { promote: true } } }
I20260808 14:50:34.825330 2841 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7ec633ac085e4b5aa53213a2f91b43fa [sys.catalog]: This master's current role is: LEADER
I20260808 14:50:34.832023 2849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:34.823811 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.253:39527 (local address 127.0.0.1:53986)
0808 14:50:34.825015 (+ 1204us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:34.825046 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0808 14:50:34.825281 (+ 235us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:50:34.825973 (+ 692us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:50:34.825977 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:50:34.826002 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:50:34.826193 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:34.826201 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:34.827488 (+ 1287us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:34.827492 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:34.829292 (+ 1800us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:34.829308 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:34.831109 (+ 1801us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:34.831115 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:34.831343 (+ 228us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:34.831416 (+ 73us) client_negotiation.cc:769] Sending connection context
0808 14:50:34.831493 (+ 77us) client_negotiation.cc:240] Negotiation successful
0808 14:50:34.831678 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1064,"thread_start_us":948,"threads_started":1}
I20260808 14:50:34.833107 2837 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:34.824207 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53986 (local address 127.26.206.253:39527)
0808 14:50:34.824448 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:34.824457 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:34.825137 (+ 680us) server_negotiation.cc:407] Connection header received
0808 14:50:34.825507 (+ 370us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:34.825515 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:34.825633 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:34.825729 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:50:34.826375 (+ 646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:34.827310 (+ 935us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:34.829456 (+ 2146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:34.830889 (+ 1433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:34.832452 (+ 1563us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:34.832646 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:34.832696 (+ 50us) server_negotiation.cc:299] Negotiation successful
0808 14:50:34.832826 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
W20260808 14:50:34.833467 2857 catalog_manager.cc:1558] T 00000000000000000000000000000000 P aa9f091538e44434a211c36698df9e04: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 14:50:34.833618 2857 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 14:50:34.834508 2742 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7c552da230014669b01423a8c5d26637 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7ec633ac085e4b5aa53213a2f91b43fa. Latest consensus state: current_term: 1 leader_uuid: "7ec633ac085e4b5aa53213a2f91b43fa" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "7ec633ac085e4b5aa53213a2f91b43fa" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 40317 } } peers { permanent_uuid: "7c552da230014669b01423a8c5d26637" member_type: NON_VOTER last_known_addr { host: "127.26.206.253" port: 39527 } attrs { promote: true } } }
I20260808 14:50:34.834807 2742 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7c552da230014669b01423a8c5d26637 [sys.catalog]: This master's current role is: LEARNER
I20260808 14:50:34.835536 2841 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 7ec633ac085e4b5aa53213a2f91b43fa: attempting to promote NON_VOTER 7c552da230014669b01423a8c5d26637 to VOTER
I20260808 14:50:34.836552 2841 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7ec633ac085e4b5aa53213a2f91b43fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "7ec633ac085e4b5aa53213a2f91b43fa" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 40317 } } peers { permanent_uuid: "7c552da230014669b01423a8c5d26637" member_type: VOTER last_known_addr { host: "127.26.206.253" port: 39527 } attrs { promote: false } }
I20260808 14:50:34.838538 2655 master_runner.cc:428] Detected that this master aa9f091538e44434a211c36698df9e04 is joining an existing cluster
I20260808 14:50:34.838617 2711 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 7c552da230014669b01423a8c5d26637 [term 1 LEARNER]: Refusing update from remote peer 7ec633ac085e4b5aa53213a2f91b43fa: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260808 14:50:34.838685 2655 master_runner.cc:432] Initiating AddMaster RPC to add 127.26.206.252:46475
I20260808 14:50:34.839188 2850 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 7ec633ac085e4b5aa53213a2f91b43fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c552da230014669b01423a8c5d26637" member_type: VOTER last_known_addr { host: "127.26.206.253" port: 39527 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260808 14:50:34.843233 2845 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 7ec633ac085e4b5aa53213a2f91b43fa [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 7c552da230014669b01423a8c5d26637 (127.26.206.253) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "7ec633ac085e4b5aa53213a2f91b43fa" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 40317 } } peers { permanent_uuid: "7c552da230014669b01423a8c5d26637" member_type: VOTER last_known_addr { host: "127.26.206.253" port: 39527 } attrs { promote: false } } }
I20260808 14:50:34.844334 2711 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 7c552da230014669b01423a8c5d26637 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 7c552da230014669b01423a8c5d26637 (127.26.206.253) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "7ec633ac085e4b5aa53213a2f91b43fa" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 40317 } } peers { permanent_uuid: "7c552da230014669b01423a8c5d26637" member_type: VOTER last_known_addr { host: "127.26.206.253" port: 39527 } attrs { promote: false } } }
I20260808 14:50:34.847295 2845 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7ec633ac085e4b5aa53213a2f91b43fa [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "7ec633ac085e4b5aa53213a2f91b43fa" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "7ec633ac085e4b5aa53213a2f91b43fa" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 40317 } } peers { permanent_uuid: "7c552da230014669b01423a8c5d26637" member_type: VOTER last_known_addr { host: "127.26.206.253" port: 39527 } attrs { promote: false } } }
I20260808 14:50:34.847519 2845 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7ec633ac085e4b5aa53213a2f91b43fa [sys.catalog]: This master's current role is: LEADER
I20260808 14:50:34.847761 2845 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7ec633ac085e4b5aa53213a2f91b43fa [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "7ec633ac085e4b5aa53213a2f91b43fa" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "7ec633ac085e4b5aa53213a2f91b43fa" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 40317 } } peers { permanent_uuid: "7c552da230014669b01423a8c5d26637" member_type: VOTER last_known_addr { host: "127.26.206.253" port: 39527 } attrs { promote: false } } }
I20260808 14:50:34.847981 2845 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7ec633ac085e4b5aa53213a2f91b43fa [sys.catalog]: This master's current role is: LEADER
I20260808 14:50:34.850354 2742 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7c552da230014669b01423a8c5d26637 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "7ec633ac085e4b5aa53213a2f91b43fa" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "7ec633ac085e4b5aa53213a2f91b43fa" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 40317 } } peers { permanent_uuid: "7c552da230014669b01423a8c5d26637" member_type: VOTER last_known_addr { host: "127.26.206.253" port: 39527 } attrs { promote: false } } }
I20260808 14:50:34.850716 2742 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7c552da230014669b01423a8c5d26637 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 14:50:34.874091 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 2070
I20260808 14:50:34.879943 2840 raft_consensus.cc:482] T 00000000000000000000000000000000 P aa9f091538e44434a211c36698df9e04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:50:34.880308 2840 raft_consensus.cc:504] T 00000000000000000000000000000000 P aa9f091538e44434a211c36698df9e04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ec633ac085e4b5aa53213a2f91b43fa" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 40317 } } peers { permanent_uuid: "7c552da230014669b01423a8c5d26637" member_type: VOTER last_known_addr { host: "127.26.206.253" port: 39527 } } peers { permanent_uuid: "aa9f091538e44434a211c36698df9e04" member_type: VOTER last_known_addr { host: "127.26.206.252" port: 46475 } }
I20260808 14:50:34.882102 2840 leader_election.cc:288] T 00000000000000000000000000000000 P aa9f091538e44434a211c36698df9e04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ec633ac085e4b5aa53213a2f91b43fa (127.26.206.254:40317), 7c552da230014669b01423a8c5d26637 (127.26.206.253:39527)
I20260808 14:50:34.882939 2711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "aa9f091538e44434a211c36698df9e04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c552da230014669b01423a8c5d26637" is_pre_election: true
I20260808 14:50:34.884274 2013 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "aa9f091538e44434a211c36698df9e04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ec633ac085e4b5aa53213a2f91b43fa" is_pre_election: true
I20260808 14:50:34.885373 2837 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:34.855707 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53990 (local address 127.26.206.253:39527)
0808 14:50:34.856006 (+ 299us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:34.856015 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:34.863116 (+ 7101us) server_negotiation.cc:407] Connection header received
0808 14:50:34.863430 (+ 314us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:34.863436 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:34.863514 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:34.863927 (+ 413us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:34.865903 (+ 1976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:34.867286 (+ 1383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:34.873661 (+ 6375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:34.874438 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:34.874549 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:34.878112 (+ 3563us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:50:34.878121 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:50:34.878128 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:50:34.878175 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:50:34.881923 (+ 3748us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:34.882786 (+ 863us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:34.882792 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:34.882797 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:34.882970 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:34.883492 (+ 522us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:34.883496 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:34.883500 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:34.883883 (+ 383us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:50:34.884023 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:34.884688 (+ 665us) server_negotiation.cc:299] Negotiation successful
0808 14:50:34.884945 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":156}
I20260808 14:50:34.885903 2775 leader_election.cc:302] T 00000000000000000000000000000000 P aa9f091538e44434a211c36698df9e04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aa9f091538e44434a211c36698df9e04; no voters: 7c552da230014669b01423a8c5d26637, 7ec633ac085e4b5aa53213a2f91b43fa
I20260808 14:50:34.887774 2840 raft_consensus.cc:2726] T 00000000000000000000000000000000 P aa9f091538e44434a211c36698df9e04 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260808 14:50:34.889391 2835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:34.863484 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56714 (local address 127.26.206.252:46475)
0808 14:50:34.863839 (+ 355us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:34.863849 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:34.869075 (+ 5226us) server_negotiation.cc:407] Connection header received
0808 14:50:34.869253 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:34.869258 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:34.869314 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:34.869375 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:34.870807 (+ 1432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:34.871846 (+ 1039us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:34.876398 (+ 4552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:34.877171 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:34.877283 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:34.880423 (+ 3140us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:50:34.880430 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:50:34.880435 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:50:34.880475 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:50:34.884192 (+ 3717us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:34.884975 (+ 783us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:34.884979 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:34.884982 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:34.885206 (+ 224us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:34.885592 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:34.885597 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:34.885600 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:34.885982 (+ 382us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:50:34.886140 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:34.887821 (+ 1681us) server_negotiation.cc:299] Negotiation successful
0808 14:50:34.888039 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":121}
I20260808 14:50:34.889448 2867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:34.864003 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.252:46475 (local address 127.0.0.1:56714)
0808 14:50:34.868997 (+ 4994us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:34.869013 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 14:50:34.869149 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:50:34.869538 (+ 389us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:50:34.869543 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:50:34.870294 (+ 751us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:50:34.870654 (+ 360us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:34.870665 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:34.872068 (+ 1403us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:34.872072 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:34.876237 (+ 4165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:34.876250 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:34.877738 (+ 1488us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:34.877744 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:34.877903 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:34.878593 (+ 690us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:50:34.878617 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:50:34.880233 (+ 1616us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:50:34.884342 (+ 4109us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:50:34.884346 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:50:34.884350 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:50:34.884857 (+ 507us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:50:34.885325 (+ 468us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:50:34.885330 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:50:34.885334 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:50:34.885475 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:50:34.886204 (+ 729us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:50:34.886208 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:50:34.887342 (+ 1134us) client_negotiation.cc:769] Sending connection context
0808 14:50:34.887530 (+ 188us) client_negotiation.cc:240] Negotiation successful
0808 14:50:34.888722 (+ 1192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4823,"thread_start_us":9825,"threads_started":1}
I20260808 14:50:34.889364 2866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:34.855775 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.253:39527 (local address 127.0.0.1:53990)
0808 14:50:34.863005 (+ 7230us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:34.863027 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 14:50:34.863261 (+ 234us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:50:34.864215 (+ 954us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:50:34.864225 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:50:34.865159 (+ 934us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:50:34.865663 (+ 504us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:34.865684 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:34.867574 (+ 1890us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:34.867603 (+ 29us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:34.869661 (+ 2058us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:34.869678 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:34.874935 (+ 5257us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:34.874943 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:34.875152 (+ 209us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:34.875972 (+ 820us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:50:34.876003 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:50:34.877201 (+ 1198us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:50:34.882076 (+ 4875us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:50:34.882089 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:50:34.882093 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:50:34.882641 (+ 548us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:50:34.883129 (+ 488us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:50:34.883134 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:50:34.883139 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:50:34.883350 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:50:34.884109 (+ 759us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:50:34.884115 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:50:34.884335 (+ 220us) client_negotiation.cc:769] Sending connection context
0808 14:50:34.885536 (+ 1201us) client_negotiation.cc:240] Negotiation successful
0808 14:50:34.885892 (+ 356us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7022,"mutex_wait_us":1,"thread_start_us":12232,"threads_started":1}
I20260808 14:50:34.898756 2616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:34.856255 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43474 (local address 127.26.206.254:40317)
0808 14:50:34.856577 (+ 322us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:34.856585 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:34.868391 (+ 11806us) server_negotiation.cc:407] Connection header received
0808 14:50:34.868558 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:34.868566 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:34.868659 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:34.868775 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:34.870543 (+ 1768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:34.871680 (+ 1137us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:34.874021 (+ 2341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:34.874874 (+ 853us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:34.874976 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:34.891776 (+ 16800us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:50:34.891782 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:50:34.891787 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:50:34.891829 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:50:34.895500 (+ 3671us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:34.896362 (+ 862us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:34.896367 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:34.896372 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:34.896529 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:34.897018 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:34.897024 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:34.897027 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:34.897394 (+ 367us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:50:34.897560 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:34.898141 (+ 581us) server_negotiation.cc:299] Negotiation successful
0808 14:50:34.898380 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":184}
I20260808 14:50:34.898943 2865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:34.862222 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:40317 (local address 127.0.0.1:43474)
0808 14:50:34.868286 (+ 6064us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:34.868303 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 14:50:34.868423 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:50:34.869063 (+ 640us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:50:34.869069 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:50:34.869884 (+ 815us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:50:34.870349 (+ 465us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:34.870365 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:34.871910 (+ 1545us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:34.871918 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:34.873722 (+ 1804us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:34.873739 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:34.889303 (+ 15564us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:34.889317 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:34.889524 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:34.890238 (+ 714us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:50:34.890271 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:50:34.891498 (+ 1227us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:50:34.895692 (+ 4194us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:50:34.895699 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:50:34.895704 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:50:34.896217 (+ 513us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:50:34.896675 (+ 458us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:50:34.896681 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:50:34.896686 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:50:34.896878 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:50:34.897543 (+ 665us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:50:34.897550 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:50:34.897794 (+ 244us) client_negotiation.cc:769] Sending connection context
0808 14:50:34.897998 (+ 204us) client_negotiation.cc:240] Negotiation successful
0808 14:50:34.898337 (+ 339us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5936,"thread_start_us":687,"threads_started":1}
Aug 08 14:50:34 dist-test-slave-6k22 krb5kdc[1949](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200631, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.26.206.193@KRBTEST.COM
I20260808 14:50:34.908125 2868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:34.876040 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58906 (local address 127.26.206.193:36989)
0808 14:50:34.886875 (+ 10835us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:34.886882 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:34.886907 (+ 25us) server_negotiation.cc:407] Connection header received
0808 14:50:34.886963 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:34.886970 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:34.887206 (+ 236us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:34.887445 (+ 239us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:34.889913 (+ 2468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:34.891094 (+ 1181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:34.893438 (+ 2344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:34.894414 (+ 976us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:34.895180 (+ 766us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:34.900571 (+ 5391us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:50:34.900583 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:50:34.900596 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:50:34.900631 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:50:34.904606 (+ 3975us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:34.905532 (+ 926us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:34.905542 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:34.905548 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:34.905787 (+ 239us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:34.906290 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:34.906298 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:34.906303 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:34.906684 (+ 381us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:50:34.907015 (+ 331us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:34.907390 (+ 375us) server_negotiation.cc:299] Negotiation successful
0808 14:50:34.907696 (+ 306us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10604,"thread_start_us":10744,"threads_started":1}
I20260808 14:50:34.909582 2213 generic_service.cc:196] Checking for leaks (request via RPC)
Aug 08 14:50:34 dist-test-slave-6k22 krb5kdc[1949](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200631, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.206.254@KRBTEST.COM for oryx/127.26.206.252@KRBTEST.COM
I20260808 14:50:34.921478 2849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:34.904656 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.252:46475 (local address 127.0.0.1:56730)
0808 14:50:34.904920 (+ 264us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:34.904942 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 14:50:34.905065 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:50:34.905494 (+ 429us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:50:34.905499 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:50:34.905997 (+ 498us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:50:34.906214 (+ 217us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:34.906229 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:34.907648 (+ 1419us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:34.907653 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:34.909078 (+ 1425us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:34.909094 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:34.910232 (+ 1138us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:34.910239 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:34.910429 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:34.911165 (+ 736us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:50:34.911193 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:50:34.914956 (+ 3763us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:50:34.918747 (+ 3791us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:50:34.918754 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:50:34.918758 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:50:34.919234 (+ 476us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:50:34.919694 (+ 460us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:50:34.919699 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:50:34.919703 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:50:34.919858 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:50:34.920414 (+ 556us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:50:34.920419 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:50:34.920626 (+ 207us) client_negotiation.cc:769] Sending connection context
0808 14:50:34.920798 (+ 172us) client_negotiation.cc:240] Negotiation successful
0808 14:50:34.921076 (+ 278us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141}
I20260808 14:50:34.921518 2835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:34.904675 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56730 (local address 127.26.206.252:46475)
0808 14:50:34.904819 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:34.904824 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:34.905021 (+ 197us) server_negotiation.cc:407] Connection header received
0808 14:50:34.905230 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:34.905235 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:34.905327 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:34.905426 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:34.906370 (+ 944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:34.907474 (+ 1104us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:34.909331 (+ 1857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:34.910003 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:34.910942 (+ 939us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:34.915158 (+ 4216us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:50:34.915176 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:50:34.915179 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:50:34.915209 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:50:34.918523 (+ 3314us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:34.919377 (+ 854us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:34.919383 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:34.919389 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:34.919519 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:34.919990 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:34.919997 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:34.920001 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:34.920277 (+ 276us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:50:34.920428 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:34.920917 (+ 489us) server_negotiation.cc:299] Negotiation successful
0808 14:50:34.921135 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260808 14:50:34.923401 2002 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.26.206.252:46475: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "aa9f091538e44434a211c36698df9e04"
member_type: NON_VOTER
last_known_addr {
host: "127.26.206.252"
port: 46475
}
attrs {
promote: true
}
}
dest_uuid: "7ec633ac085e4b5aa53213a2f91b43fa"
cas_config_opid_index: 6
I20260808 14:50:34.924196 2002 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7ec633ac085e4b5aa53213a2f91b43fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "7ec633ac085e4b5aa53213a2f91b43fa" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 40317 } } peers { permanent_uuid: "7c552da230014669b01423a8c5d26637" member_type: VOTER last_known_addr { host: "127.26.206.253" port: 39527 } attrs { promote: false } } peers { permanent_uuid: "aa9f091538e44434a211c36698df9e04" member_type: NON_VOTER last_known_addr { host: "127.26.206.252" port: 46475 } attrs { promote: true } }
I20260808 14:50:34.926754 2804 raft_consensus.cc:3037] T 00000000000000000000000000000000 P aa9f091538e44434a211c36698df9e04 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:50:34.929543 2804 raft_consensus.cc:1261] T 00000000000000000000000000000000 P aa9f091538e44434a211c36698df9e04 [term 1 FOLLOWER]: Refusing update from remote peer 7ec633ac085e4b5aa53213a2f91b43fa: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260808 14:50:34.930121 2711 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 7c552da230014669b01423a8c5d26637 [term 1 FOLLOWER]: Refusing update from remote peer 7ec633ac085e4b5aa53213a2f91b43fa: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260808 14:50:34.930465 2845 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 7ec633ac085e4b5aa53213a2f91b43fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa9f091538e44434a211c36698df9e04" member_type: NON_VOTER last_known_addr { host: "127.26.206.252" port: 46475 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:50:34.930996 2841 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 7ec633ac085e4b5aa53213a2f91b43fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c552da230014669b01423a8c5d26637" member_type: VOTER last_known_addr { host: "127.26.206.253" port: 39527 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260808 14:50:34.937980 2841 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 7ec633ac085e4b5aa53213a2f91b43fa [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, NON_VOTER aa9f091538e44434a211c36698df9e04 (127.26.206.252) added. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "7ec633ac085e4b5aa53213a2f91b43fa" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 40317 } } peers { permanent_uuid: "7c552da230014669b01423a8c5d26637" member_type: VOTER last_known_addr { host: "127.26.206.253" port: 39527 } attrs { promote: false } } peers { permanent_uuid: "aa9f091538e44434a211c36698df9e04" member_type: NON_VOTER last_known_addr { host: "127.26.206.252" port: 46475 } attrs { promote: true } } }
I20260808 14:50:34.940688 2711 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 7c552da230014669b01423a8c5d26637 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, NON_VOTER aa9f091538e44434a211c36698df9e04 (127.26.206.252) added. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "7ec633ac085e4b5aa53213a2f91b43fa" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 40317 } } peers { permanent_uuid: "7c552da230014669b01423a8c5d26637" member_type: VOTER last_known_addr { host: "127.26.206.253" port: 39527 } attrs { promote: false } } peers { permanent_uuid: "aa9f091538e44434a211c36698df9e04" member_type: NON_VOTER last_known_addr { host: "127.26.206.252" port: 46475 } attrs { promote: true } } }
I20260808 14:50:34.942623 2841 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.26.206.252:46475
I20260808 14:50:34.942937 2850 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7ec633ac085e4b5aa53213a2f91b43fa [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "7ec633ac085e4b5aa53213a2f91b43fa" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "7ec633ac085e4b5aa53213a2f91b43fa" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 40317 } } peers { permanent_uuid: "7c552da230014669b01423a8c5d26637" member_type: VOTER last_known_addr { host: "127.26.206.253" port: 39527 } attrs { promote: false } } peers { permanent_uuid: "aa9f091538e44434a211c36698df9e04" member_type: NON_VOTER last_known_addr { host: "127.26.206.252" port: 46475 } attrs { promote: true } } }
I20260808 14:50:34.943269 2850 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7ec633ac085e4b5aa53213a2f91b43fa [sys.catalog]: This master's current role is: LEADER
I20260808 14:50:34.943948 2655 master.cc:537] Master@127.26.206.252:46475 shutting down...
I20260808 14:50:34.944612 2841 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7ec633ac085e4b5aa53213a2f91b43fa [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "7ec633ac085e4b5aa53213a2f91b43fa" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "7ec633ac085e4b5aa53213a2f91b43fa" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 40317 } } peers { permanent_uuid: "7c552da230014669b01423a8c5d26637" member_type: VOTER last_known_addr { host: "127.26.206.253" port: 39527 } attrs { promote: false } } peers { permanent_uuid: "aa9f091538e44434a211c36698df9e04" member_type: NON_VOTER last_known_addr { host: "127.26.206.252" port: 46475 } attrs { promote: true } } }
I20260808 14:50:34.944900 2841 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7ec633ac085e4b5aa53213a2f91b43fa [sys.catalog]: This master's current role is: LEADER
I20260808 14:50:34.945330 2742 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7c552da230014669b01423a8c5d26637 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "7ec633ac085e4b5aa53213a2f91b43fa" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "7ec633ac085e4b5aa53213a2f91b43fa" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 40317 } } peers { permanent_uuid: "7c552da230014669b01423a8c5d26637" member_type: VOTER last_known_addr { host: "127.26.206.253" port: 39527 } attrs { promote: false } } peers { permanent_uuid: "aa9f091538e44434a211c36698df9e04" member_type: NON_VOTER last_known_addr { host: "127.26.206.252" port: 46475 } attrs { promote: true } } }
I20260808 14:50:34.945598 2742 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7c552da230014669b01423a8c5d26637 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 14:50:34.947893 2804 raft_consensus.cc:858] T 00000000000000000000000000000000 P aa9f091538e44434a211c36698df9e04 [term 1 NON_PARTICIPANT]: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
Committed config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ec633ac085e4b5aa53213a2f91b43fa" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 40317 } } peers { permanent_uuid: "7c552da230014669b01423a8c5d26637" member_type: VOTER last_known_addr { host: "127.26.206.253" port: 39527 } } peers { permanent_uuid: "aa9f091538e44434a211c36698df9e04" member_type: VOTER last_known_addr { host: "127.26.206.252" port: 46475 } }.
Pending config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "7ec633ac085e4b5aa53213a2f91b43fa" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 40317 } } peers { permanent_uuid: "7c552da230014669b01423a8c5d26637" member_type: NON_VOTER last_known_addr { host: "127.26.206.253" port: 39527 } attrs { promote: true } }:
New config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "7ec633ac085e4b5aa53213a2f91b43fa" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 40317 } } peers { permanent_uuid: "7c552da230014669b01423a8c5d26637" member_type: VOTER last_known_addr { host: "127.26.206.253" port: 39527 } attrs { promote: false } }
W20260808 14:50:34.948109 2804 raft_consensus.cc:1565] T 00000000000000000000000000000000 P aa9f091538e44434a211c36698df9e04 [term 1 NON_PARTICIPANT]: Could not prepare op 'term: 1 index: 6' and following 1 ops. Status for this op: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
Committed config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ec633ac085e4b5aa53213a2f91b43fa" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 40317 } } peers { permanent_uuid: "7c552da230014669b01423a8c5d26637" member_type: VOTER last_known_addr { host: "127.26.206.253" port: 39527 } } peers { permanent_uuid: "aa9f091538e44434a211c36698df9e04" member_type: VOTER last_known_addr { host: "127.26.206.252" port: 46475 } }.
Pending config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "7ec633ac085e4b5aa53213a2f91b43fa" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 40317 } } peers { permanent_uuid: "7c552da230014669b01423a8c5d26637" member_type: NON_VOTER last_known_addr { host: "127.26.206.253" port: 39527 } attrs { promote: true } }:
New config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "7ec633ac085e4b5aa53213a2f91b43fa" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 40317 } } peers { permanent_uuid: "7c552da230014669b01423a8c5d26637" member_type: VOTER last_known_addr { host: "127.26.206.253" port: 39527 } attrs { promote: false } }
I20260808 14:50:34.970498 2804 raft_consensus.cc:2932] T 00000000000000000000000000000000 P aa9f091538e44434a211c36698df9e04 [term 1 NON_PARTICIPANT]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 7c552da230014669b01423a8c5d26637 (127.26.206.253) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "7ec633ac085e4b5aa53213a2f91b43fa" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 40317 } } peers { permanent_uuid: "7c552da230014669b01423a8c5d26637" member_type: NON_VOTER last_known_addr { host: "127.26.206.253" port: 39527 } attrs { promote: true } } }
I20260808 14:50:34.990477 2874 sys_catalog.cc:455] T 00000000000000000000000000000000 P aa9f091538e44434a211c36698df9e04 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "7ec633ac085e4b5aa53213a2f91b43fa" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "7ec633ac085e4b5aa53213a2f91b43fa" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 40317 } } peers { permanent_uuid: "7c552da230014669b01423a8c5d26637" member_type: NON_VOTER last_known_addr { host: "127.26.206.253" port: 39527 } attrs { promote: true } } }
I20260808 14:50:34.990978 2874 sys_catalog.cc:458] T 00000000000000000000000000000000 P aa9f091538e44434a211c36698df9e04 [sys.catalog]: This master's current role is: NON_PARTICIPANT
I20260808 14:50:34.991292 2840 sys_catalog.cc:455] T 00000000000000000000000000000000 P aa9f091538e44434a211c36698df9e04 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7ec633ac085e4b5aa53213a2f91b43fa. Latest consensus state: current_term: 1 leader_uuid: "7ec633ac085e4b5aa53213a2f91b43fa" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "7ec633ac085e4b5aa53213a2f91b43fa" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 40317 } } peers { permanent_uuid: "7c552da230014669b01423a8c5d26637" member_type: NON_VOTER last_known_addr { host: "127.26.206.253" port: 39527 } attrs { promote: true } } }
I20260808 14:50:34.991458 2840 sys_catalog.cc:458] T 00000000000000000000000000000000 P aa9f091538e44434a211c36698df9e04 [sys.catalog]: This master's current role is: NON_PARTICIPANT
I20260808 14:50:34.991451 2841 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7ec633ac085e4b5aa53213a2f91b43fa [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "7ec633ac085e4b5aa53213a2f91b43fa" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "7ec633ac085e4b5aa53213a2f91b43fa" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 40317 } } peers { permanent_uuid: "7c552da230014669b01423a8c5d26637" member_type: VOTER last_known_addr { host: "127.26.206.253" port: 39527 } attrs { promote: false } } peers { permanent_uuid: "aa9f091538e44434a211c36698df9e04" member_type: NON_VOTER last_known_addr { host: "127.26.206.252" port: 46475 } attrs { promote: true } } }
I20260808 14:50:34.991794 2841 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7ec633ac085e4b5aa53213a2f91b43fa [sys.catalog]: This master's current role is: LEADER
I20260808 14:50:34.992231 2878 sys_catalog.cc:455] T 00000000000000000000000000000000 P aa9f091538e44434a211c36698df9e04 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "7ec633ac085e4b5aa53213a2f91b43fa" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "7ec633ac085e4b5aa53213a2f91b43fa" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 40317 } } peers { permanent_uuid: "7c552da230014669b01423a8c5d26637" member_type: NON_VOTER last_known_addr { host: "127.26.206.253" port: 39527 } attrs { promote: true } } }
I20260808 14:50:34.992623 2878 sys_catalog.cc:458] T 00000000000000000000000000000000 P aa9f091538e44434a211c36698df9e04 [sys.catalog]: This master's current role is: NON_PARTICIPANT
W20260808 14:50:34.993057 1987 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
I20260808 14:50:34.995530 2655 raft_consensus.cc:2229] T 00000000000000000000000000000000 P aa9f091538e44434a211c36698df9e04 [term 1 NON_PARTICIPANT]: Raft consensus shutting down.
I20260808 14:50:34.995988 2655 raft_consensus.cc:2258] T 00000000000000000000000000000000 P aa9f091538e44434a211c36698df9e04 [term 1 NON_PARTICIPANT]: Raft consensus is shut down!
I20260808 14:50:34.996141 2655 tablet_replica.cc:330] T 00000000000000000000000000000000 P aa9f091538e44434a211c36698df9e04: stopping tablet replica
W20260808 14:50:34.996116 1987 consensus_peers.cc:487] T 00000000000000000000000000000000 P 7ec633ac085e4b5aa53213a2f91b43fa -> Peer aa9f091538e44434a211c36698df9e04 (127.26.206.252:46475): Couldn't send request to peer aa9f091538e44434a211c36698df9e04. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260808 14:50:35.014194 2655 master.cc:552] Master@127.26.206.252:46475 shutdown complete.
I20260808 14:50:35.014292 2655 master_runner.cc:305] Clearing existing system tablet
I20260808 14:50:35.014662 2655 fs_manager.cc:359] Metadata directory not provided
I20260808 14:50:35.014776 2655 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:50:35.019866 2655 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.001s sys 0.001s
I20260808 14:50:35.021955 2882 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:50:35.022538 2655 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:50:35.022881 2655 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 14:50:35.023012 2655 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/master-2/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/master-2/wal
uuid: "aa9f091538e44434a211c36698df9e04"
format_stamp: "Formatted at 2026-08-08 14:50:34 on dist-test-slave-6k22"
server_key: "184c345fa4a570d9d22dff7d9716aed5"
server_key_iv: "0781ace5a2cc0e6ec7fdac4abbc9d31e"
server_key_version: "encryptionkey@0"
I20260808 14:50:35.027508 2655 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P aa9f091538e44434a211c36698df9e04: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:50:35.035079 2655 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P aa9f091538e44434a211c36698df9e04: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260808 14:50:35.035295 2655 log.cc:1196] T 00000000000000000000000000000000 P aa9f091538e44434a211c36698df9e04: Deleting WAL directory at /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260808 14:50:35.035907 2655 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P aa9f091538e44434a211c36698df9e04: Deleting consensus metadata
I20260808 14:50:35.036191 2655 master_runner.cc:315] Copying system tablet from 127.26.206.254:40317
I20260808 14:50:35.036573 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 2070
I20260808 14:50:35.056099 2655 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P aa9f091538e44434a211c36698df9e04: tablet copy: Beginning tablet copy session from remote peer at address 127.26.206.254:40317
I20260808 14:50:35.070317 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.206.193:36989
--local_ip_for_outbound_sockets=127.26.206.193
--tserver_master_addrs=127.26.206.254:40317
--webserver_port=39741
--webserver_interface=127.26.206.193
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/krb5kdc/oryx_127.26.206.193.keytab
--principal=oryx/127.26.206.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.206.212:41683
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.26.206.254:40317,127.26.206.253:39527
--tserver_master_addrs=127.26.206.254:40317,127.26.206.253:39527,127.26.206.252:46475 with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 14:50:35.075944 2889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:35.056895 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:40317 (local address 127.0.0.1:43482)
0808 14:50:35.057864 (+ 969us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:35.057885 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 14:50:35.058096 (+ 211us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:50:35.058737 (+ 641us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:50:35.058744 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:50:35.059382 (+ 638us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:50:35.060044 (+ 662us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:35.060072 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:35.061932 (+ 1860us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:35.061940 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:35.064015 (+ 2075us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:35.064034 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:35.065383 (+ 1349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:35.065392 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:35.065618 (+ 226us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:35.066401 (+ 783us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:50:35.066431 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:50:35.067740 (+ 1309us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:50:35.072595 (+ 4855us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:50:35.072602 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:50:35.072606 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:50:35.073216 (+ 610us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:50:35.073707 (+ 491us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:50:35.073713 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:50:35.073717 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:50:35.073924 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:50:35.074670 (+ 746us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:50:35.074677 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:50:35.074887 (+ 210us) client_negotiation.cc:769] Sending connection context
0808 14:50:35.075050 (+ 163us) client_negotiation.cc:240] Negotiation successful
0808 14:50:35.075374 (+ 324us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":794,"thread_start_us":668,"threads_started":1}
I20260808 14:50:35.076011 2616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:35.057086 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43482 (local address 127.26.206.254:40317)
0808 14:50:35.057334 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:35.057341 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:35.057968 (+ 627us) server_negotiation.cc:407] Connection header received
0808 14:50:35.058242 (+ 274us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:35.058249 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:35.058351 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:35.058445 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:35.060285 (+ 1840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:35.061710 (+ 1425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:35.064218 (+ 2508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:35.064989 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:35.065103 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:35.067989 (+ 2886us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:50:35.067999 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:50:35.068008 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:50:35.068057 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:50:35.072419 (+ 4362us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:35.073375 (+ 956us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:35.073384 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:35.073390 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:35.073574 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:35.074061 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:35.074068 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:35.074074 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:35.074532 (+ 458us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:50:35.074706 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:35.075212 (+ 506us) server_negotiation.cc:299] Negotiation successful
0808 14:50:35.075497 (+ 285us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":123}
I20260808 14:50:35.077165 2026 tablet_copy_service.cc:140] P 7ec633ac085e4b5aa53213a2f91b43fa: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer aa9f091538e44434a211c36698df9e04 ({username='oryx', principal='oryx/127.26.206.252@KRBTEST.COM'} at 127.0.0.1:43482)
I20260808 14:50:35.077366 2026 tablet_copy_service.cc:161] P 7ec633ac085e4b5aa53213a2f91b43fa: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer aa9f091538e44434a211c36698df9e04 at {username='oryx', principal='oryx/127.26.206.252@KRBTEST.COM'} at 127.0.0.1:43482: session id = aa9f091538e44434a211c36698df9e04-00000000000000000000000000000000
I20260808 14:50:35.081182 2026 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 7ec633ac085e4b5aa53213a2f91b43fa: Tablet Copy: opened 0 blocks and 1 log segments
I20260808 14:50:35.083263 2655 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260808 14:50:35.091866 2655 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P aa9f091538e44434a211c36698df9e04: tablet copy: Starting download of 0 data blocks...
I20260808 14:50:35.092218 2655 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P aa9f091538e44434a211c36698df9e04: tablet copy: Starting download of 1 WAL segments...
I20260808 14:50:35.094944 2655 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P aa9f091538e44434a211c36698df9e04: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260808 14:50:35.100544 2026 tablet_copy_service.cc:342] P 7ec633ac085e4b5aa53213a2f91b43fa: Request end of tablet copy session aa9f091538e44434a211c36698df9e04-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.26.206.252@KRBTEST.COM'} at 127.0.0.1:43482
I20260808 14:50:35.100687 2026 tablet_copy_service.cc:433] P 7ec633ac085e4b5aa53213a2f91b43fa: ending tablet copy session aa9f091538e44434a211c36698df9e04-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer aa9f091538e44434a211c36698df9e04
I20260808 14:50:35.113654 2655 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:50:35.116571 2892 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:50:35.120759 2893 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:50:35.132143 2655 server_base.cc:1034] running on GCE node
W20260808 14:50:35.133200 2895 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:50:35.133688 2655 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:50:35.134544 2655 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:50:35.135818 2655 hybrid_clock.cc:648] HybridClock initialized: now 1786200635135713 us; error 80 us; skew 500 ppm
I20260808 14:50:35.136175 2655 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:50:35 dist-test-slave-6k22 krb5kdc[1949](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200635, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.206.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:50:35.138753 2655 init.cc:377] Logged in from keytab as oryx/127.26.206.252@KRBTEST.COM (short username oryx)
I20260808 14:50:35.140303 2655 webserver.cc:460] Webserver started at http://127.26.206.252:35675/ using document root <none> and password file <none>
I20260808 14:50:35.140666 2655 fs_manager.cc:359] Metadata directory not provided
I20260808 14:50:35.140810 2655 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:50:35.144009 2655 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260808 14:50:35.146049 2902 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:50:35.146647 2655 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.001s
I20260808 14:50:35.146782 2655 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/master-2/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/master-2/wal
uuid: "aa9f091538e44434a211c36698df9e04"
format_stamp: "Formatted at 2026-08-08 14:50:34 on dist-test-slave-6k22"
server_key: "184c345fa4a570d9d22dff7d9716aed5"
server_key_iv: "0781ace5a2cc0e6ec7fdac4abbc9d31e"
server_key_version: "encryptionkey@0"
I20260808 14:50:35.146979 2655 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:50:35.168494 2655 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:50:35.172960 2655 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:50:35.227582 2655 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.252:46475
I20260808 14:50:35.227769 2962 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.252:46475 every 8 connection(s)
I20260808 14:50:35.228740 2655 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/master-2/data/info.pb
I20260808 14:50:35.234338 2963 sys_catalog.cc:263] Verifying existing consensus state
I20260808 14:50:35.238822 2963 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aa9f091538e44434a211c36698df9e04: Bootstrap starting.
I20260808 14:50:35.256402 2963 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aa9f091538e44434a211c36698df9e04: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 14:50:35.257149 2963 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aa9f091538e44434a211c36698df9e04: Bootstrap complete.
I20260808 14:50:35.258468 2963 raft_consensus.cc:348] T 00000000000000000000000000000000 P aa9f091538e44434a211c36698df9e04 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "7ec633ac085e4b5aa53213a2f91b43fa" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 40317 } } peers { permanent_uuid: "7c552da230014669b01423a8c5d26637" member_type: VOTER last_known_addr { host: "127.26.206.253" port: 39527 } attrs { promote: false } } peers { permanent_uuid: "aa9f091538e44434a211c36698df9e04" member_type: NON_VOTER last_known_addr { host: "127.26.206.252" port: 46475 } attrs { promote: true } }
I20260808 14:50:35.258821 2963 raft_consensus.cc:729] T 00000000000000000000000000000000 P aa9f091538e44434a211c36698df9e04 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: aa9f091538e44434a211c36698df9e04, State: Initialized, Role: LEARNER
I20260808 14:50:35.259121 2963 consensus_queue.cc:260] T 00000000000000000000000000000000 P aa9f091538e44434a211c36698df9e04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "7ec633ac085e4b5aa53213a2f91b43fa" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 40317 } } peers { permanent_uuid: "7c552da230014669b01423a8c5d26637" member_type: VOTER last_known_addr { host: "127.26.206.253" port: 39527 } attrs { promote: false } } peers { permanent_uuid: "aa9f091538e44434a211c36698df9e04" member_type: NON_VOTER last_known_addr { host: "127.26.206.252" port: 46475 } attrs { promote: true } }
I20260808 14:50:35.260094 2966 sys_catalog.cc:455] T 00000000000000000000000000000000 P aa9f091538e44434a211c36698df9e04 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "7ec633ac085e4b5aa53213a2f91b43fa" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 40317 } } peers { permanent_uuid: "7c552da230014669b01423a8c5d26637" member_type: VOTER last_known_addr { host: "127.26.206.253" port: 39527 } attrs { promote: false } } peers { permanent_uuid: "aa9f091538e44434a211c36698df9e04" member_type: NON_VOTER last_known_addr { host: "127.26.206.252" port: 46475 } attrs { promote: true } } }
I20260808 14:50:35.260458 2963 sys_catalog.cc:564] T 00000000000000000000000000000000 P aa9f091538e44434a211c36698df9e04 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:50:35.260636 2966 sys_catalog.cc:458] T 00000000000000000000000000000000 P aa9f091538e44434a211c36698df9e04 [sys.catalog]: This master's current role is: LEARNER
I20260808 14:50:35.271994 2979 catalog_manager.cc:1259] Loaded cluster ID: 9483185052154f6b952efaccfd87fc9f
I20260808 14:50:35.272111 2979 catalog_manager.cc:1552] T 00000000000000000000000000000000 P aa9f091538e44434a211c36698df9e04: loading cluster ID for follower catalog manager: success
I20260808 14:50:35.275803 2979 catalog_manager.cc:1574] T 00000000000000000000000000000000 P aa9f091538e44434a211c36698df9e04: acquiring CA information for follower catalog manager: success
I20260808 14:50:35.278301 2979 catalog_manager.cc:1602] T 00000000000000000000000000000000 P aa9f091538e44434a211c36698df9e04: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 14:50:35.437901 2845 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7ec633ac085e4b5aa53213a2f91b43fa [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "7ec633ac085e4b5aa53213a2f91b43fa" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "7ec633ac085e4b5aa53213a2f91b43fa" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 40317 } } peers { permanent_uuid: "7c552da230014669b01423a8c5d26637" member_type: VOTER last_known_addr { host: "127.26.206.253" port: 39527 } attrs { promote: false } } peers { permanent_uuid: "aa9f091538e44434a211c36698df9e04" member_type: NON_VOTER last_known_addr { host: "127.26.206.252" port: 46475 } attrs { promote: true } } }
I20260808 14:50:35.438211 2845 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7ec633ac085e4b5aa53213a2f91b43fa [sys.catalog]: This master's current role is: LEADER
I20260808 14:50:35.445297 2981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:35.438767 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56738 (local address 127.26.206.252:46475)
0808 14:50:35.439875 (+ 1108us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:35.439880 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:35.439897 (+ 17us) server_negotiation.cc:407] Connection header received
0808 14:50:35.439956 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:35.439959 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:35.440025 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:35.440154 (+ 129us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:50:35.440620 (+ 466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:35.441925 (+ 1305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:35.443436 (+ 1511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:35.444274 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:35.444503 (+ 229us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:35.444693 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:35.444860 (+ 167us) server_negotiation.cc:299] Negotiation successful
0808 14:50:35.444987 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":986,"thread_start_us":857,"threads_started":1}
I20260808 14:50:35.445313 2980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:35.438316 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.252:46475 (local address 127.0.0.1:56738)
0808 14:50:35.438851 (+ 535us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:35.438880 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0808 14:50:35.439055 (+ 175us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:50:35.440190 (+ 1135us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:50:35.440195 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:50:35.440224 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:50:35.440463 (+ 239us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:35.440473 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:35.442078 (+ 1605us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:35.442084 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:35.443268 (+ 1184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:35.443289 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:35.444459 (+ 1170us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:35.444467 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:35.444675 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:35.444711 (+ 36us) client_negotiation.cc:769] Sending connection context
0808 14:50:35.444837 (+ 126us) client_negotiation.cc:240] Negotiation successful
0808 14:50:35.444979 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":400,"thread_start_us":287,"threads_started":1}
I20260808 14:50:35.446344 2932 raft_consensus.cc:1203] T 00000000000000000000000000000000 P aa9f091538e44434a211c36698df9e04 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.5->[1.6-1.7] Dedup: 1.7->[]
I20260808 14:50:35.446779 2966 sys_catalog.cc:455] T 00000000000000000000000000000000 P aa9f091538e44434a211c36698df9e04 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7ec633ac085e4b5aa53213a2f91b43fa. Latest consensus state: current_term: 1 leader_uuid: "7ec633ac085e4b5aa53213a2f91b43fa" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "7ec633ac085e4b5aa53213a2f91b43fa" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 40317 } } peers { permanent_uuid: "7c552da230014669b01423a8c5d26637" member_type: VOTER last_known_addr { host: "127.26.206.253" port: 39527 } attrs { promote: false } } peers { permanent_uuid: "aa9f091538e44434a211c36698df9e04" member_type: NON_VOTER last_known_addr { host: "127.26.206.252" port: 46475 } attrs { promote: true } } }
I20260808 14:50:35.447049 2966 sys_catalog.cc:458] T 00000000000000000000000000000000 P aa9f091538e44434a211c36698df9e04 [sys.catalog]: This master's current role is: LEARNER
I20260808 14:50:35.447486 2841 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 7ec633ac085e4b5aa53213a2f91b43fa: attempting to promote NON_VOTER aa9f091538e44434a211c36698df9e04 to VOTER
I20260808 14:50:35.448287 2841 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7ec633ac085e4b5aa53213a2f91b43fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "7ec633ac085e4b5aa53213a2f91b43fa" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 40317 } } peers { permanent_uuid: "7c552da230014669b01423a8c5d26637" member_type: VOTER last_known_addr { host: "127.26.206.253" port: 39527 } attrs { promote: false } } peers { permanent_uuid: "aa9f091538e44434a211c36698df9e04" member_type: VOTER last_known_addr { host: "127.26.206.252" port: 46475 } attrs { promote: false } }
I20260808 14:50:35.450361 2932 raft_consensus.cc:1261] T 00000000000000000000000000000000 P aa9f091538e44434a211c36698df9e04 [term 1 LEARNER]: Refusing update from remote peer 7ec633ac085e4b5aa53213a2f91b43fa: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260808 14:50:35.450367 2711 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 7c552da230014669b01423a8c5d26637 [term 1 FOLLOWER]: Refusing update from remote peer 7ec633ac085e4b5aa53213a2f91b43fa: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260808 14:50:35.451012 2845 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 7ec633ac085e4b5aa53213a2f91b43fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa9f091538e44434a211c36698df9e04" member_type: VOTER last_known_addr { host: "127.26.206.252" port: 46475 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260808 14:50:35.451290 2850 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 7ec633ac085e4b5aa53213a2f91b43fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c552da230014669b01423a8c5d26637" member_type: VOTER last_known_addr { host: "127.26.206.253" port: 39527 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260808 14:50:35.454082 2845 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 7ec633ac085e4b5aa53213a2f91b43fa [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, aa9f091538e44434a211c36698df9e04 (127.26.206.252) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "7ec633ac085e4b5aa53213a2f91b43fa" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 40317 } } peers { permanent_uuid: "7c552da230014669b01423a8c5d26637" member_type: VOTER last_known_addr { host: "127.26.206.253" port: 39527 } attrs { promote: false } } peers { permanent_uuid: "aa9f091538e44434a211c36698df9e04" member_type: VOTER last_known_addr { host: "127.26.206.252" port: 46475 } attrs { promote: false } } }
I20260808 14:50:35.457188 2841 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7ec633ac085e4b5aa53213a2f91b43fa [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "7ec633ac085e4b5aa53213a2f91b43fa" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "7ec633ac085e4b5aa53213a2f91b43fa" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 40317 } } peers { permanent_uuid: "7c552da230014669b01423a8c5d26637" member_type: VOTER last_known_addr { host: "127.26.206.253" port: 39527 } attrs { promote: false } } peers { permanent_uuid: "aa9f091538e44434a211c36698df9e04" member_type: VOTER last_known_addr { host: "127.26.206.252" port: 46475 } attrs { promote: false } } }
I20260808 14:50:35.457494 2841 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7ec633ac085e4b5aa53213a2f91b43fa [sys.catalog]: This master's current role is: LEADER
I20260808 14:50:35.457348 2711 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 7c552da230014669b01423a8c5d26637 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, aa9f091538e44434a211c36698df9e04 (127.26.206.252) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "7ec633ac085e4b5aa53213a2f91b43fa" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 40317 } } peers { permanent_uuid: "7c552da230014669b01423a8c5d26637" member_type: VOTER last_known_addr { host: "127.26.206.253" port: 39527 } attrs { promote: false } } peers { permanent_uuid: "aa9f091538e44434a211c36698df9e04" member_type: VOTER last_known_addr { host: "127.26.206.252" port: 46475 } attrs { promote: false } } }
I20260808 14:50:35.457772 2841 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7ec633ac085e4b5aa53213a2f91b43fa [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "7ec633ac085e4b5aa53213a2f91b43fa" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "7ec633ac085e4b5aa53213a2f91b43fa" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 40317 } } peers { permanent_uuid: "7c552da230014669b01423a8c5d26637" member_type: VOTER last_known_addr { host: "127.26.206.253" port: 39527 } attrs { promote: false } } peers { permanent_uuid: "aa9f091538e44434a211c36698df9e04" member_type: VOTER last_known_addr { host: "127.26.206.252" port: 46475 } attrs { promote: false } } }
I20260808 14:50:35.458014 2841 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7ec633ac085e4b5aa53213a2f91b43fa [sys.catalog]: This master's current role is: LEADER
I20260808 14:50:35.461621 2983 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7c552da230014669b01423a8c5d26637 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "7ec633ac085e4b5aa53213a2f91b43fa" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "7ec633ac085e4b5aa53213a2f91b43fa" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 40317 } } peers { permanent_uuid: "7c552da230014669b01423a8c5d26637" member_type: VOTER last_known_addr { host: "127.26.206.253" port: 39527 } attrs { promote: false } } peers { permanent_uuid: "aa9f091538e44434a211c36698df9e04" member_type: VOTER last_known_addr { host: "127.26.206.252" port: 46475 } attrs { promote: false } } }
I20260808 14:50:35.461892 2983 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7c552da230014669b01423a8c5d26637 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 14:50:35.461923 2845 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7ec633ac085e4b5aa53213a2f91b43fa [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "7ec633ac085e4b5aa53213a2f91b43fa" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "7ec633ac085e4b5aa53213a2f91b43fa" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 40317 } } peers { permanent_uuid: "7c552da230014669b01423a8c5d26637" member_type: VOTER last_known_addr { host: "127.26.206.253" port: 39527 } attrs { promote: false } } peers { permanent_uuid: "aa9f091538e44434a211c36698df9e04" member_type: VOTER last_known_addr { host: "127.26.206.252" port: 46475 } attrs { promote: false } } }
I20260808 14:50:35.462172 2845 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7ec633ac085e4b5aa53213a2f91b43fa [sys.catalog]: This master's current role is: LEADER
I20260808 14:50:35.462694 2932 raft_consensus.cc:2932] T 00000000000000000000000000000000 P aa9f091538e44434a211c36698df9e04 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, aa9f091538e44434a211c36698df9e04 (127.26.206.252) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "7ec633ac085e4b5aa53213a2f91b43fa" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 40317 } } peers { permanent_uuid: "7c552da230014669b01423a8c5d26637" member_type: VOTER last_known_addr { host: "127.26.206.253" port: 39527 } attrs { promote: false } } peers { permanent_uuid: "aa9f091538e44434a211c36698df9e04" member_type: VOTER last_known_addr { host: "127.26.206.252" port: 46475 } attrs { promote: false } } }
I20260808 14:50:35.465653 2966 sys_catalog.cc:455] T 00000000000000000000000000000000 P aa9f091538e44434a211c36698df9e04 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "7ec633ac085e4b5aa53213a2f91b43fa" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "7ec633ac085e4b5aa53213a2f91b43fa" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 40317 } } peers { permanent_uuid: "7c552da230014669b01423a8c5d26637" member_type: VOTER last_known_addr { host: "127.26.206.253" port: 39527 } attrs { promote: false } } peers { permanent_uuid: "aa9f091538e44434a211c36698df9e04" member_type: VOTER last_known_addr { host: "127.26.206.252" port: 46475 } attrs { promote: false } } }
I20260808 14:50:35.465914 2966 sys_catalog.cc:458] T 00000000000000000000000000000000 P aa9f091538e44434a211c36698df9e04 [sys.catalog]: This master's current role is: FOLLOWER
W20260808 14:50:35.479158 2890 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:50:35.479452 2890 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:50:35.479666 2890 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:50:35.486886 2890 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:50:35.487030 2890 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:50:35.487210 2890 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.206.193
I20260808 14:50:35.497171 2890 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:41683
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/krb5kdc/oryx_127.26.206.193.keytab
--principal=oryx/127.26.206.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.206.193:36989
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.206.193
--webserver_port=39741
--tserver_master_addrs=127.26.206.254:40317,127.26.206.253:39527,127.26.206.252:46475
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.206.193
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:50:35.498446 2890 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:50:35.499842 2890 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:50:35.513609 2992 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:50:35.513631 2989 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:50:35.513656 2990 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:50:35.514828 2890 server_base.cc:1034] running on GCE node
I20260808 14:50:35.515367 2890 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:50:35.516294 2890 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:50:35.517519 2890 hybrid_clock.cc:648] HybridClock initialized: now 1786200635517480 us; error 63 us; skew 500 ppm
I20260808 14:50:35.517835 2890 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:50:35 dist-test-slave-6k22 krb5kdc[1949](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200635, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.206.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:50:35.521108 2890 init.cc:377] Logged in from keytab as oryx/127.26.206.193@KRBTEST.COM (short username oryx)
I20260808 14:50:35.522491 2890 webserver.cc:460] Webserver started at http://127.26.206.193:39741/ using document root <none> and password file <none>
I20260808 14:50:35.523130 2890 fs_manager.cc:359] Metadata directory not provided
I20260808 14:50:35.523249 2890 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:50:35.528529 2890 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 14:50:35.531121 3001 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:50:35.532490 2890 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260808 14:50:35.532622 2890 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/ts-0/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/ts-0/wal
uuid: "97ede4953e344ddaa50fe48bebd2c6e1"
format_stamp: "Formatted at 2026-08-08 14:50:32 on dist-test-slave-6k22"
server_key: "9c5029197aacce1754c09c15c42c283b"
server_key_iv: "93e473ece97577489c7e842384994e12"
server_key_version: "encryptionkey@0"
I20260808 14:50:35.533516 2890 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:50:35.561697 2890 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:50:35.565824 2890 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:50:35.566061 2890 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:50:35.566964 2890 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:50:35.568320 2890 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:50:35.568406 2890 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:50:35.568488 2890 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:50:35.568544 2890 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:50:35.604005 2890 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.193:36989
I20260808 14:50:35.604101 3123 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.193:36989 every 8 connection(s)
I20260808 14:50:35.605566 2890 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/ts-0/data/info.pb
I20260808 14:50:35.613947 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 2890
I20260808 14:50:35.614253 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 2224
Aug 08 14:50:35 dist-test-slave-6k22 krb5kdc[1949](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200635, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.206.193@KRBTEST.COM for oryx/127.26.206.252@KRBTEST.COM
Aug 08 14:50:35 dist-test-slave-6k22 krb5kdc[1949](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200635, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.206.193@KRBTEST.COM for oryx/127.26.206.253@KRBTEST.COM
Aug 08 14:50:35 dist-test-slave-6k22 krb5kdc[1949](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200635, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.206.193@KRBTEST.COM for oryx/127.26.206.254@KRBTEST.COM
Aug 08 14:50:35 dist-test-slave-6k22 krb5kdc[1949](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200631, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.26.206.194@KRBTEST.COM
I20260808 14:50:35.647243 2981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:35.608699 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.193:60987 (local address 127.26.206.252:46475)
0808 14:50:35.608910 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:35.608917 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:35.613297 (+ 4380us) server_negotiation.cc:407] Connection header received
0808 14:50:35.626045 (+ 12748us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:35.626055 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:35.626171 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:35.626271 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:35.628417 (+ 2146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:35.629409 (+ 992us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:35.631358 (+ 1949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:35.632059 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:35.632142 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:35.638743 (+ 6601us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:50:35.638751 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:50:35.638756 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:50:35.638804 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:50:35.642803 (+ 3999us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:35.644426 (+ 1623us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:35.644433 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:35.644439 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:35.644615 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:35.645117 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:35.645122 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:35.645125 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:35.645493 (+ 368us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:50:35.645636 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:35.646659 (+ 1023us) server_negotiation.cc:299] Negotiation successful
0808 14:50:35.646910 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260808 14:50:35.647334 3130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:35.609129 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.193:41947 (local address 127.26.206.253:39527)
0808 14:50:35.612220 (+ 3091us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:35.612229 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:35.617184 (+ 4955us) server_negotiation.cc:407] Connection header received
0808 14:50:35.617481 (+ 297us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:35.617490 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:35.617596 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:35.617716 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:35.621029 (+ 3313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:35.622696 (+ 1667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:35.631286 (+ 8590us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:35.632011 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:35.632142 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:35.638594 (+ 6452us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:50:35.638604 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:50:35.638612 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:50:35.638659 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:50:35.642922 (+ 4263us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:35.644320 (+ 1398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:35.644326 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:35.644329 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:35.644512 (+ 183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:35.645108 (+ 596us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:35.645113 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:35.645117 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:35.645473 (+ 356us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:50:35.645625 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:35.646649 (+ 1024us) server_negotiation.cc:299] Negotiation successful
0808 14:50:35.646910 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2873,"thread_start_us":2703,"threads_started":1}
I20260808 14:50:35.647656 3135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:35.611606 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.193:33349 (local address 127.26.206.254:40317)
0808 14:50:35.612647 (+ 1041us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:35.612656 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:35.628253 (+ 15597us) server_negotiation.cc:407] Connection header received
0808 14:50:35.628341 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:35.628346 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:35.628425 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:35.628549 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:35.629850 (+ 1301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:35.631077 (+ 1227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:35.633191 (+ 2114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:35.633842 (+ 651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:35.633952 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:35.639570 (+ 5618us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:50:35.639579 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:50:35.639585 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:50:35.639646 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:50:35.643236 (+ 3590us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:35.644338 (+ 1102us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:35.644343 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:35.644346 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:35.644512 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:35.645108 (+ 596us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:35.645113 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:35.645117 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:35.645739 (+ 622us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:50:35.645873 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:35.646946 (+ 1073us) server_negotiation.cc:299] Negotiation successful
0808 14:50:35.647203 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":889,"thread_start_us":669,"threads_started":1}
I20260808 14:50:35.648881 3138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:35.615294 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34498 (local address 127.26.206.194:34835)
0808 14:50:35.627502 (+ 12208us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:35.627513 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:35.628382 (+ 869us) server_negotiation.cc:407] Connection header received
0808 14:50:35.628541 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:35.628550 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:35.628800 (+ 250us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:35.628978 (+ 178us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:35.630854 (+ 1876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:35.632352 (+ 1498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:35.634282 (+ 1930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:35.635187 (+ 905us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:35.635331 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:35.641016 (+ 5685us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:50:35.641027 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:50:35.641040 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:50:35.641110 (+ 70us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:50:35.645212 (+ 4102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:35.646096 (+ 884us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:35.646105 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:35.646109 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:35.646263 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:35.646719 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:35.646723 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:35.646726 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:35.647164 (+ 438us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:50:35.648001 (+ 837us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:35.648192 (+ 191us) server_negotiation.cc:299] Negotiation successful
0808 14:50:35.648462 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11977,"thread_start_us":12226,"threads_started":1}
I20260808 14:50:35.649924 3131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:35.609067 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.253:39527 (local address 127.26.206.193:41947)
0808 14:50:35.617061 (+ 7994us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:35.617090 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0808 14:50:35.617312 (+ 222us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:50:35.618455 (+ 1143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:50:35.618475 (+ 20us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:50:35.619737 (+ 1262us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:50:35.620759 (+ 1022us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:35.620787 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:35.622977 (+ 2190us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:35.622985 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:35.625791 (+ 2806us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:35.625811 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:35.632503 (+ 6692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:35.632510 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:35.633092 (+ 582us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:35.634136 (+ 1044us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:50:35.634156 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:50:35.638292 (+ 4136us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:50:35.643099 (+ 4807us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:50:35.643109 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:50:35.643129 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:50:35.644186 (+ 1057us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:50:35.644666 (+ 480us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:50:35.644669 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:50:35.644673 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:50:35.644972 (+ 299us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:50:35.645720 (+ 748us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:50:35.645727 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:50:35.646192 (+ 465us) client_negotiation.cc:769] Sending connection context
0808 14:50:35.647605 (+ 1413us) client_negotiation.cc:240] Negotiation successful
0808 14:50:35.648533 (+ 928us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2435,"mutex_wait_us":809,"spinlock_wait_cycles":52736,"thread_start_us":754,"threads_started":1}
I20260808 14:50:35.650170 2366 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:50:35.650374 3133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:35.611419 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:40317 (local address 127.26.206.193:33349)
0808 14:50:35.628138 (+ 16719us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:35.628157 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 14:50:35.628248 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:50:35.628721 (+ 473us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:50:35.628724 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:50:35.629250 (+ 526us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:50:35.629630 (+ 380us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:35.629649 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:35.631262 (+ 1613us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:35.631268 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:35.633022 (+ 1754us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:35.633040 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:35.634353 (+ 1313us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:35.634360 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:35.634572 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:35.635204 (+ 632us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:50:35.635244 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:50:35.639282 (+ 4038us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:50:35.643426 (+ 4144us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:50:35.643430 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:50:35.643434 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:50:35.644172 (+ 738us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:50:35.644658 (+ 486us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:50:35.644663 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:50:35.644666 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:50:35.644972 (+ 306us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:50:35.645928 (+ 956us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:50:35.645932 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:50:35.646192 (+ 260us) client_negotiation.cc:769] Sending connection context
0808 14:50:35.646517 (+ 325us) client_negotiation.cc:240] Negotiation successful
0808 14:50:35.648417 (+ 1900us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16606,"mutex_wait_us":323,"spinlock_wait_cycles":7296,"thread_start_us":16253,"threads_started":1}
I20260808 14:50:35.649905 3132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:35.609067 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.252:46475 (local address 127.26.206.193:60987)
0808 14:50:35.613059 (+ 3992us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:35.613129 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0808 14:50:35.616533 (+ 3404us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:50:35.626538 (+ 10005us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:50:35.626545 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:50:35.627140 (+ 595us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:50:35.627530 (+ 390us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:35.627563 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:35.629569 (+ 2006us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:35.629573 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:35.631105 (+ 1532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:35.631122 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:35.632503 (+ 1381us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:35.632510 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:35.633087 (+ 577us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:35.634052 (+ 965us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:50:35.634097 (+ 45us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:50:35.638532 (+ 4435us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:50:35.643389 (+ 4857us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:50:35.643394 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:50:35.643398 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:50:35.644266 (+ 868us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:50:35.644772 (+ 506us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:50:35.644788 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:50:35.644791 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:50:35.644979 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:50:35.645721 (+ 742us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:50:35.645733 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:50:35.646230 (+ 497us) client_negotiation.cc:769] Sending connection context
0808 14:50:35.647454 (+ 1224us) client_negotiation.cc:240] Negotiation successful
0808 14:50:35.648877 (+ 1423us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2521,"mutex_wait_us":1739,"spinlock_wait_cycles":19712,"thread_start_us":1510,"threads_started":1}
I20260808 14:50:35.651641 3127 heartbeater.cc:347] Connected to a master server at 127.26.206.253:39527
I20260808 14:50:35.651991 3127 heartbeater.cc:464] Registering TS with master...
I20260808 14:50:35.652880 3127 heartbeater.cc:511] Master 127.26.206.253:39527 requested a full tablet report, sending...
I20260808 14:50:35.653699 3126 heartbeater.cc:347] Connected to a master server at 127.26.206.254:40317
I20260808 14:50:35.653822 3126 heartbeater.cc:464] Registering TS with master...
I20260808 14:50:35.654276 3126 heartbeater.cc:511] Master 127.26.206.254:40317 requested a full tablet report, sending...
I20260808 14:50:35.655735 2002 ts_manager.cc:194] Re-registered known tserver with Master: 97ede4953e344ddaa50fe48bebd2c6e1 (127.26.206.193:36989)
I20260808 14:50:35.656369 2700 ts_manager.cc:194] Registered new tserver with Master: 97ede4953e344ddaa50fe48bebd2c6e1 (127.26.206.193:36989)
I20260808 14:50:35.657011 2002 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.26.206.193@KRBTEST.COM'} at 127.26.206.193:33349
I20260808 14:50:35.657289 3125 heartbeater.cc:347] Connected to a master server at 127.26.206.252:46475
I20260808 14:50:35.657404 3125 heartbeater.cc:464] Registering TS with master...
I20260808 14:50:35.657879 3125 heartbeater.cc:511] Master 127.26.206.252:46475 requested a full tablet report, sending...
I20260808 14:50:35.660406 2921 ts_manager.cc:194] Registered new tserver with Master: 97ede4953e344ddaa50fe48bebd2c6e1 (127.26.206.193:36989)
I20260808 14:50:35.736596 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 2224
I20260808 14:50:35.755918 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.206.194:34835
--local_ip_for_outbound_sockets=127.26.206.194
--tserver_master_addrs=127.26.206.254:40317
--webserver_port=45799
--webserver_interface=127.26.206.194
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/krb5kdc/oryx_127.26.206.194.keytab
--principal=oryx/127.26.206.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.206.212:41683
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.26.206.254:40317,127.26.206.253:39527
--tserver_master_addrs=127.26.206.254:40317,127.26.206.253:39527,127.26.206.252:46475 with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:50:36.092279 3140 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:50:36.092538 3140 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:50:36.092633 3140 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:50:36.100004 3140 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:50:36.100104 3140 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:50:36.100220 3140 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.206.194
I20260808 14:50:36.110206 3140 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:41683
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/krb5kdc/oryx_127.26.206.194.keytab
--principal=oryx/127.26.206.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.206.194:34835
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.206.194
--webserver_port=45799
--tserver_master_addrs=127.26.206.254:40317,127.26.206.253:39527,127.26.206.252:46475
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.206.194
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:50:36.111524 3140 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:50:36.112953 3140 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:50:36.125550 3147 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:50:36.125594 3148 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:50:36.125631 3151 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:50:36.126680 3140 server_base.cc:1034] running on GCE node
I20260808 14:50:36.127242 3140 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:50:36.128178 3140 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:50:36.129360 3140 hybrid_clock.cc:648] HybridClock initialized: now 1786200636129304 us; error 49 us; skew 500 ppm
I20260808 14:50:36.129604 3140 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:50:36 dist-test-slave-6k22 krb5kdc[1949](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200636, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.206.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:50:36.132731 3140 init.cc:377] Logged in from keytab as oryx/127.26.206.194@KRBTEST.COM (short username oryx)
I20260808 14:50:36.134017 3140 webserver.cc:460] Webserver started at http://127.26.206.194:45799/ using document root <none> and password file <none>
I20260808 14:50:36.134614 3140 fs_manager.cc:359] Metadata directory not provided
I20260808 14:50:36.134734 3140 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:50:36.139961 3140 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.001s sys 0.002s
I20260808 14:50:36.142539 3159 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:50:36.143884 3140 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 14:50:36.144047 3140 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/ts-1/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/ts-1/wal
uuid: "3883b0f2f9f7452aa7784ad7f79ed570"
format_stamp: "Formatted at 2026-08-08 14:50:32 on dist-test-slave-6k22"
server_key: "ed9b9c43128357e6fc99da42e5e5b370"
server_key_iv: "47bcc149203f3f45938adb9818b54614"
server_key_version: "encryptionkey@0"
I20260808 14:50:36.145026 3140 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:50:36.157186 3140 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:50:36.160995 3140 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:50:36.161252 3140 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:50:36.162227 3140 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:50:36.163499 3140 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:50:36.163688 3140 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:50:36.163823 3140 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:50:36.163903 3140 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:50:36.200891 3140 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.194:34835
I20260808 14:50:36.200984 3286 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.194:34835 every 8 connection(s)
I20260808 14:50:36.202418 3140 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/ts-1/data/info.pb
I20260808 14:50:36.210567 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 3140
I20260808 14:50:36.210903 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 2377
Aug 08 14:50:36 dist-test-slave-6k22 krb5kdc[1949](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200636, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.206.194@KRBTEST.COM for oryx/127.26.206.253@KRBTEST.COM
Aug 08 14:50:36 dist-test-slave-6k22 krb5kdc[1949](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200636, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.206.194@KRBTEST.COM for oryx/127.26.206.252@KRBTEST.COM
I20260808 14:50:36.240471 3296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:36.205933 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.253:39527 (local address 127.26.206.194:41311)
0808 14:50:36.213522 (+ 7589us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:36.213589 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0808 14:50:36.216690 (+ 3101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:50:36.218265 (+ 1575us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:50:36.218279 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:50:36.219274 (+ 995us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:50:36.220231 (+ 957us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:36.220259 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:36.222121 (+ 1862us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:36.222129 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:36.224668 (+ 2539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:36.224688 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:36.226107 (+ 1419us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:36.226115 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:36.226429 (+ 314us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:36.227250 (+ 821us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:50:36.227296 (+ 46us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:50:36.230666 (+ 3370us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:50:36.235200 (+ 4534us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:50:36.235208 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:50:36.235222 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:50:36.235825 (+ 603us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:50:36.236396 (+ 571us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:50:36.236404 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:50:36.236409 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:50:36.236672 (+ 263us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:50:36.237575 (+ 903us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:50:36.237585 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:50:36.238059 (+ 474us) client_negotiation.cc:769] Sending connection context
0808 14:50:36.238367 (+ 308us) client_negotiation.cc:240] Negotiation successful
0808 14:50:36.238989 (+ 622us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7228,"threads_started":1}
I20260808 14:50:36.241770 3293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:36.205643 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.194:41311 (local address 127.26.206.253:39527)
0808 14:50:36.217438 (+ 11795us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:36.217447 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:36.217470 (+ 23us) server_negotiation.cc:407] Connection header received
0808 14:50:36.217542 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:36.217550 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:36.217647 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:36.217781 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:36.220492 (+ 2711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:36.221909 (+ 1417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:36.224889 (+ 2980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:36.225634 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:36.225774 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:36.230939 (+ 5165us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:50:36.230945 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:50:36.230949 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:50:36.230991 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:50:36.235023 (+ 4032us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:36.236074 (+ 1051us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:36.236083 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:36.236090 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:36.236250 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:36.236831 (+ 581us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:36.236838 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:36.236844 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:36.237338 (+ 494us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:50:36.237494 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:36.241215 (+ 3721us) server_negotiation.cc:299] Negotiation successful
0808 14:50:36.241436 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11644,"thread_start_us":11532,"threads_started":1}
I20260808 14:50:36.242014 3300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:36.205932 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.252:46475 (local address 127.26.206.194:49975)
0808 14:50:36.219080 (+ 13148us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:36.219104 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0808 14:50:36.219259 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:50:36.220006 (+ 747us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:50:36.220013 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:50:36.220811 (+ 798us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:50:36.221187 (+ 376us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:36.221203 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:36.223140 (+ 1937us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:36.223148 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:36.225302 (+ 2154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:36.225322 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:36.226906 (+ 1584us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:36.226915 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:36.227162 (+ 247us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:36.227902 (+ 740us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:50:36.227933 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:50:36.231164 (+ 3231us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:50:36.236260 (+ 5096us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:50:36.236268 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:50:36.236287 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:50:36.236933 (+ 646us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:50:36.237457 (+ 524us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:50:36.237464 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:50:36.237471 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:50:36.237674 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:50:36.238524 (+ 850us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:50:36.238532 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:50:36.238731 (+ 199us) client_negotiation.cc:769] Sending connection context
0808 14:50:36.238956 (+ 225us) client_negotiation.cc:240] Negotiation successful
0808 14:50:36.239321 (+ 365us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12961,"mutex_wait_us":106,"spinlock_wait_cycles":86400,"thread_start_us":6984,"threads_started":1}
I20260808 14:50:36.242511 3292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:36.205243 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.194:49975 (local address 127.26.206.252:46475)
0808 14:50:36.213122 (+ 7879us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:36.213131 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:36.219403 (+ 6272us) server_negotiation.cc:407] Connection header received
0808 14:50:36.219485 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:36.219493 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:36.219621 (+ 128us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:36.219742 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:36.221427 (+ 1685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:36.222926 (+ 1499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:36.225519 (+ 2593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:36.226424 (+ 905us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:36.226571 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:36.231462 (+ 4891us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:50:36.231472 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:50:36.231479 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:50:36.231534 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:50:36.236069 (+ 4535us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:36.237101 (+ 1032us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:36.237109 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:36.237115 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:36.237301 (+ 186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:36.237822 (+ 521us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:36.237829 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:36.237835 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:36.238249 (+ 414us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:50:36.238445 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:36.240922 (+ 2477us) server_negotiation.cc:299] Negotiation successful
0808 14:50:36.241232 (+ 310us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7703,"thread_start_us":7556,"threads_started":1}
I20260808 14:50:36.243872 3288 heartbeater.cc:347] Connected to a master server at 127.26.206.252:46475
I20260808 14:50:36.244259 3288 heartbeater.cc:464] Registering TS with master...
I20260808 14:50:36.245309 3288 heartbeater.cc:511] Master 127.26.206.252:46475 requested a full tablet report, sending...
I20260808 14:50:36.247503 2921 ts_manager.cc:194] Registered new tserver with Master: 3883b0f2f9f7452aa7784ad7f79ed570 (127.26.206.194:34835)
I20260808 14:50:36.256019 3290 heartbeater.cc:347] Connected to a master server at 127.26.206.253:39527
I20260808 14:50:36.256171 3290 heartbeater.cc:464] Registering TS with master...
I20260808 14:50:36.256664 3290 heartbeater.cc:511] Master 127.26.206.253:39527 requested a full tablet report, sending...
I20260808 14:50:36.257895 2700 ts_manager.cc:194] Registered new tserver with Master: 3883b0f2f9f7452aa7784ad7f79ed570 (127.26.206.194:34835)
Aug 08 14:50:36 dist-test-slave-6k22 krb5kdc[1949](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200636, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.206.194@KRBTEST.COM for oryx/127.26.206.254@KRBTEST.COM
Aug 08 14:50:36 dist-test-slave-6k22 krb5kdc[1949](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200631, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.26.206.195@KRBTEST.COM
I20260808 14:50:36.268167 3296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:36.218470 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:40317 (local address 127.26.206.194:57133)
0808 14:50:36.240827 (+ 22357us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:36.240850 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 14:50:36.240962 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:50:36.255352 (+ 14390us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:50:36.255359 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:50:36.255884 (+ 525us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:50:36.256102 (+ 218us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:36.256113 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:36.257567 (+ 1454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:36.257573 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:36.258750 (+ 1177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:36.258761 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:36.259466 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:36.259481 (+ 15us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:36.259664 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:36.260261 (+ 597us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:50:36.260283 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:50:36.262651 (+ 2368us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:50:36.265869 (+ 3218us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:50:36.265875 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:50:36.265879 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:50:36.266214 (+ 335us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:50:36.266597 (+ 383us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:50:36.266602 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:50:36.266606 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:50:36.266732 (+ 126us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:50:36.267220 (+ 488us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:50:36.267224 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:50:36.267377 (+ 153us) client_negotiation.cc:769] Sending connection context
0808 14:50:36.267514 (+ 137us) client_negotiation.cc:240] Negotiation successful
0808 14:50:36.267819 (+ 305us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":22215,"thread_start_us":316,"threads_started":1}
I20260808 14:50:36.268213 3299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:36.214507 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.194:57133 (local address 127.26.206.254:40317)
0808 14:50:36.255003 (+ 40496us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:36.255009 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:36.255031 (+ 22us) server_negotiation.cc:407] Connection header received
0808 14:50:36.255099 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:36.255107 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:36.255205 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:36.255318 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:36.256297 (+ 979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:36.257393 (+ 1096us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:36.258885 (+ 1492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:36.259326 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:36.259459 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:36.262838 (+ 3379us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:50:36.262844 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:50:36.262850 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:50:36.262885 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:50:36.265694 (+ 2809us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:36.266350 (+ 656us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:36.266355 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:36.266358 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:36.266494 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:36.266849 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:36.266853 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:36.266856 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:36.267092 (+ 236us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:50:36.267256 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:36.267660 (+ 404us) server_negotiation.cc:299] Negotiation successful
0808 14:50:36.267871 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40369,"thread_start_us":40232,"threads_started":1}
I20260808 14:50:36.269004 3289 heartbeater.cc:347] Connected to a master server at 127.26.206.254:40317
I20260808 14:50:36.269164 3289 heartbeater.cc:464] Registering TS with master...
I20260808 14:50:36.269558 3289 heartbeater.cc:511] Master 127.26.206.254:40317 requested a full tablet report, sending...
I20260808 14:50:36.270526 2002 ts_manager.cc:194] Re-registered known tserver with Master: 3883b0f2f9f7452aa7784ad7f79ed570 (127.26.206.194:34835)
I20260808 14:50:36.271381 2002 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.26.206.194@KRBTEST.COM'} at 127.26.206.194:57133
I20260808 14:50:36.272624 3298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:36.212638 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35446 (local address 127.26.206.195:43699)
0808 14:50:36.253786 (+ 41148us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:36.253799 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:36.255238 (+ 1439us) server_negotiation.cc:407] Connection header received
0808 14:50:36.255430 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:36.255443 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:36.255915 (+ 472us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:36.256086 (+ 171us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:36.258238 (+ 2152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:36.259257 (+ 1019us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:36.260642 (+ 1385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:36.261303 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:36.261453 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:36.266277 (+ 4824us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:50:36.266287 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:50:36.266297 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:50:36.266326 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:50:36.269630 (+ 3304us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:36.270458 (+ 828us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:36.270465 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:36.270467 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:36.270624 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:36.271020 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:36.271025 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:36.271028 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:36.271344 (+ 316us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:50:36.271677 (+ 333us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:36.272017 (+ 340us) server_negotiation.cc:299] Negotiation successful
0808 14:50:36.272210 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40912,"thread_start_us":41170,"threads_started":1}
I20260808 14:50:36.273772 2523 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:50:36.358873 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 2377
I20260808 14:50:36.380038 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.206.195:43699
--local_ip_for_outbound_sockets=127.26.206.195
--tserver_master_addrs=127.26.206.254:40317
--webserver_port=41495
--webserver_interface=127.26.206.195
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/krb5kdc/oryx_127.26.206.195.keytab
--principal=oryx/127.26.206.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.206.212:41683
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.26.206.254:40317,127.26.206.253:39527
--tserver_master_addrs=127.26.206.254:40317,127.26.206.253:39527,127.26.206.252:46475 with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 14:50:36.659584 3126 heartbeater.cc:503] Master 127.26.206.254:40317 was elected leader, sending a full tablet report...
W20260808 14:50:36.718461 3302 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:50:36.718724 3302 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:50:36.718818 3302 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:50:36.725826 3302 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:50:36.725929 3302 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:50:36.726056 3302 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.206.195
I20260808 14:50:36.735301 3302 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:41683
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/krb5kdc/oryx_127.26.206.195.keytab
--principal=oryx/127.26.206.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.206.195:43699
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.206.195
--webserver_port=41495
--tserver_master_addrs=127.26.206.254:40317,127.26.206.253:39527,127.26.206.252:46475
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.206.195
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:50:36.736482 3302 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:50:36.737648 3302 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:50:36.751050 3313 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:50:36.751070 3310 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:50:36.751268 3311 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:50:36.752188 3302 server_base.cc:1034] running on GCE node
I20260808 14:50:36.752852 3302 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:50:36.753772 3302 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:50:36.754969 3302 hybrid_clock.cc:648] HybridClock initialized: now 1786200636754936 us; error 26 us; skew 500 ppm
I20260808 14:50:36.755232 3302 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:50:36 dist-test-slave-6k22 krb5kdc[1949](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200636, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.206.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:50:36.758488 3302 init.cc:377] Logged in from keytab as oryx/127.26.206.195@KRBTEST.COM (short username oryx)
I20260808 14:50:36.760011 3302 webserver.cc:460] Webserver started at http://127.26.206.195:41495/ using document root <none> and password file <none>
I20260808 14:50:36.760648 3302 fs_manager.cc:359] Metadata directory not provided
I20260808 14:50:36.760813 3302 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:50:36.766018 3302 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20260808 14:50:36.768659 3320 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:50:36.770174 3302 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 14:50:36.770362 3302 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/ts-2/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/ts-2/wal
uuid: "5baab2df33494b8cb20296450685fed3"
format_stamp: "Formatted at 2026-08-08 14:50:33 on dist-test-slave-6k22"
server_key: "c110284a599b60a61730637c1b01035f"
server_key_iv: "2b10de888752b21cabc808e9b310b73e"
server_key_version: "encryptionkey@0"
I20260808 14:50:36.771333 3302 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:50:36.788410 3302 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:50:36.792178 3302 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:50:36.792452 3302 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:50:36.793383 3302 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:50:36.794672 3302 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:50:36.794781 3302 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:50:36.794912 3302 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:50:36.795006 3302 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:50:36.828464 3302 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.195:43699
I20260808 14:50:36.828514 3447 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.195:43699 every 8 connection(s)
I20260808 14:50:36.829913 3302 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/ts-2/data/info.pb
I20260808 14:50:36.834616 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 3302
Aug 08 14:50:36 dist-test-slave-6k22 krb5kdc[1949](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200636, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.206.195@KRBTEST.COM for oryx/127.26.206.253@KRBTEST.COM
Aug 08 14:50:36 dist-test-slave-6k22 krb5kdc[1949](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200636, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.206.195@KRBTEST.COM for oryx/127.26.206.254@KRBTEST.COM
I20260808 14:50:36.867981 3452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:36.832827 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.195:44305 (local address 127.26.206.253:39527)
0808 14:50:36.833277 (+ 450us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:36.833281 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:36.835610 (+ 2329us) server_negotiation.cc:407] Connection header received
0808 14:50:36.837970 (+ 2360us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:36.837981 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:36.838098 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:36.838197 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:36.841143 (+ 2946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:36.842636 (+ 1493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:36.845924 (+ 3288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:36.846833 (+ 909us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:36.846953 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:36.852372 (+ 5419us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:50:36.852382 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:50:36.852389 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:50:36.852463 (+ 74us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:50:36.856099 (+ 3636us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:36.865125 (+ 9026us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:36.865130 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:36.865133 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:36.865329 (+ 196us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:36.865837 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:36.865844 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:36.865848 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:36.866177 (+ 329us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:50:36.866338 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:36.867311 (+ 973us) server_negotiation.cc:299] Negotiation successful
0808 14:50:36.867559 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":352,"thread_start_us":246,"threads_started":1}
I20260808 14:50:36.870242 3455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:36.833520 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.253:39527 (local address 127.26.206.195:44305)
0808 14:50:36.834482 (+ 962us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:36.834528 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0808 14:50:36.837552 (+ 3024us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:50:36.838878 (+ 1326us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:50:36.838894 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:50:36.839875 (+ 981us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:50:36.840881 (+ 1006us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:36.840913 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:36.842928 (+ 2015us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:36.842936 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:36.845707 (+ 2771us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:36.845728 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:36.847370 (+ 1642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:36.847379 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:36.847932 (+ 553us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:36.848807 (+ 875us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:50:36.848834 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:50:36.852066 (+ 3232us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:50:36.864266 (+ 12200us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:50:36.864275 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:50:36.864292 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:50:36.864994 (+ 702us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:50:36.865461 (+ 467us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:50:36.865466 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:50:36.865469 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:50:36.865700 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:50:36.866446 (+ 746us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:50:36.866454 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:50:36.866881 (+ 427us) client_negotiation.cc:769] Sending connection context
0808 14:50:36.868545 (+ 1664us) client_negotiation.cc:240] Negotiation successful
0808 14:50:36.869175 (+ 630us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":629,"thread_start_us":814,"threads_started":1}
I20260808 14:50:36.870613 3456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:36.834201 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:40317 (local address 127.26.206.195:48065)
0808 14:50:36.843953 (+ 9752us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:36.843986 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0808 14:50:36.844117 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:50:36.849889 (+ 5772us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:50:36.849895 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:50:36.850707 (+ 812us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:50:36.851117 (+ 410us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:36.851137 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:36.853283 (+ 2146us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:36.853292 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:36.855423 (+ 2131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:36.855443 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:36.856901 (+ 1458us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:36.856910 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:36.857164 (+ 254us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:36.857917 (+ 753us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:50:36.857946 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:50:36.861533 (+ 3587us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:50:36.867390 (+ 5857us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:50:36.867398 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:50:36.867404 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:50:36.868155 (+ 751us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:50:36.868708 (+ 553us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:50:36.868716 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:50:36.868722 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:50:36.868883 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:50:36.869596 (+ 713us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:50:36.869600 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:50:36.869769 (+ 169us) client_negotiation.cc:769] Sending connection context
0808 14:50:36.869917 (+ 148us) client_negotiation.cc:240] Negotiation successful
0808 14:50:36.870177 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9627,"thread_start_us":9422,"threads_started":1}
I20260808 14:50:36.871714 3453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:36.832859 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.195:48065 (local address 127.26.206.254:40317)
0808 14:50:36.849364 (+ 16505us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:36.849372 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:36.849400 (+ 28us) server_negotiation.cc:407] Connection header received
0808 14:50:36.849477 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:36.849485 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:36.849585 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:36.849848 (+ 263us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:36.851382 (+ 1534us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:36.853012 (+ 1630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:36.855712 (+ 2700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:36.856656 (+ 944us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:36.857573 (+ 917us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:36.861836 (+ 4263us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:50:36.861851 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:50:36.861858 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:50:36.861911 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:50:36.867186 (+ 5275us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:36.868357 (+ 1171us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:36.868365 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:36.868371 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:36.868540 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:36.869058 (+ 518us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:36.869066 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:36.869072 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:36.869441 (+ 369us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:50:36.870939 (+ 1498us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:36.871087 (+ 148us) server_negotiation.cc:299] Negotiation successful
0808 14:50:36.871325 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16355,"thread_start_us":16191,"threads_started":1}
I20260808 14:50:36.872009 3450 heartbeater.cc:347] Connected to a master server at 127.26.206.253:39527
I20260808 14:50:36.872337 3450 heartbeater.cc:464] Registering TS with master...
I20260808 14:50:36.873199 3450 heartbeater.cc:511] Master 127.26.206.253:39527 requested a full tablet report, sending...
I20260808 14:50:36.874223 3449 heartbeater.cc:347] Connected to a master server at 127.26.206.254:40317
I20260808 14:50:36.874339 3449 heartbeater.cc:464] Registering TS with master...
I20260808 14:50:36.874730 3449 heartbeater.cc:511] Master 127.26.206.254:40317 requested a full tablet report, sending...
I20260808 14:50:36.875774 2002 ts_manager.cc:194] Re-registered known tserver with Master: 5baab2df33494b8cb20296450685fed3 (127.26.206.195:43699)
I20260808 14:50:36.875553 2700 ts_manager.cc:194] Registered new tserver with Master: 5baab2df33494b8cb20296450685fed3 (127.26.206.195:43699)
I20260808 14:50:36.876899 2002 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.26.206.195@KRBTEST.COM'} at 127.26.206.195:48065
Aug 08 14:50:36 dist-test-slave-6k22 krb5kdc[1949](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200636, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.206.195@KRBTEST.COM for oryx/127.26.206.252@KRBTEST.COM
I20260808 14:50:36.890679 3458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:36.844309 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.195:53987 (local address 127.26.206.252:46475)
0808 14:50:36.872597 (+ 28288us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:36.872606 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:36.872630 (+ 24us) server_negotiation.cc:407] Connection header received
0808 14:50:36.872706 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:36.872714 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:36.872813 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:36.872968 (+ 155us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:36.874271 (+ 1303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:36.875558 (+ 1287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:36.877409 (+ 1851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:36.877888 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:36.878138 (+ 250us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:36.883527 (+ 5389us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:50:36.883535 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:50:36.883542 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:50:36.883607 (+ 65us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:50:36.887228 (+ 3621us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:36.888129 (+ 901us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:36.888135 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:36.888138 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:36.888293 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:36.888796 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:36.888801 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:36.888804 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:36.889177 (+ 373us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:50:36.889317 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:36.889955 (+ 638us) server_negotiation.cc:299] Negotiation successful
0808 14:50:36.890215 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28132,"thread_start_us":27981,"threads_started":1}
I20260808 14:50:36.891645 3460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:36.851176 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.252:46475 (local address 127.26.206.195:53987)
0808 14:50:36.864154 (+ 12978us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:36.864176 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 14:50:36.864297 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:50:36.873025 (+ 8728us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:50:36.873029 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:50:36.873733 (+ 704us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:50:36.874063 (+ 330us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:36.874077 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:36.875783 (+ 1706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:36.875789 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:36.877204 (+ 1415us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:36.877220 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:36.879647 (+ 2427us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:36.879658 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:36.879867 (+ 209us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:36.880478 (+ 611us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:50:36.880502 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:50:36.883316 (+ 2814us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:50:36.887391 (+ 4075us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:50:36.887397 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:50:36.887401 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:50:36.887977 (+ 576us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:50:36.888457 (+ 480us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:50:36.888461 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:50:36.888465 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:50:36.888643 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:50:36.889417 (+ 774us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:50:36.889425 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:50:36.889625 (+ 200us) client_negotiation.cc:769] Sending connection context
0808 14:50:36.890879 (+ 1254us) client_negotiation.cc:240] Negotiation successful
0808 14:50:36.891204 (+ 325us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12863,"thread_start_us":13229,"threads_started":1}
I20260808 14:50:36.892623 3448 heartbeater.cc:347] Connected to a master server at 127.26.206.252:46475
I20260808 14:50:36.892771 3448 heartbeater.cc:464] Registering TS with master...
I20260808 14:50:36.893193 3448 heartbeater.cc:511] Master 127.26.206.252:46475 requested a full tablet report, sending...
I20260808 14:50:36.894405 2921 ts_manager.cc:194] Registered new tserver with Master: 5baab2df33494b8cb20296450685fed3 (127.26.206.195:43699)
I20260808 14:50:36.898738 3452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:36.871484 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54002 (local address 127.26.206.253:39527)
0808 14:50:36.872249 (+ 765us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:36.872255 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:36.879076 (+ 6821us) server_negotiation.cc:407] Connection header received
0808 14:50:36.879250 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:36.879254 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:36.879365 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:36.879468 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:36.882434 (+ 2966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:36.883490 (+ 1056us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:36.886210 (+ 2720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:36.886872 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:36.886973 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:36.891352 (+ 4379us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:50:36.891358 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:50:36.891364 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:50:36.891402 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:50:36.895348 (+ 3946us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:36.896225 (+ 877us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:36.896232 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:36.896236 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:36.896399 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:36.896887 (+ 488us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:36.896893 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:36.896898 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:36.897287 (+ 389us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:50:36.897533 (+ 246us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:36.898138 (+ 605us) server_negotiation.cc:299] Negotiation successful
0808 14:50:36.898376 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":604}
I20260808 14:50:36.899258 3453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:36.878151 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43496 (local address 127.26.206.254:40317)
0808 14:50:36.878365 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:36.878372 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:36.881190 (+ 2818us) server_negotiation.cc:407] Connection header received
0808 14:50:36.881513 (+ 323us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:36.881521 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:36.881611 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:36.881693 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:36.884799 (+ 3106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:36.885920 (+ 1121us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:36.887950 (+ 2030us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:36.888580 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:36.888677 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:36.892517 (+ 3840us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:50:36.892535 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:50:36.892541 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:50:36.892581 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:50:36.895860 (+ 3279us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:36.896569 (+ 709us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:36.896577 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:36.896580 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:36.896709 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:36.897180 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:36.897185 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:36.897188 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:36.897455 (+ 267us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:50:36.897888 (+ 433us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:36.898593 (+ 705us) server_negotiation.cc:299] Negotiation successful
0808 14:50:36.898807 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260808 14:50:36.901700 3466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:36.879655 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56740 (local address 127.26.206.252:46475)
0808 14:50:36.880242 (+ 587us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:36.880247 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:36.883257 (+ 3010us) server_negotiation.cc:407] Connection header received
0808 14:50:36.883697 (+ 440us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:36.883704 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:36.883797 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:36.883889 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:36.886486 (+ 2597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:36.887736 (+ 1250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:36.889669 (+ 1933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:36.890435 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:36.890544 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:36.895094 (+ 4550us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:50:36.895101 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:50:36.895106 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:50:36.895142 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:50:36.898665 (+ 3523us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:36.899593 (+ 928us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:36.899599 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:36.899602 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:36.899767 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:36.900216 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:36.900222 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:36.900226 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:36.900588 (+ 362us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:50:36.900833 (+ 245us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:36.901150 (+ 317us) server_negotiation.cc:299] Negotiation successful
0808 14:50:36.901364 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":445,"thread_start_us":315,"threads_started":1}
I20260808 14:50:36.904284 2002 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43496:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:50:36.911723 2002 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:50:36.947988 3484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:36.932981 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.193:36989 (local address 127.0.0.1:58920)
0808 14:50:36.940013 (+ 7032us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:36.940029 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 14:50:36.940174 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:50:36.940928 (+ 754us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:50:36.940936 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:50:36.940974 (+ 38us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:50:36.941483 (+ 509us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:36.941499 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:36.943291 (+ 1792us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:36.943298 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:36.945544 (+ 2246us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:36.945560 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:36.947164 (+ 1604us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:36.947182 (+ 18us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:36.947318 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:36.947341 (+ 23us) client_negotiation.cc:769] Sending connection context
0808 14:50:36.947404 (+ 63us) client_negotiation.cc:240] Negotiation successful
0808 14:50:36.947533 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6910,"mutex_wait_us":16,"thread_start_us":6797,"threads_started":1}
I20260808 14:50:36.948196 3483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:36.932736 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.194:34835 (local address 127.0.0.1:34500)
0808 14:50:36.933351 (+ 615us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:36.933382 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0808 14:50:36.933683 (+ 301us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:50:36.941275 (+ 7592us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:50:36.941280 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:50:36.941306 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:50:36.941791 (+ 485us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:36.941805 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:36.943199 (+ 1394us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:36.943207 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:36.945288 (+ 2081us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:36.945301 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:36.947227 (+ 1926us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:36.947233 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:36.947401 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:36.947443 (+ 42us) client_negotiation.cc:769] Sending connection context
0808 14:50:36.947529 (+ 86us) client_negotiation.cc:240] Negotiation successful
0808 14:50:36.947736 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":481,"mutex_wait_us":47,"thread_start_us":1181,"threads_started":1}
I20260808 14:50:36.949035 3486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:36.933572 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58920 (local address 127.26.206.193:36989)
0808 14:50:36.934263 (+ 691us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:36.934275 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:36.940136 (+ 5861us) server_negotiation.cc:407] Connection header received
0808 14:50:36.940371 (+ 235us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:36.940383 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:36.940668 (+ 285us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:36.940920 (+ 252us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:50:36.941798 (+ 878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:36.943156 (+ 1358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:36.945711 (+ 2555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:36.946726 (+ 1015us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:36.946897 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:36.948479 (+ 1582us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:36.948560 (+ 81us) server_negotiation.cc:299] Negotiation successful
0808 14:50:36.948723 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":477,"thread_start_us":1029,"threads_started":1}
I20260808 14:50:36.949095 3485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:36.933322 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34500 (local address 127.26.206.194:34835)
0808 14:50:36.940670 (+ 7348us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:36.940678 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:36.940707 (+ 29us) server_negotiation.cc:407] Connection header received
0808 14:50:36.940816 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:36.940827 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:36.941078 (+ 251us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:36.941297 (+ 219us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:50:36.941962 (+ 665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:36.943061 (+ 1099us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:36.945425 (+ 2364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:36.946785 (+ 1360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:36.946930 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:36.947087 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:36.948610 (+ 1523us) server_negotiation.cc:299] Negotiation successful
0808 14:50:36.948808 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7180,"thread_start_us":7086,"threads_started":1}
I20260808 14:50:36.952708 3481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:36.931828 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.195:43699 (local address 127.0.0.1:35458)
0808 14:50:36.932605 (+ 777us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:36.932625 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 14:50:36.932920 (+ 295us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:50:36.944129 (+ 11209us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:50:36.944136 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:50:36.944168 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:50:36.944665 (+ 497us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:36.944686 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:36.947842 (+ 3156us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:36.947847 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:36.950136 (+ 2289us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:36.950156 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:36.951916 (+ 1760us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:36.951923 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:36.952096 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:36.952127 (+ 31us) client_negotiation.cc:769] Sending connection context
0808 14:50:36.952234 (+ 107us) client_negotiation.cc:240] Negotiation successful
0808 14:50:36.952361 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":640,"thread_start_us":447,"threads_started":1}
I20260808 14:50:36.952785 3482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:36.932226 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35458 (local address 127.26.206.195:43699)
0808 14:50:36.943521 (+ 11295us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:36.943529 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:36.943587 (+ 58us) server_negotiation.cc:407] Connection header received
0808 14:50:36.943689 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:36.943697 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:36.943918 (+ 221us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:36.944114 (+ 196us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:50:36.945647 (+ 1533us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:36.947669 (+ 2022us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:36.950311 (+ 2642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:36.951710 (+ 1399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:36.951869 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:36.952025 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:36.952293 (+ 268us) server_negotiation.cc:299] Negotiation successful
0808 14:50:36.952437 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11125,"thread_start_us":9958,"threads_started":1}
I20260808 14:50:36.953210 3212 tablet_service.cc:1467] Processing CreateTablet for tablet 4dcf0acffdb04c7eab4180374a31e16e (DEFAULT_TABLE table=test-table [id=6e4e0d54b10d495ba669bd2ce6071d1d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:50:36.953135 3052 tablet_service.cc:1467] Processing CreateTablet for tablet 4dcf0acffdb04c7eab4180374a31e16e (DEFAULT_TABLE table=test-table [id=6e4e0d54b10d495ba669bd2ce6071d1d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:50:36.954468 3052 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4dcf0acffdb04c7eab4180374a31e16e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:50:36.954566 3212 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4dcf0acffdb04c7eab4180374a31e16e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:50:36.956172 3375 tablet_service.cc:1467] Processing CreateTablet for tablet 4dcf0acffdb04c7eab4180374a31e16e (DEFAULT_TABLE table=test-table [id=6e4e0d54b10d495ba669bd2ce6071d1d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:50:36.957382 3375 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4dcf0acffdb04c7eab4180374a31e16e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:50:36.966151 3487 tablet_bootstrap.cc:492] T 4dcf0acffdb04c7eab4180374a31e16e P 97ede4953e344ddaa50fe48bebd2c6e1: Bootstrap starting.
I20260808 14:50:36.969491 3487 tablet_bootstrap.cc:654] T 4dcf0acffdb04c7eab4180374a31e16e P 97ede4953e344ddaa50fe48bebd2c6e1: Neither blocks nor log segments found. Creating new log.
I20260808 14:50:36.970762 3488 tablet_bootstrap.cc:492] T 4dcf0acffdb04c7eab4180374a31e16e P 3883b0f2f9f7452aa7784ad7f79ed570: Bootstrap starting.
I20260808 14:50:36.970835 3487 log.cc:824] T 4dcf0acffdb04c7eab4180374a31e16e P 97ede4953e344ddaa50fe48bebd2c6e1: Log is configured to *not* fsync() on all Append() calls
I20260808 14:50:36.972328 3490 tablet_bootstrap.cc:492] T 4dcf0acffdb04c7eab4180374a31e16e P 5baab2df33494b8cb20296450685fed3: Bootstrap starting.
I20260808 14:50:36.974978 3488 tablet_bootstrap.cc:654] T 4dcf0acffdb04c7eab4180374a31e16e P 3883b0f2f9f7452aa7784ad7f79ed570: Neither blocks nor log segments found. Creating new log.
I20260808 14:50:36.975912 3487 tablet_bootstrap.cc:492] T 4dcf0acffdb04c7eab4180374a31e16e P 97ede4953e344ddaa50fe48bebd2c6e1: No bootstrap required, opened a new log
I20260808 14:50:36.976198 3487 ts_tablet_manager.cc:1397] T 4dcf0acffdb04c7eab4180374a31e16e P 97ede4953e344ddaa50fe48bebd2c6e1: Time spent bootstrapping tablet: real 0.010s user 0.009s sys 0.000s
I20260808 14:50:36.976485 3490 tablet_bootstrap.cc:654] T 4dcf0acffdb04c7eab4180374a31e16e P 5baab2df33494b8cb20296450685fed3: Neither blocks nor log segments found. Creating new log.
I20260808 14:50:36.976563 3488 log.cc:824] T 4dcf0acffdb04c7eab4180374a31e16e P 3883b0f2f9f7452aa7784ad7f79ed570: Log is configured to *not* fsync() on all Append() calls
I20260808 14:50:36.977602 3490 log.cc:824] T 4dcf0acffdb04c7eab4180374a31e16e P 5baab2df33494b8cb20296450685fed3: Log is configured to *not* fsync() on all Append() calls
I20260808 14:50:36.979666 3488 tablet_bootstrap.cc:492] T 4dcf0acffdb04c7eab4180374a31e16e P 3883b0f2f9f7452aa7784ad7f79ed570: No bootstrap required, opened a new log
I20260808 14:50:36.979980 3488 ts_tablet_manager.cc:1397] T 4dcf0acffdb04c7eab4180374a31e16e P 3883b0f2f9f7452aa7784ad7f79ed570: Time spent bootstrapping tablet: real 0.009s user 0.005s sys 0.003s
I20260808 14:50:36.980568 3490 tablet_bootstrap.cc:492] T 4dcf0acffdb04c7eab4180374a31e16e P 5baab2df33494b8cb20296450685fed3: No bootstrap required, opened a new log
I20260808 14:50:36.980840 3490 ts_tablet_manager.cc:1397] T 4dcf0acffdb04c7eab4180374a31e16e P 5baab2df33494b8cb20296450685fed3: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260808 14:50:36.986462 3487 raft_consensus.cc:348] T 4dcf0acffdb04c7eab4180374a31e16e P 97ede4953e344ddaa50fe48bebd2c6e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5baab2df33494b8cb20296450685fed3" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 43699 } } peers { permanent_uuid: "3883b0f2f9f7452aa7784ad7f79ed570" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 34835 } } peers { permanent_uuid: "97ede4953e344ddaa50fe48bebd2c6e1" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 36989 } }
I20260808 14:50:36.986873 3487 raft_consensus.cc:374] T 4dcf0acffdb04c7eab4180374a31e16e P 97ede4953e344ddaa50fe48bebd2c6e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:50:36.986966 3487 raft_consensus.cc:729] T 4dcf0acffdb04c7eab4180374a31e16e P 97ede4953e344ddaa50fe48bebd2c6e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97ede4953e344ddaa50fe48bebd2c6e1, State: Initialized, Role: FOLLOWER
I20260808 14:50:36.987592 3487 consensus_queue.cc:260] T 4dcf0acffdb04c7eab4180374a31e16e P 97ede4953e344ddaa50fe48bebd2c6e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5baab2df33494b8cb20296450685fed3" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 43699 } } peers { permanent_uuid: "3883b0f2f9f7452aa7784ad7f79ed570" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 34835 } } peers { permanent_uuid: "97ede4953e344ddaa50fe48bebd2c6e1" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 36989 } }
I20260808 14:50:36.988353 3490 raft_consensus.cc:348] T 4dcf0acffdb04c7eab4180374a31e16e P 5baab2df33494b8cb20296450685fed3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5baab2df33494b8cb20296450685fed3" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 43699 } } peers { permanent_uuid: "3883b0f2f9f7452aa7784ad7f79ed570" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 34835 } } peers { permanent_uuid: "97ede4953e344ddaa50fe48bebd2c6e1" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 36989 } }
I20260808 14:50:36.988755 3490 raft_consensus.cc:374] T 4dcf0acffdb04c7eab4180374a31e16e P 5baab2df33494b8cb20296450685fed3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:50:36.988857 3490 raft_consensus.cc:729] T 4dcf0acffdb04c7eab4180374a31e16e P 5baab2df33494b8cb20296450685fed3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5baab2df33494b8cb20296450685fed3, State: Initialized, Role: FOLLOWER
I20260808 14:50:36.989470 3490 consensus_queue.cc:260] T 4dcf0acffdb04c7eab4180374a31e16e P 5baab2df33494b8cb20296450685fed3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5baab2df33494b8cb20296450685fed3" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 43699 } } peers { permanent_uuid: "3883b0f2f9f7452aa7784ad7f79ed570" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 34835 } } peers { permanent_uuid: "97ede4953e344ddaa50fe48bebd2c6e1" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 36989 } }
I20260808 14:50:36.990830 3488 raft_consensus.cc:348] T 4dcf0acffdb04c7eab4180374a31e16e P 3883b0f2f9f7452aa7784ad7f79ed570 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5baab2df33494b8cb20296450685fed3" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 43699 } } peers { permanent_uuid: "3883b0f2f9f7452aa7784ad7f79ed570" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 34835 } } peers { permanent_uuid: "97ede4953e344ddaa50fe48bebd2c6e1" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 36989 } }
I20260808 14:50:36.991219 3488 raft_consensus.cc:374] T 4dcf0acffdb04c7eab4180374a31e16e P 3883b0f2f9f7452aa7784ad7f79ed570 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:50:36.991318 3488 raft_consensus.cc:729] T 4dcf0acffdb04c7eab4180374a31e16e P 3883b0f2f9f7452aa7784ad7f79ed570 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3883b0f2f9f7452aa7784ad7f79ed570, State: Initialized, Role: FOLLOWER
I20260808 14:50:36.992035 3488 consensus_queue.cc:260] T 4dcf0acffdb04c7eab4180374a31e16e P 3883b0f2f9f7452aa7784ad7f79ed570 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5baab2df33494b8cb20296450685fed3" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 43699 } } peers { permanent_uuid: "3883b0f2f9f7452aa7784ad7f79ed570" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 34835 } } peers { permanent_uuid: "97ede4953e344ddaa50fe48bebd2c6e1" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 36989 } }
I20260808 14:50:36.993161 3289 heartbeater.cc:503] Master 127.26.206.254:40317 was elected leader, sending a full tablet report...
I20260808 14:50:36.996165 3488 ts_tablet_manager.cc:1428] T 4dcf0acffdb04c7eab4180374a31e16e P 3883b0f2f9f7452aa7784ad7f79ed570: Time spent starting tablet: real 0.016s user 0.010s sys 0.002s
I20260808 14:50:36.996773 3487 ts_tablet_manager.cc:1428] T 4dcf0acffdb04c7eab4180374a31e16e P 97ede4953e344ddaa50fe48bebd2c6e1: Time spent starting tablet: real 0.020s user 0.014s sys 0.000s
I20260808 14:50:37.000063 3490 ts_tablet_manager.cc:1428] T 4dcf0acffdb04c7eab4180374a31e16e P 5baab2df33494b8cb20296450685fed3: Time spent starting tablet: real 0.019s user 0.007s sys 0.009s
I20260808 14:50:37.000487 3449 heartbeater.cc:503] Master 127.26.206.254:40317 was elected leader, sending a full tablet report...
I20260808 14:50:37.037642 3494 raft_consensus.cc:482] T 4dcf0acffdb04c7eab4180374a31e16e P 5baab2df33494b8cb20296450685fed3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:50:37.037981 3494 raft_consensus.cc:504] T 4dcf0acffdb04c7eab4180374a31e16e P 5baab2df33494b8cb20296450685fed3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5baab2df33494b8cb20296450685fed3" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 43699 } } peers { permanent_uuid: "3883b0f2f9f7452aa7784ad7f79ed570" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 34835 } } peers { permanent_uuid: "97ede4953e344ddaa50fe48bebd2c6e1" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 36989 } }
I20260808 14:50:37.039757 3494 leader_election.cc:288] T 4dcf0acffdb04c7eab4180374a31e16e P 5baab2df33494b8cb20296450685fed3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3883b0f2f9f7452aa7784ad7f79ed570 (127.26.206.194:34835), 97ede4953e344ddaa50fe48bebd2c6e1 (127.26.206.193:36989)
I20260808 14:50:37.045626 3486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:37.040255 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.195:48957 (local address 127.26.206.193:36989)
0808 14:50:37.040488 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:37.040494 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:37.040520 (+ 26us) server_negotiation.cc:407] Connection header received
0808 14:50:37.040586 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:37.040589 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:37.040654 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:37.040755 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:50:37.041209 (+ 454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:37.041931 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:37.043795 (+ 1864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:37.044663 (+ 868us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:37.044848 (+ 185us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:37.044923 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:37.045251 (+ 328us) server_negotiation.cc:299] Negotiation successful
0808 14:50:37.045375 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260808 14:50:37.045809 3485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:37.040087 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.195:45021 (local address 127.26.206.194:34835)
0808 14:50:37.040290 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:37.040297 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:37.040530 (+ 233us) server_negotiation.cc:407] Connection header received
0808 14:50:37.040724 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:37.040736 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:37.040797 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:37.040897 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:50:37.041331 (+ 434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:37.042043 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:37.044027 (+ 1984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:37.044878 (+ 851us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:37.045057 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:37.045128 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:37.045442 (+ 314us) server_negotiation.cc:299] Negotiation successful
0808 14:50:37.045569 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260808 14:50:37.045876 3455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:37.039987 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.194:34835 (local address 127.26.206.195:45021)
0808 14:50:37.040432 (+ 445us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:37.040447 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 14:50:37.040584 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:50:37.040923 (+ 339us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:50:37.040928 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:50:37.040952 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:50:37.041170 (+ 218us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:37.041178 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:37.042189 (+ 1011us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:37.042194 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:37.043849 (+ 1655us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:37.043863 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:37.045057 (+ 1194us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:37.045063 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:37.045280 (+ 217us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:37.045304 (+ 24us) client_negotiation.cc:769] Sending connection context
0808 14:50:37.045414 (+ 110us) client_negotiation.cc:240] Negotiation successful
0808 14:50:37.045540 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":331,"mutex_wait_us":159}
I20260808 14:50:37.045639 3460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:37.039987 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.193:36989 (local address 127.26.206.195:48957)
0808 14:50:37.040223 (+ 236us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:37.040248 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0808 14:50:37.040382 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:50:37.040796 (+ 414us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:50:37.040800 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:50:37.040826 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:50:37.041032 (+ 206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:37.041039 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:37.042069 (+ 1030us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:37.042076 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:37.043461 (+ 1385us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:37.043475 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:37.044856 (+ 1381us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:37.044862 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:37.045076 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:37.045100 (+ 24us) client_negotiation.cc:769] Sending connection context
0808 14:50:37.045225 (+ 125us) client_negotiation.cc:240] Negotiation successful
0808 14:50:37.045359 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":80,"mutex_wait_us":61}
I20260808 14:50:37.046841 3233 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4dcf0acffdb04c7eab4180374a31e16e" candidate_uuid: "5baab2df33494b8cb20296450685fed3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3883b0f2f9f7452aa7784ad7f79ed570" is_pre_election: true
I20260808 14:50:37.047046 3073 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4dcf0acffdb04c7eab4180374a31e16e" candidate_uuid: "5baab2df33494b8cb20296450685fed3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97ede4953e344ddaa50fe48bebd2c6e1" is_pre_election: true
I20260808 14:50:37.047379 3233 raft_consensus.cc:2454] T 4dcf0acffdb04c7eab4180374a31e16e P 3883b0f2f9f7452aa7784ad7f79ed570 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5baab2df33494b8cb20296450685fed3 in term 0.
I20260808 14:50:37.047657 3073 raft_consensus.cc:2454] T 4dcf0acffdb04c7eab4180374a31e16e P 97ede4953e344ddaa50fe48bebd2c6e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5baab2df33494b8cb20296450685fed3 in term 0.
I20260808 14:50:37.048169 3321 leader_election.cc:302] T 4dcf0acffdb04c7eab4180374a31e16e P 5baab2df33494b8cb20296450685fed3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3883b0f2f9f7452aa7784ad7f79ed570, 5baab2df33494b8cb20296450685fed3; no voters:
I20260808 14:50:37.048637 3494 raft_consensus.cc:2781] T 4dcf0acffdb04c7eab4180374a31e16e P 5baab2df33494b8cb20296450685fed3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:50:37.048803 3494 raft_consensus.cc:482] T 4dcf0acffdb04c7eab4180374a31e16e P 5baab2df33494b8cb20296450685fed3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:50:37.048938 3494 raft_consensus.cc:3037] T 4dcf0acffdb04c7eab4180374a31e16e P 5baab2df33494b8cb20296450685fed3 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:50:37.051461 3494 raft_consensus.cc:504] T 4dcf0acffdb04c7eab4180374a31e16e P 5baab2df33494b8cb20296450685fed3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5baab2df33494b8cb20296450685fed3" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 43699 } } peers { permanent_uuid: "3883b0f2f9f7452aa7784ad7f79ed570" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 34835 } } peers { permanent_uuid: "97ede4953e344ddaa50fe48bebd2c6e1" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 36989 } }
I20260808 14:50:37.052098 3494 leader_election.cc:288] T 4dcf0acffdb04c7eab4180374a31e16e P 5baab2df33494b8cb20296450685fed3 [CANDIDATE]: Term 1 election: Requested vote from peers 3883b0f2f9f7452aa7784ad7f79ed570 (127.26.206.194:34835), 97ede4953e344ddaa50fe48bebd2c6e1 (127.26.206.193:36989)
I20260808 14:50:37.052529 3073 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4dcf0acffdb04c7eab4180374a31e16e" candidate_uuid: "5baab2df33494b8cb20296450685fed3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97ede4953e344ddaa50fe48bebd2c6e1"
I20260808 14:50:37.052560 3233 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4dcf0acffdb04c7eab4180374a31e16e" candidate_uuid: "5baab2df33494b8cb20296450685fed3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3883b0f2f9f7452aa7784ad7f79ed570"
I20260808 14:50:37.052772 3073 raft_consensus.cc:3037] T 4dcf0acffdb04c7eab4180374a31e16e P 97ede4953e344ddaa50fe48bebd2c6e1 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:50:37.052820 3233 raft_consensus.cc:3037] T 4dcf0acffdb04c7eab4180374a31e16e P 3883b0f2f9f7452aa7784ad7f79ed570 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:50:37.054867 3073 raft_consensus.cc:2454] T 4dcf0acffdb04c7eab4180374a31e16e P 97ede4953e344ddaa50fe48bebd2c6e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5baab2df33494b8cb20296450685fed3 in term 1.
I20260808 14:50:37.055042 3233 raft_consensus.cc:2454] T 4dcf0acffdb04c7eab4180374a31e16e P 3883b0f2f9f7452aa7784ad7f79ed570 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5baab2df33494b8cb20296450685fed3 in term 1.
I20260808 14:50:37.055299 3324 leader_election.cc:302] T 4dcf0acffdb04c7eab4180374a31e16e P 5baab2df33494b8cb20296450685fed3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5baab2df33494b8cb20296450685fed3, 97ede4953e344ddaa50fe48bebd2c6e1; no voters:
I20260808 14:50:37.055608 3494 raft_consensus.cc:2781] T 4dcf0acffdb04c7eab4180374a31e16e P 5baab2df33494b8cb20296450685fed3 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:50:37.056053 3494 raft_consensus.cc:686] T 4dcf0acffdb04c7eab4180374a31e16e P 5baab2df33494b8cb20296450685fed3 [term 1 LEADER]: Becoming Leader. State: Replica: 5baab2df33494b8cb20296450685fed3, State: Running, Role: LEADER
I20260808 14:50:37.056559 3494 consensus_queue.cc:237] T 4dcf0acffdb04c7eab4180374a31e16e P 5baab2df33494b8cb20296450685fed3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5baab2df33494b8cb20296450685fed3" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 43699 } } peers { permanent_uuid: "3883b0f2f9f7452aa7784ad7f79ed570" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 34835 } } peers { permanent_uuid: "97ede4953e344ddaa50fe48bebd2c6e1" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 36989 } }
I20260808 14:50:37.061928 2002 catalog_manager.cc:5495] T 4dcf0acffdb04c7eab4180374a31e16e P 5baab2df33494b8cb20296450685fed3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5baab2df33494b8cb20296450685fed3 (127.26.206.195). New cstate: current_term: 1 leader_uuid: "5baab2df33494b8cb20296450685fed3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5baab2df33494b8cb20296450685fed3" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 43699 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3883b0f2f9f7452aa7784ad7f79ed570" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 34835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "97ede4953e344ddaa50fe48bebd2c6e1" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 36989 } health_report { overall_health: UNKNOWN } } }
W20260808 14:50:37.082859 3451 tablet.cc:2369] T 4dcf0acffdb04c7eab4180374a31e16e P 5baab2df33494b8cb20296450685fed3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:50:37.102836 3482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:37.097614 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35466 (local address 127.26.206.195:43699)
0808 14:50:37.097807 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:37.097812 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:37.097955 (+ 143us) server_negotiation.cc:407] Connection header received
0808 14:50:37.098125 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:37.098129 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:37.098214 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:37.098342 (+ 128us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:50:37.098677 (+ 335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:37.099375 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:37.100797 (+ 1422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:37.101228 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:37.101358 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:37.101811 (+ 453us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:50:37.102288 (+ 477us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:50:37.102441 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:37.102575 (+ 134us) server_negotiation.cc:299] Negotiation successful
0808 14:50:37.102638 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260808 14:50:37.110988 3233 raft_consensus.cc:1261] T 4dcf0acffdb04c7eab4180374a31e16e P 3883b0f2f9f7452aa7784ad7f79ed570 [term 1 FOLLOWER]: Refusing update from remote peer 5baab2df33494b8cb20296450685fed3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:50:37.111025 3073 raft_consensus.cc:1261] T 4dcf0acffdb04c7eab4180374a31e16e P 97ede4953e344ddaa50fe48bebd2c6e1 [term 1 FOLLOWER]: Refusing update from remote peer 5baab2df33494b8cb20296450685fed3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:50:37.111967 3496 consensus_queue.cc:1035] T 4dcf0acffdb04c7eab4180374a31e16e P 5baab2df33494b8cb20296450685fed3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3883b0f2f9f7452aa7784ad7f79ed570" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 34835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:50:37.112370 3494 consensus_queue.cc:1035] T 4dcf0acffdb04c7eab4180374a31e16e P 5baab2df33494b8cb20296450685fed3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "97ede4953e344ddaa50fe48bebd2c6e1" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 36989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260808 14:50:37.112831 3129 tablet.cc:2369] T 4dcf0acffdb04c7eab4180374a31e16e P 97ede4953e344ddaa50fe48bebd2c6e1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:50:37.146817 2003 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43496:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:50:37.147101 2003 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43496:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:50:37.154098 2003 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7ec633ac085e4b5aa53213a2f91b43fa: Sending DeleteTablet for 3 replicas of tablet 4dcf0acffdb04c7eab4180374a31e16e
I20260808 14:50:37.155100 3375 tablet_service.cc:1514] Processing DeleteTablet for tablet 4dcf0acffdb04c7eab4180374a31e16e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:50:37 UTC) from {username='oryx', principal='oryx/127.26.206.254@KRBTEST.COM'} at 127.0.0.1:35458
I20260808 14:50:37.155395 3212 tablet_service.cc:1514] Processing DeleteTablet for tablet 4dcf0acffdb04c7eab4180374a31e16e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:50:37 UTC) from {username='oryx', principal='oryx/127.26.206.254@KRBTEST.COM'} at 127.0.0.1:34500
I20260808 14:50:37.156662 3052 tablet_service.cc:1514] Processing DeleteTablet for tablet 4dcf0acffdb04c7eab4180374a31e16e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:50:37 UTC) from {username='oryx', principal='oryx/127.26.206.254@KRBTEST.COM'} at 127.0.0.1:58920
I20260808 14:50:37.168383 3511 tablet_replica.cc:330] T 4dcf0acffdb04c7eab4180374a31e16e P 3883b0f2f9f7452aa7784ad7f79ed570: stopping tablet replica
I20260808 14:50:37.168988 3511 raft_consensus.cc:2229] T 4dcf0acffdb04c7eab4180374a31e16e P 3883b0f2f9f7452aa7784ad7f79ed570 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:50:37.169582 3511 raft_consensus.cc:2258] T 4dcf0acffdb04c7eab4180374a31e16e P 3883b0f2f9f7452aa7784ad7f79ed570 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:50:37.173085 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 1966
I20260808 14:50:37.173512 3512 tablet_replica.cc:330] T 4dcf0acffdb04c7eab4180374a31e16e P 97ede4953e344ddaa50fe48bebd2c6e1: stopping tablet replica
I20260808 14:50:37.173975 3512 raft_consensus.cc:2229] T 4dcf0acffdb04c7eab4180374a31e16e P 97ede4953e344ddaa50fe48bebd2c6e1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:50:37.174216 2037 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:50:37.174799 3512 raft_consensus.cc:2258] T 4dcf0acffdb04c7eab4180374a31e16e P 97ede4953e344ddaa50fe48bebd2c6e1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:50:37.177764 3512 ts_tablet_manager.cc:1905] T 4dcf0acffdb04c7eab4180374a31e16e P 97ede4953e344ddaa50fe48bebd2c6e1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:50:37.185253 3511 ts_tablet_manager.cc:1905] T 4dcf0acffdb04c7eab4180374a31e16e P 3883b0f2f9f7452aa7784ad7f79ed570: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:50:37.185930 3510 tablet_replica.cc:330] T 4dcf0acffdb04c7eab4180374a31e16e P 5baab2df33494b8cb20296450685fed3: stopping tablet replica
I20260808 14:50:37.186867 3510 raft_consensus.cc:2229] T 4dcf0acffdb04c7eab4180374a31e16e P 5baab2df33494b8cb20296450685fed3 [term 1 LEADER]: Raft consensus shutting down.
I20260808 14:50:37.187721 3510 raft_consensus.cc:2258] T 4dcf0acffdb04c7eab4180374a31e16e P 5baab2df33494b8cb20296450685fed3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:50:37.190570 3510 ts_tablet_manager.cc:1905] T 4dcf0acffdb04c7eab4180374a31e16e P 5baab2df33494b8cb20296450685fed3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:50:37.195989 3452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:37.157865 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54014 (local address 127.26.206.253:39527)
0808 14:50:37.158058 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:37.158064 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:37.171819 (+ 13755us) server_negotiation.cc:407] Connection header received
0808 14:50:37.172047 (+ 228us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:37.172054 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:37.172136 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:37.172237 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:37.178223 (+ 5986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:37.179488 (+ 1265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:37.183319 (+ 3831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:37.184071 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:37.184169 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:37.188624 (+ 4455us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:50:37.188630 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:50:37.188636 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:50:37.188678 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:50:37.192432 (+ 3754us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:37.193328 (+ 896us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:37.193333 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:37.193337 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:37.193490 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:37.193978 (+ 488us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:37.193983 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:37.193986 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:37.194357 (+ 371us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:50:37.194634 (+ 277us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:37.195319 (+ 685us) server_negotiation.cc:299] Negotiation successful
0808 14:50:37.195551 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260808 14:50:37.197721 3512 ts_tablet_manager.cc:1918] T 4dcf0acffdb04c7eab4180374a31e16e P 97ede4953e344ddaa50fe48bebd2c6e1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:50:37.197955 3512 log.cc:1196] T 4dcf0acffdb04c7eab4180374a31e16e P 97ede4953e344ddaa50fe48bebd2c6e1: Deleting WAL directory at /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/ts-0/wal/wals/4dcf0acffdb04c7eab4180374a31e16e
I20260808 14:50:37.198635 3512 ts_tablet_manager.cc:1939] T 4dcf0acffdb04c7eab4180374a31e16e P 97ede4953e344ddaa50fe48bebd2c6e1: Deleting consensus metadata
I20260808 14:50:37.202728 3510 ts_tablet_manager.cc:1918] T 4dcf0acffdb04c7eab4180374a31e16e P 5baab2df33494b8cb20296450685fed3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:50:37.203078 3510 log.cc:1196] T 4dcf0acffdb04c7eab4180374a31e16e P 5baab2df33494b8cb20296450685fed3: Deleting WAL directory at /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/ts-2/wal/wals/4dcf0acffdb04c7eab4180374a31e16e
I20260808 14:50:37.203809 3510 ts_tablet_manager.cc:1939] T 4dcf0acffdb04c7eab4180374a31e16e P 5baab2df33494b8cb20296450685fed3: Deleting consensus metadata
I20260808 14:50:37.209196 3511 ts_tablet_manager.cc:1918] T 4dcf0acffdb04c7eab4180374a31e16e P 3883b0f2f9f7452aa7784ad7f79ed570: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:50:37.209396 3511 log.cc:1196] T 4dcf0acffdb04c7eab4180374a31e16e P 3883b0f2f9f7452aa7784ad7f79ed570: Deleting WAL directory at /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/ts-1/wal/wals/4dcf0acffdb04c7eab4180374a31e16e
I20260808 14:50:37.209934 3511 ts_tablet_manager.cc:1939] T 4dcf0acffdb04c7eab4180374a31e16e P 3883b0f2f9f7452aa7784ad7f79ed570: Deleting consensus metadata
I20260808 14:50:37.227133 3466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:37.171975 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56754 (local address 127.26.206.252:46475)
0808 14:50:37.172506 (+ 531us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:37.172512 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:37.198306 (+ 25794us) server_negotiation.cc:407] Connection header received
0808 14:50:37.198634 (+ 328us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:37.198640 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:37.198727 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:37.198824 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:37.212507 (+ 13683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:37.213610 (+ 1103us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:37.215521 (+ 1911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:37.216343 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:37.216460 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:37.220265 (+ 3805us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:50:37.220272 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:50:37.220286 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:50:37.220325 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:50:37.223987 (+ 3662us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:37.224822 (+ 835us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:37.224828 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:37.224832 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:37.224984 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:37.225445 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:37.225450 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:37.225453 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:37.225780 (+ 327us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:50:37.226006 (+ 226us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:37.226556 (+ 550us) server_negotiation.cc:299] Negotiation successful
0808 14:50:37.226774 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":374}
I20260808 14:50:37.326270 1987 catalog_manager.cc:4841] TS 97ede4953e344ddaa50fe48bebd2c6e1 (127.26.206.193:36989): tablet 4dcf0acffdb04c7eab4180374a31e16e (table test-table [id=6e4e0d54b10d495ba669bd2ce6071d1d]) successfully deleted
I20260808 14:50:37.326753 1984 catalog_manager.cc:4841] TS 3883b0f2f9f7452aa7784ad7f79ed570 (127.26.206.194:34835): tablet 4dcf0acffdb04c7eab4180374a31e16e (table test-table [id=6e4e0d54b10d495ba669bd2ce6071d1d]) successfully deleted
I20260808 14:50:37.327055 1984 catalog_manager.cc:4841] TS 5baab2df33494b8cb20296450685fed3 (127.26.206.195:43699): tablet 4dcf0acffdb04c7eab4180374a31e16e (table test-table [id=6e4e0d54b10d495ba669bd2ce6071d1d]) successfully deleted
I20260808 14:50:37.327064 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 1966
I20260808 14:50:37.376345 3452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:37.358185 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54030 (local address 127.26.206.253:39527)
0808 14:50:37.358413 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:37.358419 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:37.359511 (+ 1092us) server_negotiation.cc:407] Connection header received
0808 14:50:37.359831 (+ 320us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:37.359838 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:37.359921 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:37.359993 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:37.362402 (+ 2409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:37.363399 (+ 997us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:37.365203 (+ 1804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:37.365893 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:37.365994 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:37.369497 (+ 3503us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:50:37.369502 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:50:37.369505 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:50:37.369538 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:50:37.373283 (+ 3745us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:37.374092 (+ 809us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:37.374097 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:37.374102 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:37.374256 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:37.374764 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:37.374770 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:37.374773 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:37.375183 (+ 410us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:50:37.375443 (+ 260us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:37.375808 (+ 365us) server_negotiation.cc:299] Negotiation successful
0808 14:50:37.376000 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260808 14:50:37.377971 3466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:37.360317 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56756 (local address 127.26.206.252:46475)
0808 14:50:37.360520 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:37.360527 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:37.360761 (+ 234us) server_negotiation.cc:407] Connection header received
0808 14:50:37.360936 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:37.360941 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:37.361011 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:37.361111 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:37.363051 (+ 1940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:37.364217 (+ 1166us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:37.366128 (+ 1911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:37.366770 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:37.366867 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:37.370441 (+ 3574us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:50:37.370447 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:50:37.370453 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:50:37.370496 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:50:37.374532 (+ 4036us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:37.375393 (+ 861us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:37.375399 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:37.375402 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:37.375628 (+ 226us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:37.376118 (+ 490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:37.376123 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:37.376125 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:37.376436 (+ 311us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:50:37.376920 (+ 484us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:37.377439 (+ 519us) server_negotiation.cc:299] Negotiation successful
0808 14:50:37.377639 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260808 14:50:38.137992 3526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:38.137261 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:40317 (local address 127.26.206.194:37943)
0808 14:50:38.137700 (+ 439us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:38.137826 (+ 126us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:40317: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":333,"thread_start_us":236,"threads_started":1}
W20260808 14:50:38.139008 3289 heartbeater.cc:644] Failed to heartbeat to 127.26.206.254:40317 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.26.206.254:40317: connect: Connection refused (error 111)
I20260808 14:50:38.139837 3528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:38.138615 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:40317 (local address 127.26.206.193:39987)
0808 14:50:38.139469 (+ 854us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:38.139644 (+ 175us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:40317: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":739,"thread_start_us":624,"threads_started":1}
W20260808 14:50:38.140249 3126 heartbeater.cc:644] Failed to heartbeat to 127.26.206.254:40317 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.26.206.254:40317: connect: Connection refused (error 111)
I20260808 14:50:38.143826 3529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:38.142971 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:40317 (local address 127.26.206.195:34123)
0808 14:50:38.143422 (+ 451us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:38.143641 (+ 219us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:40317: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":331,"thread_start_us":196,"threads_started":1}
W20260808 14:50:38.144240 3449 heartbeater.cc:644] Failed to heartbeat to 127.26.206.254:40317 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.26.206.254:40317: connect: Connection refused (error 111)
I20260808 14:50:38.654035 3530 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7c552da230014669b01423a8c5d26637 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7ec633ac085e4b5aa53213a2f91b43fa)
I20260808 14:50:38.654287 3530 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7c552da230014669b01423a8c5d26637 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "7ec633ac085e4b5aa53213a2f91b43fa" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 40317 } } peers { permanent_uuid: "7c552da230014669b01423a8c5d26637" member_type: VOTER last_known_addr { host: "127.26.206.253" port: 39527 } attrs { promote: false } } peers { permanent_uuid: "aa9f091538e44434a211c36698df9e04" member_type: VOTER last_known_addr { host: "127.26.206.252" port: 46475 } attrs { promote: false } }
I20260808 14:50:38.654865 3531 raft_consensus.cc:482] T 00000000000000000000000000000000 P aa9f091538e44434a211c36698df9e04 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7ec633ac085e4b5aa53213a2f91b43fa)
I20260808 14:50:38.655279 3530 leader_election.cc:288] T 00000000000000000000000000000000 P 7c552da230014669b01423a8c5d26637 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7ec633ac085e4b5aa53213a2f91b43fa (127.26.206.254:40317), aa9f091538e44434a211c36698df9e04 (127.26.206.252:46475)
I20260808 14:50:38.655085 3531 raft_consensus.cc:504] T 00000000000000000000000000000000 P aa9f091538e44434a211c36698df9e04 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "7ec633ac085e4b5aa53213a2f91b43fa" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 40317 } } peers { permanent_uuid: "7c552da230014669b01423a8c5d26637" member_type: VOTER last_known_addr { host: "127.26.206.253" port: 39527 } attrs { promote: false } } peers { permanent_uuid: "aa9f091538e44434a211c36698df9e04" member_type: VOTER last_known_addr { host: "127.26.206.252" port: 46475 } attrs { promote: false } }
I20260808 14:50:38.656522 3532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:38.655467 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:40317 (local address 127.0.0.1:41490)
0808 14:50:38.655989 (+ 522us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:38.656212 (+ 223us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:40317: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":402,"thread_start_us":249,"threads_started":1}
I20260808 14:50:38.657908 3531 leader_election.cc:288] T 00000000000000000000000000000000 P aa9f091538e44434a211c36698df9e04 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7ec633ac085e4b5aa53213a2f91b43fa (127.26.206.254:40317), 7c552da230014669b01423a8c5d26637 (127.26.206.253:39527)
I20260808 14:50:38.662354 3534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:38.656489 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:40317 (local address 127.0.0.1:41506)
0808 14:50:38.661752 (+ 5263us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:38.661987 (+ 235us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:40317: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":5091,"thread_start_us":743,"threads_started":1}
W20260808 14:50:38.662701 2906 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.206.254:40317: connect: Connection refused (error 111)
W20260808 14:50:38.668105 2687 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.206.254:40317: connect: Connection refused (error 111)
I20260808 14:50:38.668515 3534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:38.668057 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:40317 (local address 127.0.0.1:41520)
0808 14:50:38.668279 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:38.668356 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:40317: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111}
I20260808 14:50:38.668836 3536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:38.656367 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.253:39527 (local address 127.0.0.1:40588)
0808 14:50:38.657556 (+ 1189us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:38.657576 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 14:50:38.657704 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:50:38.658871 (+ 1167us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:50:38.658876 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:50:38.658906 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:50:38.659322 (+ 416us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:38.659339 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:38.664076 (+ 4737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:38.664083 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:38.666292 (+ 2209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:38.666306 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:38.667933 (+ 1627us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:38.667939 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:38.668116 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:38.668161 (+ 45us) client_negotiation.cc:769] Sending connection context
0808 14:50:38.668232 (+ 71us) client_negotiation.cc:240] Negotiation successful
0808 14:50:38.668377 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1053,"thread_start_us":5085,"threads_started":1}
W20260808 14:50:38.668785 2906 leader_election.cc:334] T 00000000000000000000000000000000 P aa9f091538e44434a211c36698df9e04 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7ec633ac085e4b5aa53213a2f91b43fa (127.26.206.254:40317): Network error: Client connection negotiation failed: client connection to 127.26.206.254:40317: connect: Connection refused (error 111)
I20260808 14:50:38.669308 3532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:38.656100 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.252:46475 (local address 127.0.0.1:60174)
0808 14:50:38.656834 (+ 734us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:38.656855 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 14:50:38.657017 (+ 162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:50:38.661859 (+ 4842us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:50:38.661864 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:50:38.661913 (+ 49us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:50:38.662271 (+ 358us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:38.662284 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:38.664166 (+ 1882us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:38.664174 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:38.666294 (+ 2120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:38.666307 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:38.668455 (+ 2148us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:38.668461 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:38.668670 (+ 209us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:38.668733 (+ 63us) client_negotiation.cc:769] Sending connection context
0808 14:50:38.668819 (+ 86us) client_negotiation.cc:240] Negotiation successful
0808 14:50:38.668971 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":625,"thread_start_us":11701,"threads_started":1}
I20260808 14:50:38.670492 3537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:38.656712 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40588 (local address 127.26.206.253:39527)
0808 14:50:38.658525 (+ 1813us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:38.658530 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:38.658548 (+ 18us) server_negotiation.cc:407] Connection header received
0808 14:50:38.658609 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:38.658613 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:38.658689 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:38.659523 (+ 834us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:50:38.659904 (+ 381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:38.663912 (+ 4008us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:38.666508 (+ 2596us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:38.667742 (+ 1234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:38.669205 (+ 1463us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:38.669292 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:38.669348 (+ 56us) server_negotiation.cc:299] Negotiation successful
0808 14:50:38.669503 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1689,"thread_start_us":2190,"threads_started":1}
I20260808 14:50:38.670521 3538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:38.656741 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60174 (local address 127.26.206.252:46475)
0808 14:50:38.661491 (+ 4750us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:38.661496 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:38.661516 (+ 20us) server_negotiation.cc:407] Connection header received
0808 14:50:38.661586 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:38.661591 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:38.661678 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:38.662413 (+ 735us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:50:38.662824 (+ 411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:38.663996 (+ 1172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:38.666825 (+ 2829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:38.668176 (+ 1351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:38.669936 (+ 1760us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:38.670021 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:38.670069 (+ 48us) server_negotiation.cc:299] Negotiation successful
0808 14:50:38.670189 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4587,"thread_start_us":4431,"threads_started":1}
I20260808 14:50:38.670562 3532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:38.670084 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:40317 (local address 127.0.0.1:41528)
0808 14:50:38.670258 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:38.670361 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:40317: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
W20260808 14:50:38.671059 2687 leader_election.cc:334] T 00000000000000000000000000000000 P 7c552da230014669b01423a8c5d26637 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7ec633ac085e4b5aa53213a2f91b43fa (127.26.206.254:40317): Network error: Client connection negotiation failed: client connection to 127.26.206.254:40317: connect: Connection refused (error 111)
I20260808 14:50:38.671106 2711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "aa9f091538e44434a211c36698df9e04" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "7c552da230014669b01423a8c5d26637" is_pre_election: true
I20260808 14:50:38.671104 2932 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7c552da230014669b01423a8c5d26637" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "aa9f091538e44434a211c36698df9e04" is_pre_election: true
I20260808 14:50:38.671406 2711 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 7c552da230014669b01423a8c5d26637 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aa9f091538e44434a211c36698df9e04 in term 1.
I20260808 14:50:38.671427 2932 raft_consensus.cc:2454] T 00000000000000000000000000000000 P aa9f091538e44434a211c36698df9e04 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c552da230014669b01423a8c5d26637 in term 1.
I20260808 14:50:38.672024 2687 leader_election.cc:302] T 00000000000000000000000000000000 P 7c552da230014669b01423a8c5d26637 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c552da230014669b01423a8c5d26637, aa9f091538e44434a211c36698df9e04; no voters: 7ec633ac085e4b5aa53213a2f91b43fa
I20260808 14:50:38.671960 2905 leader_election.cc:302] T 00000000000000000000000000000000 P aa9f091538e44434a211c36698df9e04 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c552da230014669b01423a8c5d26637, aa9f091538e44434a211c36698df9e04; no voters: 7ec633ac085e4b5aa53213a2f91b43fa
I20260808 14:50:38.672307 3530 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7c552da230014669b01423a8c5d26637 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260808 14:50:38.672427 3531 raft_consensus.cc:2781] T 00000000000000000000000000000000 P aa9f091538e44434a211c36698df9e04 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260808 14:50:38.672425 3530 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7c552da230014669b01423a8c5d26637 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7ec633ac085e4b5aa53213a2f91b43fa)
I20260808 14:50:38.672564 3530 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7c552da230014669b01423a8c5d26637 [term 1 FOLLOWER]: Advancing to term 2
I20260808 14:50:38.672564 3531 raft_consensus.cc:482] T 00000000000000000000000000000000 P aa9f091538e44434a211c36698df9e04 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7ec633ac085e4b5aa53213a2f91b43fa)
I20260808 14:50:38.672675 3531 raft_consensus.cc:3037] T 00000000000000000000000000000000 P aa9f091538e44434a211c36698df9e04 [term 1 FOLLOWER]: Advancing to term 2
I20260808 14:50:38.675042 3531 raft_consensus.cc:504] T 00000000000000000000000000000000 P aa9f091538e44434a211c36698df9e04 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "7ec633ac085e4b5aa53213a2f91b43fa" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 40317 } } peers { permanent_uuid: "7c552da230014669b01423a8c5d26637" member_type: VOTER last_known_addr { host: "127.26.206.253" port: 39527 } attrs { promote: false } } peers { permanent_uuid: "aa9f091538e44434a211c36698df9e04" member_type: VOTER last_known_addr { host: "127.26.206.252" port: 46475 } attrs { promote: false } }
I20260808 14:50:38.675076 3530 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7c552da230014669b01423a8c5d26637 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "7ec633ac085e4b5aa53213a2f91b43fa" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 40317 } } peers { permanent_uuid: "7c552da230014669b01423a8c5d26637" member_type: VOTER last_known_addr { host: "127.26.206.253" port: 39527 } attrs { promote: false } } peers { permanent_uuid: "aa9f091538e44434a211c36698df9e04" member_type: VOTER last_known_addr { host: "127.26.206.252" port: 46475 } attrs { promote: false } }
I20260808 14:50:38.675800 3531 leader_election.cc:288] T 00000000000000000000000000000000 P aa9f091538e44434a211c36698df9e04 [CANDIDATE]: Term 2 election: Requested vote from peers 7ec633ac085e4b5aa53213a2f91b43fa (127.26.206.254:40317), 7c552da230014669b01423a8c5d26637 (127.26.206.253:39527)
I20260808 14:50:38.675858 3530 leader_election.cc:288] T 00000000000000000000000000000000 P 7c552da230014669b01423a8c5d26637 [CANDIDATE]: Term 2 election: Requested vote from peers 7ec633ac085e4b5aa53213a2f91b43fa (127.26.206.254:40317), aa9f091538e44434a211c36698df9e04 (127.26.206.252:46475)
I20260808 14:50:38.676240 3536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:38.675860 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:40317 (local address 127.0.0.1:41532)
0808 14:50:38.676025 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:38.676120 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:40317: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
I20260808 14:50:38.676374 2711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "aa9f091538e44434a211c36698df9e04" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "7c552da230014669b01423a8c5d26637"
I20260808 14:50:38.676726 2711 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 7c552da230014669b01423a8c5d26637 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate aa9f091538e44434a211c36698df9e04 in current term 2: Already voted for candidate 7c552da230014669b01423a8c5d26637 in this term.
I20260808 14:50:38.676910 3532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:38.676506 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:40317 (local address 127.0.0.1:41544)
0808 14:50:38.676630 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:38.676717 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:40317: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260808 14:50:38.677296 3536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:38.676916 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:40317 (local address 127.0.0.1:41560)
0808 14:50:38.677054 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:38.677139 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:40317: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260808 14:50:38.677297 2932 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7c552da230014669b01423a8c5d26637" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "aa9f091538e44434a211c36698df9e04"
W20260808 14:50:38.677561 2906 leader_election.cc:334] T 00000000000000000000000000000000 P aa9f091538e44434a211c36698df9e04 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7ec633ac085e4b5aa53213a2f91b43fa (127.26.206.254:40317): Network error: Client connection negotiation failed: client connection to 127.26.206.254:40317: connect: Connection refused (error 111)
I20260808 14:50:38.677675 2932 raft_consensus.cc:2379] T 00000000000000000000000000000000 P aa9f091538e44434a211c36698df9e04 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c552da230014669b01423a8c5d26637 in current term 2: Already voted for candidate aa9f091538e44434a211c36698df9e04 in this term.
I20260808 14:50:38.677697 2906 leader_election.cc:302] T 00000000000000000000000000000000 P aa9f091538e44434a211c36698df9e04 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aa9f091538e44434a211c36698df9e04; no voters: 7c552da230014669b01423a8c5d26637, 7ec633ac085e4b5aa53213a2f91b43fa
I20260808 14:50:38.677986 3531 raft_consensus.cc:2726] T 00000000000000000000000000000000 P aa9f091538e44434a211c36698df9e04 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260808 14:50:38.678900 3532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:38.678555 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:40317 (local address 127.0.0.1:41574)
0808 14:50:38.678695 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:38.678757 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:40317: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260808 14:50:38.679072 2687 leader_election.cc:334] T 00000000000000000000000000000000 P 7c552da230014669b01423a8c5d26637 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7ec633ac085e4b5aa53213a2f91b43fa (127.26.206.254:40317): Network error: Client connection negotiation failed: client connection to 127.26.206.254:40317: connect: Connection refused (error 111)
I20260808 14:50:38.679241 2687 leader_election.cc:302] T 00000000000000000000000000000000 P 7c552da230014669b01423a8c5d26637 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c552da230014669b01423a8c5d26637; no voters: 7ec633ac085e4b5aa53213a2f91b43fa, aa9f091538e44434a211c36698df9e04
I20260808 14:50:38.679545 3530 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 7c552da230014669b01423a8c5d26637 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260808 14:50:39.140447 3541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:39.139660 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:40317 (local address 127.26.206.194:38751)
0808 14:50:39.140159 (+ 499us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:39.140265 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:40317: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":380,"thread_start_us":264,"threads_started":1}
I20260808 14:50:39.141671 3543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:39.140908 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:40317 (local address 127.26.206.193:41363)
0808 14:50:39.141410 (+ 502us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:39.141509 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:40317: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":394,"thread_start_us":281,"threads_started":1}
I20260808 14:50:39.145677 3544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:39.144973 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:40317 (local address 127.26.206.195:57787)
0808 14:50:39.145364 (+ 391us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:39.145436 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:40317: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":303,"thread_start_us":212,"threads_started":1}
I20260808 14:50:40.142040 3545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:40.141237 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:40317 (local address 127.26.206.194:59165)
0808 14:50:40.141650 (+ 413us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:40.141779 (+ 129us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:40317: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":320,"thread_start_us":226,"threads_started":1}
I20260808 14:50:40.143231 3547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:40.142413 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:40317 (local address 127.26.206.193:57925)
0808 14:50:40.142958 (+ 545us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:40.143056 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:40317: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":405,"thread_start_us":246,"threads_started":1}
I20260808 14:50:40.147133 3548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:40.146450 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:40317 (local address 127.26.206.195:53527)
0808 14:50:40.146901 (+ 451us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:40.147002 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:40317: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":349,"thread_start_us":262,"threads_started":1}
I20260808 14:50:40.459973 3549 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7c552da230014669b01423a8c5d26637 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:50:40.460315 3549 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7c552da230014669b01423a8c5d26637 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "7ec633ac085e4b5aa53213a2f91b43fa" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 40317 } } peers { permanent_uuid: "7c552da230014669b01423a8c5d26637" member_type: VOTER last_known_addr { host: "127.26.206.253" port: 39527 } attrs { promote: false } } peers { permanent_uuid: "aa9f091538e44434a211c36698df9e04" member_type: VOTER last_known_addr { host: "127.26.206.252" port: 46475 } attrs { promote: false } }
I20260808 14:50:40.460918 3549 leader_election.cc:288] T 00000000000000000000000000000000 P 7c552da230014669b01423a8c5d26637 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ec633ac085e4b5aa53213a2f91b43fa (127.26.206.254:40317), aa9f091538e44434a211c36698df9e04 (127.26.206.252:46475)
I20260808 14:50:40.461921 3550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:40.461125 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:40317 (local address 127.0.0.1:41794)
0808 14:50:40.461622 (+ 497us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:40.461755 (+ 133us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:40317: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":369,"thread_start_us":272,"threads_started":1}
I20260808 14:50:40.462054 2932 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7c552da230014669b01423a8c5d26637" candidate_term: 3 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "aa9f091538e44434a211c36698df9e04" is_pre_election: true
I20260808 14:50:40.462345 2932 raft_consensus.cc:2454] T 00000000000000000000000000000000 P aa9f091538e44434a211c36698df9e04 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c552da230014669b01423a8c5d26637 in term 2.
I20260808 14:50:40.463086 2687 leader_election.cc:302] T 00000000000000000000000000000000 P 7c552da230014669b01423a8c5d26637 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c552da230014669b01423a8c5d26637, aa9f091538e44434a211c36698df9e04; no voters:
I20260808 14:50:40.463289 3550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:40.462925 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:40317 (local address 127.0.0.1:41800)
0808 14:50:40.463054 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:40.463126 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:40317: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260808 14:50:40.463368 3549 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7c552da230014669b01423a8c5d26637 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260808 14:50:40.463486 3549 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7c552da230014669b01423a8c5d26637 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260808 14:50:40.463587 2687 leader_election.cc:334] T 00000000000000000000000000000000 P 7c552da230014669b01423a8c5d26637 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7ec633ac085e4b5aa53213a2f91b43fa (127.26.206.254:40317): Network error: Client connection negotiation failed: client connection to 127.26.206.254:40317: connect: Connection refused (error 111)
I20260808 14:50:40.463675 3549 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7c552da230014669b01423a8c5d26637 [term 2 FOLLOWER]: Advancing to term 3
I20260808 14:50:40.465926 3549 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7c552da230014669b01423a8c5d26637 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "7ec633ac085e4b5aa53213a2f91b43fa" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 40317 } } peers { permanent_uuid: "7c552da230014669b01423a8c5d26637" member_type: VOTER last_known_addr { host: "127.26.206.253" port: 39527 } attrs { promote: false } } peers { permanent_uuid: "aa9f091538e44434a211c36698df9e04" member_type: VOTER last_known_addr { host: "127.26.206.252" port: 46475 } attrs { promote: false } }
I20260808 14:50:40.466476 3549 leader_election.cc:288] T 00000000000000000000000000000000 P 7c552da230014669b01423a8c5d26637 [CANDIDATE]: Term 3 election: Requested vote from peers 7ec633ac085e4b5aa53213a2f91b43fa (127.26.206.254:40317), aa9f091538e44434a211c36698df9e04 (127.26.206.252:46475)
I20260808 14:50:40.466925 3550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:40.466569 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:40317 (local address 127.0.0.1:41814)
0808 14:50:40.466697 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:40.466784 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:40317: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
I20260808 14:50:40.467113 2932 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7c552da230014669b01423a8c5d26637" candidate_term: 3 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "aa9f091538e44434a211c36698df9e04"
I20260808 14:50:40.467377 2932 raft_consensus.cc:3037] T 00000000000000000000000000000000 P aa9f091538e44434a211c36698df9e04 [term 2 FOLLOWER]: Advancing to term 3
I20260808 14:50:40.467960 3550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:40.467653 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:40317 (local address 127.0.0.1:41824)
0808 14:50:40.467799 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:40.467873 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:40317: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
W20260808 14:50:40.468122 2687 leader_election.cc:334] T 00000000000000000000000000000000 P 7c552da230014669b01423a8c5d26637 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 7ec633ac085e4b5aa53213a2f91b43fa (127.26.206.254:40317): Network error: Client connection negotiation failed: client connection to 127.26.206.254:40317: connect: Connection refused (error 111)
I20260808 14:50:40.469635 2932 raft_consensus.cc:2454] T 00000000000000000000000000000000 P aa9f091538e44434a211c36698df9e04 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c552da230014669b01423a8c5d26637 in term 3.
I20260808 14:50:40.470059 2687 leader_election.cc:302] T 00000000000000000000000000000000 P 7c552da230014669b01423a8c5d26637 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c552da230014669b01423a8c5d26637, aa9f091538e44434a211c36698df9e04; no voters: 7ec633ac085e4b5aa53213a2f91b43fa
I20260808 14:50:40.470347 3549 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7c552da230014669b01423a8c5d26637 [term 3 FOLLOWER]: Leader election won for term 3
I20260808 14:50:40.470733 3549 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7c552da230014669b01423a8c5d26637 [term 3 LEADER]: Becoming Leader. State: Replica: 7c552da230014669b01423a8c5d26637, State: Running, Role: LEADER
I20260808 14:50:40.471132 3549 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7c552da230014669b01423a8c5d26637 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "7ec633ac085e4b5aa53213a2f91b43fa" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 40317 } } peers { permanent_uuid: "7c552da230014669b01423a8c5d26637" member_type: VOTER last_known_addr { host: "127.26.206.253" port: 39527 } attrs { promote: false } } peers { permanent_uuid: "aa9f091538e44434a211c36698df9e04" member_type: VOTER last_known_addr { host: "127.26.206.252" port: 46475 } attrs { promote: false } }
I20260808 14:50:40.472898 3552 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7c552da230014669b01423a8c5d26637 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7c552da230014669b01423a8c5d26637. Latest consensus state: current_term: 3 leader_uuid: "7c552da230014669b01423a8c5d26637" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "7ec633ac085e4b5aa53213a2f91b43fa" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 40317 } } peers { permanent_uuid: "7c552da230014669b01423a8c5d26637" member_type: VOTER last_known_addr { host: "127.26.206.253" port: 39527 } attrs { promote: false } } peers { permanent_uuid: "aa9f091538e44434a211c36698df9e04" member_type: VOTER last_known_addr { host: "127.26.206.252" port: 46475 } attrs { promote: false } } }
I20260808 14:50:40.473218 3552 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7c552da230014669b01423a8c5d26637 [sys.catalog]: This master's current role is: LEADER
I20260808 14:50:40.473891 3554 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:50:40.477793 3554 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:50:40.478615 3554 catalog_manager.cc:1259] Loaded cluster ID: 9483185052154f6b952efaccfd87fc9f
I20260808 14:50:40.478708 3554 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:50:40.480079 3554 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:50:40.480875 3554 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 7c552da230014669b01423a8c5d26637: Loaded TSK: 0
I20260808 14:50:40.481781 3554 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:50:40.505563 2699 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54030:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:50:40.512475 2699 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:50:40.516538 2932 raft_consensus.cc:1261] T 00000000000000000000000000000000 P aa9f091538e44434a211c36698df9e04 [term 3 FOLLOWER]: Refusing update from remote peer 7c552da230014669b01423a8c5d26637: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 3 index: 14. (index mismatch)
I20260808 14:50:40.516629 3550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:40.516203 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:40317 (local address 127.0.0.1:41842)
0808 14:50:40.516381 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:40.516468 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:40317: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260808 14:50:40.517199 3549 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 7c552da230014669b01423a8c5d26637 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa9f091538e44434a211c36698df9e04" member_type: VOTER last_known_addr { host: "127.26.206.252" port: 46475 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260808 14:50:40.517652 3550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:40.517267 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:40317 (local address 127.0.0.1:41852)
0808 14:50:40.517436 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:40.517512 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:40317: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260808 14:50:40.517876 2687 consensus_peers.cc:487] T 00000000000000000000000000000000 P 7c552da230014669b01423a8c5d26637 -> Peer 7ec633ac085e4b5aa53213a2f91b43fa (127.26.206.254:40317): Couldn't send request to peer 7ec633ac085e4b5aa53213a2f91b43fa. Status: Network error: Client connection negotiation failed: client connection to 127.26.206.254:40317: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260808 14:50:40.519944 3556 sys_catalog.cc:455] T 00000000000000000000000000000000 P aa9f091538e44434a211c36698df9e04 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7c552da230014669b01423a8c5d26637. Latest consensus state: current_term: 3 leader_uuid: "7c552da230014669b01423a8c5d26637" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "7ec633ac085e4b5aa53213a2f91b43fa" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 40317 } } peers { permanent_uuid: "7c552da230014669b01423a8c5d26637" member_type: VOTER last_known_addr { host: "127.26.206.253" port: 39527 } attrs { promote: false } } peers { permanent_uuid: "aa9f091538e44434a211c36698df9e04" member_type: VOTER last_known_addr { host: "127.26.206.252" port: 46475 } attrs { promote: false } } }
I20260808 14:50:40.520197 3556 sys_catalog.cc:458] T 00000000000000000000000000000000 P aa9f091538e44434a211c36698df9e04 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 14:50:40.521893 3552 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7c552da230014669b01423a8c5d26637 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "7c552da230014669b01423a8c5d26637" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "7ec633ac085e4b5aa53213a2f91b43fa" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 40317 } } peers { permanent_uuid: "7c552da230014669b01423a8c5d26637" member_type: VOTER last_known_addr { host: "127.26.206.253" port: 39527 } attrs { promote: false } } peers { permanent_uuid: "aa9f091538e44434a211c36698df9e04" member_type: VOTER last_known_addr { host: "127.26.206.252" port: 46475 } attrs { promote: false } } }
I20260808 14:50:40.522167 3552 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7c552da230014669b01423a8c5d26637 [sys.catalog]: This master's current role is: LEADER
I20260808 14:50:40.523481 3556 sys_catalog.cc:455] T 00000000000000000000000000000000 P aa9f091538e44434a211c36698df9e04 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "7c552da230014669b01423a8c5d26637" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "7ec633ac085e4b5aa53213a2f91b43fa" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 40317 } } peers { permanent_uuid: "7c552da230014669b01423a8c5d26637" member_type: VOTER last_known_addr { host: "127.26.206.253" port: 39527 } attrs { promote: false } } peers { permanent_uuid: "aa9f091538e44434a211c36698df9e04" member_type: VOTER last_known_addr { host: "127.26.206.252" port: 46475 } attrs { promote: false } } }
I20260808 14:50:40.523769 3556 sys_catalog.cc:458] T 00000000000000000000000000000000 P aa9f091538e44434a211c36698df9e04 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 14:50:40.537847 3550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:40.529860 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.195:43699 (local address 127.0.0.1:55852)
0808 14:50:40.530048 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:40.530071 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 14:50:40.530185 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:50:40.531356 (+ 1171us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:50:40.531361 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:50:40.531389 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:50:40.531739 (+ 350us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:40.531749 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:40.533300 (+ 1551us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:40.533308 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:40.535405 (+ 2097us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:40.535415 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:40.537031 (+ 1616us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:40.537041 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:40.537244 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:40.537271 (+ 27us) client_negotiation.cc:769] Sending connection context
0808 14:50:40.537385 (+ 114us) client_negotiation.cc:240] Negotiation successful
0808 14:50:40.537548 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":55}
I20260808 14:50:40.537959 3562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:40.530387 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55852 (local address 127.26.206.195:43699)
0808 14:50:40.530951 (+ 564us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:40.530956 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:40.530992 (+ 36us) server_negotiation.cc:407] Connection header received
0808 14:50:40.531052 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:40.531056 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:40.531134 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:40.531863 (+ 729us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:50:40.532054 (+ 191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:40.533123 (+ 1069us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:40.535618 (+ 2495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:40.536772 (+ 1154us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:40.537000 (+ 228us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:40.537095 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:40.537435 (+ 340us) server_negotiation.cc:299] Negotiation successful
0808 14:50:40.537589 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":430,"thread_start_us":730,"threads_started":1}
I20260808 14:50:40.538727 3375 tablet_service.cc:1467] Processing CreateTablet for tablet d82f5db0bb964a8d904762b401625add (DEFAULT_TABLE table=test-table [id=9f5d7d5ff243438789723468f9b584f3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:50:40.539215 3375 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d82f5db0bb964a8d904762b401625add. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:50:40.541388 3566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:40.530650 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.194:34835 (local address 127.0.0.1:60696)
0808 14:50:40.533064 (+ 2414us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:40.533082 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 14:50:40.533275 (+ 193us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:50:40.534374 (+ 1099us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:50:40.534379 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:50:40.534405 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:50:40.534895 (+ 490us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:40.534905 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:40.536896 (+ 1991us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:40.536904 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:40.539014 (+ 2110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:40.539027 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:40.540598 (+ 1571us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:40.540604 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:40.540793 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:40.540831 (+ 38us) client_negotiation.cc:769] Sending connection context
0808 14:50:40.540927 (+ 96us) client_negotiation.cc:240] Negotiation successful
0808 14:50:40.541054 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2284,"thread_start_us":2874,"threads_started":1}
I20260808 14:50:40.542313 3564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:40.530914 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60696 (local address 127.26.206.194:34835)
0808 14:50:40.531493 (+ 579us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:40.531499 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:40.533163 (+ 1664us) server_negotiation.cc:407] Connection header received
0808 14:50:40.533448 (+ 285us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:40.533455 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:40.533538 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:40.533613 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:50:40.535086 (+ 1473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:40.536173 (+ 1087us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:40.539164 (+ 2991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:40.540400 (+ 1236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:40.540552 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:40.540619 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:40.540966 (+ 347us) server_negotiation.cc:299] Negotiation successful
0808 14:50:40.541104 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":435,"thread_start_us":284,"threads_started":1}
I20260808 14:50:40.542827 3563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:40.532479 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.193:36989 (local address 127.0.0.1:60538)
0808 14:50:40.533788 (+ 1309us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:40.533802 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 14:50:40.533901 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:50:40.534206 (+ 305us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:50:40.534209 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:50:40.534226 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:50:40.534603 (+ 377us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:40.534612 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:40.536076 (+ 1464us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:40.536082 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:40.540119 (+ 4037us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:40.540131 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:40.542101 (+ 1970us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:40.542105 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:40.542232 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:40.542253 (+ 21us) client_negotiation.cc:769] Sending connection context
0808 14:50:40.542361 (+ 108us) client_negotiation.cc:240] Negotiation successful
0808 14:50:40.542485 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1189,"thread_start_us":295,"threads_started":1}
I20260808 14:50:40.542876 3565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:40.531827 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60538 (local address 127.26.206.193:36989)
0808 14:50:40.532410 (+ 583us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:40.532416 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:40.533874 (+ 1458us) server_negotiation.cc:407] Connection header received
0808 14:50:40.533996 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:40.534002 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:40.534087 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:40.534189 (+ 102us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:50:40.534767 (+ 578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:40.535907 (+ 1140us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:40.540290 (+ 4383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:40.541708 (+ 1418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:40.541888 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:40.541969 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:40.542390 (+ 421us) server_negotiation.cc:299] Negotiation successful
0808 14:50:40.542531 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":447,"thread_start_us":322,"threads_started":1}
I20260808 14:50:40.543181 3212 tablet_service.cc:1467] Processing CreateTablet for tablet d82f5db0bb964a8d904762b401625add (DEFAULT_TABLE table=test-table [id=9f5d7d5ff243438789723468f9b584f3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:50:40.543669 3212 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d82f5db0bb964a8d904762b401625add. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:50:40.543875 3052 tablet_service.cc:1467] Processing CreateTablet for tablet d82f5db0bb964a8d904762b401625add (DEFAULT_TABLE table=test-table [id=9f5d7d5ff243438789723468f9b584f3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:50:40.544215 3052 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d82f5db0bb964a8d904762b401625add. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:50:40.549892 3568 tablet_bootstrap.cc:492] T d82f5db0bb964a8d904762b401625add P 97ede4953e344ddaa50fe48bebd2c6e1: Bootstrap starting.
I20260808 14:50:40.551330 3567 tablet_bootstrap.cc:492] T d82f5db0bb964a8d904762b401625add P 5baab2df33494b8cb20296450685fed3: Bootstrap starting.
I20260808 14:50:40.552481 3568 tablet_bootstrap.cc:654] T d82f5db0bb964a8d904762b401625add P 97ede4953e344ddaa50fe48bebd2c6e1: Neither blocks nor log segments found. Creating new log.
I20260808 14:50:40.553242 3567 tablet_bootstrap.cc:654] T d82f5db0bb964a8d904762b401625add P 5baab2df33494b8cb20296450685fed3: Neither blocks nor log segments found. Creating new log.
I20260808 14:50:40.554984 3568 tablet_bootstrap.cc:492] T d82f5db0bb964a8d904762b401625add P 97ede4953e344ddaa50fe48bebd2c6e1: No bootstrap required, opened a new log
I20260808 14:50:40.555160 3568 ts_tablet_manager.cc:1397] T d82f5db0bb964a8d904762b401625add P 97ede4953e344ddaa50fe48bebd2c6e1: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260808 14:50:40.556066 3568 raft_consensus.cc:348] T d82f5db0bb964a8d904762b401625add P 97ede4953e344ddaa50fe48bebd2c6e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5baab2df33494b8cb20296450685fed3" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 43699 } } peers { permanent_uuid: "97ede4953e344ddaa50fe48bebd2c6e1" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 36989 } } peers { permanent_uuid: "3883b0f2f9f7452aa7784ad7f79ed570" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 34835 } }
I20260808 14:50:40.556396 3568 raft_consensus.cc:374] T d82f5db0bb964a8d904762b401625add P 97ede4953e344ddaa50fe48bebd2c6e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:50:40.556500 3568 raft_consensus.cc:729] T d82f5db0bb964a8d904762b401625add P 97ede4953e344ddaa50fe48bebd2c6e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97ede4953e344ddaa50fe48bebd2c6e1, State: Initialized, Role: FOLLOWER
I20260808 14:50:40.556737 3568 consensus_queue.cc:260] T d82f5db0bb964a8d904762b401625add P 97ede4953e344ddaa50fe48bebd2c6e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5baab2df33494b8cb20296450685fed3" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 43699 } } peers { permanent_uuid: "97ede4953e344ddaa50fe48bebd2c6e1" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 36989 } } peers { permanent_uuid: "3883b0f2f9f7452aa7784ad7f79ed570" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 34835 } }
I20260808 14:50:40.557051 3567 tablet_bootstrap.cc:492] T d82f5db0bb964a8d904762b401625add P 5baab2df33494b8cb20296450685fed3: No bootstrap required, opened a new log
I20260808 14:50:40.557205 3567 ts_tablet_manager.cc:1397] T d82f5db0bb964a8d904762b401625add P 5baab2df33494b8cb20296450685fed3: Time spent bootstrapping tablet: real 0.006s user 0.003s sys 0.000s
I20260808 14:50:40.558260 3567 raft_consensus.cc:348] T d82f5db0bb964a8d904762b401625add P 5baab2df33494b8cb20296450685fed3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5baab2df33494b8cb20296450685fed3" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 43699 } } peers { permanent_uuid: "97ede4953e344ddaa50fe48bebd2c6e1" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 36989 } } peers { permanent_uuid: "3883b0f2f9f7452aa7784ad7f79ed570" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 34835 } }
I20260808 14:50:40.558568 3569 tablet_bootstrap.cc:492] T d82f5db0bb964a8d904762b401625add P 3883b0f2f9f7452aa7784ad7f79ed570: Bootstrap starting.
I20260808 14:50:40.558552 3567 raft_consensus.cc:374] T d82f5db0bb964a8d904762b401625add P 5baab2df33494b8cb20296450685fed3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:50:40.558657 3567 raft_consensus.cc:729] T d82f5db0bb964a8d904762b401625add P 5baab2df33494b8cb20296450685fed3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5baab2df33494b8cb20296450685fed3, State: Initialized, Role: FOLLOWER
I20260808 14:50:40.558907 3567 consensus_queue.cc:260] T d82f5db0bb964a8d904762b401625add P 5baab2df33494b8cb20296450685fed3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5baab2df33494b8cb20296450685fed3" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 43699 } } peers { permanent_uuid: "97ede4953e344ddaa50fe48bebd2c6e1" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 36989 } } peers { permanent_uuid: "3883b0f2f9f7452aa7784ad7f79ed570" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 34835 } }
I20260808 14:50:40.559855 3567 ts_tablet_manager.cc:1428] T d82f5db0bb964a8d904762b401625add P 5baab2df33494b8cb20296450685fed3: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 14:50:40.561254 3569 tablet_bootstrap.cc:654] T d82f5db0bb964a8d904762b401625add P 3883b0f2f9f7452aa7784ad7f79ed570: Neither blocks nor log segments found. Creating new log.
I20260808 14:50:40.561326 3548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:40.560668 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:40317 (local address 127.26.206.195:58585)
0808 14:50:40.561091 (+ 423us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:40.561182 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:40317: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":302}
I20260808 14:50:40.562646 3548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:40.561941 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:40317 (local address 127.26.206.195:33683)
0808 14:50:40.562327 (+ 386us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:40.562452 (+ 125us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:40317: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":258}
I20260808 14:50:40.566318 3450 heartbeater.cc:503] Master 127.26.206.253:39527 was elected leader, sending a full tablet report...
I20260808 14:50:40.567145 3568 ts_tablet_manager.cc:1428] T d82f5db0bb964a8d904762b401625add P 97ede4953e344ddaa50fe48bebd2c6e1: Time spent starting tablet: real 0.012s user 0.011s sys 0.000s
I20260808 14:50:40.568854 3547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:40.568413 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:40317 (local address 127.26.206.193:59055)
0808 14:50:40.568571 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:40.568666 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:40317: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
I20260808 14:50:40.569243 3569 tablet_bootstrap.cc:492] T d82f5db0bb964a8d904762b401625add P 3883b0f2f9f7452aa7784ad7f79ed570: No bootstrap required, opened a new log
I20260808 14:50:40.569447 3569 ts_tablet_manager.cc:1397] T d82f5db0bb964a8d904762b401625add P 3883b0f2f9f7452aa7784ad7f79ed570: Time spent bootstrapping tablet: real 0.011s user 0.009s sys 0.000s
I20260808 14:50:40.570255 3547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:40.569834 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:40317 (local address 127.26.206.193:50753)
0808 14:50:40.569978 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:40.570095 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:40317: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260808 14:50:40.570240 3569 raft_consensus.cc:348] T d82f5db0bb964a8d904762b401625add P 3883b0f2f9f7452aa7784ad7f79ed570 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5baab2df33494b8cb20296450685fed3" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 43699 } } peers { permanent_uuid: "97ede4953e344ddaa50fe48bebd2c6e1" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 36989 } } peers { permanent_uuid: "3883b0f2f9f7452aa7784ad7f79ed570" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 34835 } }
I20260808 14:50:40.570533 3569 raft_consensus.cc:374] T d82f5db0bb964a8d904762b401625add P 3883b0f2f9f7452aa7784ad7f79ed570 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:50:40.570660 3569 raft_consensus.cc:729] T d82f5db0bb964a8d904762b401625add P 3883b0f2f9f7452aa7784ad7f79ed570 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3883b0f2f9f7452aa7784ad7f79ed570, State: Initialized, Role: FOLLOWER
I20260808 14:50:40.570940 3569 consensus_queue.cc:260] T d82f5db0bb964a8d904762b401625add P 3883b0f2f9f7452aa7784ad7f79ed570 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5baab2df33494b8cb20296450685fed3" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 43699 } } peers { permanent_uuid: "97ede4953e344ddaa50fe48bebd2c6e1" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 36989 } } peers { permanent_uuid: "3883b0f2f9f7452aa7784ad7f79ed570" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 34835 } }
I20260808 14:50:40.571815 3569 ts_tablet_manager.cc:1428] T d82f5db0bb964a8d904762b401625add P 3883b0f2f9f7452aa7784ad7f79ed570: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 14:50:40.572494 3545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:40.572106 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:40317 (local address 127.26.206.194:56621)
0808 14:50:40.572265 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:40.572356 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:40317: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260808 14:50:40.573436 3545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:40.573111 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:40317 (local address 127.26.206.194:45191)
0808 14:50:40.573230 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:40.573309 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:40317: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
I20260808 14:50:40.574527 3290 heartbeater.cc:503] Master 127.26.206.253:39527 was elected leader, sending a full tablet report...
I20260808 14:50:40.652936 3573 raft_consensus.cc:482] T d82f5db0bb964a8d904762b401625add P 97ede4953e344ddaa50fe48bebd2c6e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:50:40.653337 3573 raft_consensus.cc:504] T d82f5db0bb964a8d904762b401625add P 97ede4953e344ddaa50fe48bebd2c6e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5baab2df33494b8cb20296450685fed3" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 43699 } } peers { permanent_uuid: "97ede4953e344ddaa50fe48bebd2c6e1" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 36989 } } peers { permanent_uuid: "3883b0f2f9f7452aa7784ad7f79ed570" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 34835 } }
I20260808 14:50:40.655213 3573 leader_election.cc:288] T d82f5db0bb964a8d904762b401625add P 97ede4953e344ddaa50fe48bebd2c6e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5baab2df33494b8cb20296450685fed3 (127.26.206.195:43699), 3883b0f2f9f7452aa7784ad7f79ed570 (127.26.206.194:34835)
I20260808 14:50:40.662148 3562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:40.655601 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.193:51273 (local address 127.26.206.195:43699)
0808 14:50:40.655835 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:40.655840 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:40.655864 (+ 24us) server_negotiation.cc:407] Connection header received
0808 14:50:40.656136 (+ 272us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:40.656146 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:40.656248 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:40.656369 (+ 121us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:50:40.657285 (+ 916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:40.658079 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:40.660160 (+ 2081us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:40.661079 (+ 919us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:40.661298 (+ 219us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:40.661385 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:40.661690 (+ 305us) server_negotiation.cc:299] Negotiation successful
0808 14:50:40.661850 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260808 14:50:40.662202 3547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:40.655524 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.195:43699 (local address 127.26.206.193:51273)
0808 14:50:40.655753 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:40.655783 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0808 14:50:40.655923 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:50:40.656628 (+ 705us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:50:40.656636 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:50:40.656684 (+ 48us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:50:40.657106 (+ 422us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:40.657125 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:40.658230 (+ 1105us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:40.658239 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:40.659980 (+ 1741us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:40.659992 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:40.661306 (+ 1314us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:40.661312 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:40.661514 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:40.661539 (+ 25us) client_negotiation.cc:769] Sending connection context
0808 14:50:40.661664 (+ 125us) client_negotiation.cc:240] Negotiation successful
0808 14:50:40.661868 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":81,"mutex_wait_us":4}
I20260808 14:50:40.662385 3564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:40.656228 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.193:37659 (local address 127.26.206.194:34835)
0808 14:50:40.656472 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:40.656478 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:40.657142 (+ 664us) server_negotiation.cc:407] Connection header received
0808 14:50:40.657313 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:40.657329 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:40.657409 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:40.657509 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:50:40.658003 (+ 494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:40.658715 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:40.660530 (+ 1815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:40.661403 (+ 873us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:40.661596 (+ 193us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:40.661669 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:40.662025 (+ 356us) server_negotiation.cc:299] Negotiation successful
0808 14:50:40.662144 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260808 14:50:40.662542 3578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:40.655968 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.194:34835 (local address 127.26.206.193:37659)
0808 14:50:40.657010 (+ 1042us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:40.657033 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 14:50:40.657173 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:50:40.657528 (+ 355us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:50:40.657532 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:50:40.657555 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:50:40.657854 (+ 299us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:40.657861 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:40.658857 (+ 996us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:40.658864 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:40.660382 (+ 1518us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:40.660393 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:40.661641 (+ 1248us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:40.661648 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:40.661833 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:40.661895 (+ 62us) client_negotiation.cc:769] Sending connection context
0808 14:50:40.661998 (+ 103us) client_negotiation.cc:240] Negotiation successful
0808 14:50:40.662123 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":881,"mutex_wait_us":1,"thread_start_us":621,"threads_started":1}
I20260808 14:50:40.663254 3233 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d82f5db0bb964a8d904762b401625add" candidate_uuid: "97ede4953e344ddaa50fe48bebd2c6e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3883b0f2f9f7452aa7784ad7f79ed570" is_pre_election: true
I20260808 14:50:40.663501 3233 raft_consensus.cc:2454] T d82f5db0bb964a8d904762b401625add P 3883b0f2f9f7452aa7784ad7f79ed570 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 97ede4953e344ddaa50fe48bebd2c6e1 in term 0.
I20260808 14:50:40.663424 3397 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d82f5db0bb964a8d904762b401625add" candidate_uuid: "97ede4953e344ddaa50fe48bebd2c6e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5baab2df33494b8cb20296450685fed3" is_pre_election: true
I20260808 14:50:40.664002 3397 raft_consensus.cc:2454] T d82f5db0bb964a8d904762b401625add P 5baab2df33494b8cb20296450685fed3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 97ede4953e344ddaa50fe48bebd2c6e1 in term 0.
I20260808 14:50:40.664108 3002 leader_election.cc:302] T d82f5db0bb964a8d904762b401625add P 97ede4953e344ddaa50fe48bebd2c6e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3883b0f2f9f7452aa7784ad7f79ed570, 97ede4953e344ddaa50fe48bebd2c6e1; no voters:
I20260808 14:50:40.664548 3573 raft_consensus.cc:2781] T d82f5db0bb964a8d904762b401625add P 97ede4953e344ddaa50fe48bebd2c6e1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:50:40.664686 3573 raft_consensus.cc:482] T d82f5db0bb964a8d904762b401625add P 97ede4953e344ddaa50fe48bebd2c6e1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:50:40.664815 3573 raft_consensus.cc:3037] T d82f5db0bb964a8d904762b401625add P 97ede4953e344ddaa50fe48bebd2c6e1 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:50:40.667141 3573 raft_consensus.cc:504] T d82f5db0bb964a8d904762b401625add P 97ede4953e344ddaa50fe48bebd2c6e1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5baab2df33494b8cb20296450685fed3" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 43699 } } peers { permanent_uuid: "97ede4953e344ddaa50fe48bebd2c6e1" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 36989 } } peers { permanent_uuid: "3883b0f2f9f7452aa7784ad7f79ed570" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 34835 } }
I20260808 14:50:40.667851 3573 leader_election.cc:288] T d82f5db0bb964a8d904762b401625add P 97ede4953e344ddaa50fe48bebd2c6e1 [CANDIDATE]: Term 1 election: Requested vote from peers 5baab2df33494b8cb20296450685fed3 (127.26.206.195:43699), 3883b0f2f9f7452aa7784ad7f79ed570 (127.26.206.194:34835)
I20260808 14:50:40.668360 3397 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d82f5db0bb964a8d904762b401625add" candidate_uuid: "97ede4953e344ddaa50fe48bebd2c6e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5baab2df33494b8cb20296450685fed3"
I20260808 14:50:40.668432 3233 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d82f5db0bb964a8d904762b401625add" candidate_uuid: "97ede4953e344ddaa50fe48bebd2c6e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3883b0f2f9f7452aa7784ad7f79ed570"
I20260808 14:50:40.668589 3397 raft_consensus.cc:3037] T d82f5db0bb964a8d904762b401625add P 5baab2df33494b8cb20296450685fed3 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:50:40.668619 3233 raft_consensus.cc:3037] T d82f5db0bb964a8d904762b401625add P 3883b0f2f9f7452aa7784ad7f79ed570 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:50:40.671607 3233 raft_consensus.cc:2454] T d82f5db0bb964a8d904762b401625add P 3883b0f2f9f7452aa7784ad7f79ed570 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97ede4953e344ddaa50fe48bebd2c6e1 in term 1.
I20260808 14:50:40.671689 3397 raft_consensus.cc:2454] T d82f5db0bb964a8d904762b401625add P 5baab2df33494b8cb20296450685fed3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97ede4953e344ddaa50fe48bebd2c6e1 in term 1.
I20260808 14:50:40.672001 3002 leader_election.cc:302] T d82f5db0bb964a8d904762b401625add P 97ede4953e344ddaa50fe48bebd2c6e1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3883b0f2f9f7452aa7784ad7f79ed570, 97ede4953e344ddaa50fe48bebd2c6e1; no voters:
I20260808 14:50:40.672335 3573 raft_consensus.cc:2781] T d82f5db0bb964a8d904762b401625add P 97ede4953e344ddaa50fe48bebd2c6e1 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:50:40.672804 3573 raft_consensus.cc:686] T d82f5db0bb964a8d904762b401625add P 97ede4953e344ddaa50fe48bebd2c6e1 [term 1 LEADER]: Becoming Leader. State: Replica: 97ede4953e344ddaa50fe48bebd2c6e1, State: Running, Role: LEADER
I20260808 14:50:40.673070 3127 heartbeater.cc:503] Master 127.26.206.253:39527 was elected leader, sending a full tablet report...
I20260808 14:50:40.673238 3573 consensus_queue.cc:237] T d82f5db0bb964a8d904762b401625add P 97ede4953e344ddaa50fe48bebd2c6e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5baab2df33494b8cb20296450685fed3" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 43699 } } peers { permanent_uuid: "97ede4953e344ddaa50fe48bebd2c6e1" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 36989 } } peers { permanent_uuid: "3883b0f2f9f7452aa7784ad7f79ed570" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 34835 } }
I20260808 14:50:40.673820 3578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:40.673395 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:40317 (local address 127.26.206.193:46491)
0808 14:50:40.673525 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:40.673662 (+ 137us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:40317: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260808 14:50:40.676353 3578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:40.675853 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:40317 (local address 127.26.206.193:39383)
0808 14:50:40.676062 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:40.676198 (+ 136us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:40317: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120}
I20260808 14:50:40.677282 2700 catalog_manager.cc:5495] T d82f5db0bb964a8d904762b401625add P 97ede4953e344ddaa50fe48bebd2c6e1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 97ede4953e344ddaa50fe48bebd2c6e1 (127.26.206.193). New cstate: current_term: 1 leader_uuid: "97ede4953e344ddaa50fe48bebd2c6e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5baab2df33494b8cb20296450685fed3" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 43699 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "97ede4953e344ddaa50fe48bebd2c6e1" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 36989 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3883b0f2f9f7452aa7784ad7f79ed570" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 34835 } health_report { overall_health: UNKNOWN } } }
I20260808 14:50:40.697582 3565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:40.692336 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60540 (local address 127.26.206.193:36989)
0808 14:50:40.692505 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:40.692511 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:40.692597 (+ 86us) server_negotiation.cc:407] Connection header received
0808 14:50:40.692876 (+ 279us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:40.692880 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:40.692949 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:40.693095 (+ 146us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:50:40.693485 (+ 390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:40.694154 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:40.695455 (+ 1301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:40.695948 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:40.696082 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:40.696493 (+ 411us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:50:40.697002 (+ 509us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:50:40.697151 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:40.697230 (+ 79us) server_negotiation.cc:299] Negotiation successful
0808 14:50:40.697332 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260808 14:50:40.701730 3233 raft_consensus.cc:1261] T d82f5db0bb964a8d904762b401625add P 3883b0f2f9f7452aa7784ad7f79ed570 [term 1 FOLLOWER]: Refusing update from remote peer 97ede4953e344ddaa50fe48bebd2c6e1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:50:40.702052 3397 raft_consensus.cc:1261] T d82f5db0bb964a8d904762b401625add P 5baab2df33494b8cb20296450685fed3 [term 1 FOLLOWER]: Refusing update from remote peer 97ede4953e344ddaa50fe48bebd2c6e1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:50:40.702428 3579 consensus_queue.cc:1035] T d82f5db0bb964a8d904762b401625add P 97ede4953e344ddaa50fe48bebd2c6e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3883b0f2f9f7452aa7784ad7f79ed570" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 34835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:50:40.702821 3573 consensus_queue.cc:1035] T d82f5db0bb964a8d904762b401625add P 97ede4953e344ddaa50fe48bebd2c6e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5baab2df33494b8cb20296450685fed3" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 43699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:50:40.705065 3545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:40.704561 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:40317 (local address 127.26.206.194:57707)
0808 14:50:40.704776 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:40.704869 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:40317: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111}
I20260808 14:50:40.705821 3548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:40.705439 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:40317 (local address 127.26.206.195:35981)
0808 14:50:40.705571 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:40.705655 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:40317: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260808 14:50:40.708559 3291 tablet.cc:2369] T d82f5db0bb964a8d904762b401625add P 3883b0f2f9f7452aa7784ad7f79ed570: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:50:40.710846 3582 mvcc.cc:205] Tried to move back new op lower bound from 7316277824306733056 to 7316277824202207232. Current Snapshot: MvccSnapshot[applied={T|T < 7316277824306733056}]
I20260808 14:50:40.711978 3583 mvcc.cc:205] Tried to move back new op lower bound from 7316277824306733056 to 7316277824202207232. Current Snapshot: MvccSnapshot[applied={T|T < 7316277824306733056}]
I20260808 14:50:40.712177 3548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:40.711678 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:40317 (local address 127.26.206.195:38641)
0808 14:50:40.711922 (+ 244us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:40.712018 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:40317: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123}
I20260808 14:50:40.713464 3578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:40.712814 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:40317 (local address 127.26.206.193:59051)
0808 14:50:40.713118 (+ 304us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:40.713271 (+ 153us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:40317: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":135}
I20260808 14:50:40.715001 3545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:40.714304 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:40317 (local address 127.26.206.194:58105)
0808 14:50:40.714676 (+ 372us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:40.714795 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:40317: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":223}
I20260808 14:50:40.718710 3584 mvcc.cc:205] Tried to move back new op lower bound from 7316277824306733056 to 7316277824202207232. Current Snapshot: MvccSnapshot[applied={T|T < 7316277824306733056 or (T in {7316277824306733056})}]
I20260808 14:50:40.725538 2700 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54030:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:50:40.725806 2700 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54030:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:50:40.731839 2700 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7c552da230014669b01423a8c5d26637: Sending DeleteTablet for 3 replicas of tablet d82f5db0bb964a8d904762b401625add
I20260808 14:50:40.732905 3052 tablet_service.cc:1514] Processing DeleteTablet for tablet d82f5db0bb964a8d904762b401625add with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:50:40 UTC) from {username='oryx', principal='oryx/127.26.206.253@KRBTEST.COM'} at 127.0.0.1:60538
I20260808 14:50:40.732955 3375 tablet_service.cc:1514] Processing DeleteTablet for tablet d82f5db0bb964a8d904762b401625add with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:50:40 UTC) from {username='oryx', principal='oryx/127.26.206.253@KRBTEST.COM'} at 127.0.0.1:55852
I20260808 14:50:40.732963 3212 tablet_service.cc:1514] Processing DeleteTablet for tablet d82f5db0bb964a8d904762b401625add with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:50:40 UTC) from {username='oryx', principal='oryx/127.26.206.253@KRBTEST.COM'} at 127.0.0.1:60696
I20260808 14:50:40.737134 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 2890
I20260808 14:50:40.754582 3593 tablet_replica.cc:330] T d82f5db0bb964a8d904762b401625add P 3883b0f2f9f7452aa7784ad7f79ed570: stopping tablet replica
I20260808 14:50:40.754897 3592 tablet_replica.cc:330] T d82f5db0bb964a8d904762b401625add P 5baab2df33494b8cb20296450685fed3: stopping tablet replica
I20260808 14:50:40.754935 3593 raft_consensus.cc:2229] T d82f5db0bb964a8d904762b401625add P 3883b0f2f9f7452aa7784ad7f79ed570 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:50:40.755312 3593 raft_consensus.cc:2258] T d82f5db0bb964a8d904762b401625add P 3883b0f2f9f7452aa7784ad7f79ed570 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:50:40.755537 3591 tablet_replica.cc:330] T d82f5db0bb964a8d904762b401625add P 97ede4953e344ddaa50fe48bebd2c6e1: stopping tablet replica
I20260808 14:50:40.755834 3592 raft_consensus.cc:2229] T d82f5db0bb964a8d904762b401625add P 5baab2df33494b8cb20296450685fed3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:50:40.756156 3592 raft_consensus.cc:2258] T d82f5db0bb964a8d904762b401625add P 5baab2df33494b8cb20296450685fed3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:50:40.756348 3591 raft_consensus.cc:2229] T d82f5db0bb964a8d904762b401625add P 97ede4953e344ddaa50fe48bebd2c6e1 [term 1 LEADER]: Raft consensus shutting down.
I20260808 14:50:40.756630 3593 ts_tablet_manager.cc:1905] T d82f5db0bb964a8d904762b401625add P 3883b0f2f9f7452aa7784ad7f79ed570: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:50:40.757050 3591 raft_consensus.cc:2258] T d82f5db0bb964a8d904762b401625add P 97ede4953e344ddaa50fe48bebd2c6e1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:50:40.757390 3592 ts_tablet_manager.cc:1905] T d82f5db0bb964a8d904762b401625add P 5baab2df33494b8cb20296450685fed3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:50:40.758667 3591 ts_tablet_manager.cc:1905] T d82f5db0bb964a8d904762b401625add P 97ede4953e344ddaa50fe48bebd2c6e1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:50:40.763326 3593 ts_tablet_manager.cc:1918] T d82f5db0bb964a8d904762b401625add P 3883b0f2f9f7452aa7784ad7f79ed570: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:50:40.763504 3593 log.cc:1196] T d82f5db0bb964a8d904762b401625add P 3883b0f2f9f7452aa7784ad7f79ed570: Deleting WAL directory at /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/ts-1/wal/wals/d82f5db0bb964a8d904762b401625add
I20260808 14:50:40.763873 3592 ts_tablet_manager.cc:1918] T d82f5db0bb964a8d904762b401625add P 5baab2df33494b8cb20296450685fed3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:50:40.764008 3592 log.cc:1196] T d82f5db0bb964a8d904762b401625add P 5baab2df33494b8cb20296450685fed3: Deleting WAL directory at /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/ts-2/wal/wals/d82f5db0bb964a8d904762b401625add
I20260808 14:50:40.764379 3593 ts_tablet_manager.cc:1939] T d82f5db0bb964a8d904762b401625add P 3883b0f2f9f7452aa7784ad7f79ed570: Deleting consensus metadata
I20260808 14:50:40.764453 3592 ts_tablet_manager.cc:1939] T d82f5db0bb964a8d904762b401625add P 5baab2df33494b8cb20296450685fed3: Deleting consensus metadata
I20260808 14:50:40.765604 2684 catalog_manager.cc:4841] TS 5baab2df33494b8cb20296450685fed3 (127.26.206.195:43699): tablet d82f5db0bb964a8d904762b401625add (table test-table [id=9f5d7d5ff243438789723468f9b584f3]) successfully deleted
I20260808 14:50:40.765956 2684 catalog_manager.cc:4841] TS 3883b0f2f9f7452aa7784ad7f79ed570 (127.26.206.194:34835): tablet d82f5db0bb964a8d904762b401625add (table test-table [id=9f5d7d5ff243438789723468f9b584f3]) successfully deleted
I20260808 14:50:40.766155 3591 ts_tablet_manager.cc:1918] T d82f5db0bb964a8d904762b401625add P 97ede4953e344ddaa50fe48bebd2c6e1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:50:40.766357 3591 log.cc:1196] T d82f5db0bb964a8d904762b401625add P 97ede4953e344ddaa50fe48bebd2c6e1: Deleting WAL directory at /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200577490656-27451-0/minicluster-data/ts-0/wal/wals/d82f5db0bb964a8d904762b401625add
I20260808 14:50:40.766844 3591 ts_tablet_manager.cc:1939] T d82f5db0bb964a8d904762b401625add P 97ede4953e344ddaa50fe48bebd2c6e1: Deleting consensus metadata
I20260808 14:50:40.767843 2687 catalog_manager.cc:4841] TS 97ede4953e344ddaa50fe48bebd2c6e1 (127.26.206.193:36989): tablet d82f5db0bb964a8d904762b401625add (table test-table [id=9f5d7d5ff243438789723468f9b584f3]) successfully deleted
I20260808 14:50:40.768988 3565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:40.738701 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60554 (local address 127.26.206.193:36989)
0808 14:50:40.738883 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:40.738889 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:40.742294 (+ 3405us) server_negotiation.cc:407] Connection header received
0808 14:50:40.743320 (+ 1026us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:40.743333 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:40.743438 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:40.743557 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:40.748222 (+ 4665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:40.749886 (+ 1664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:40.756545 (+ 6659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:40.757207 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:40.757319 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:40.761197 (+ 3878us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:50:40.761211 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:50:40.761230 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:50:40.761291 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:50:40.765519 (+ 4228us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:40.766402 (+ 883us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:40.766411 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:40.766415 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:40.766593 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:40.767084 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:40.767089 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:40.767093 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:40.767628 (+ 535us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:50:40.767964 (+ 336us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:40.768539 (+ 575us) server_negotiation.cc:299] Negotiation successful
0808 14:50:40.768711 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260808 14:50:40.769706 3119 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:50:40.872427 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 2890
I20260808 14:50:40.895555 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 3140
I20260808 14:50:40.908895 3564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:40.896389 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60698 (local address 127.26.206.194:34835)
0808 14:50:40.896583 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:40.896589 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:40.896664 (+ 75us) server_negotiation.cc:407] Connection header received
0808 14:50:40.896875 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:40.896881 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:40.896945 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:40.897048 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:40.898286 (+ 1238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:40.899053 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:40.900431 (+ 1378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:40.900844 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:40.900975 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:40.903418 (+ 2443us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:50:40.903433 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:50:40.903449 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:50:40.903492 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:50:40.906162 (+ 2670us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:40.906809 (+ 647us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:40.906816 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:40.906818 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:40.906950 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:40.907324 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:40.907332 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:40.907335 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:40.907733 (+ 398us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:50:40.908040 (+ 307us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:40.908312 (+ 272us) server_negotiation.cc:299] Negotiation successful
0808 14:50:40.908529 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260808 14:50:40.909559 3282 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:50:41.003614 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 3140
I20260808 14:50:41.024683 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 3302
I20260808 14:50:41.038380 3562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:41.025445 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55858 (local address 127.26.206.195:43699)
0808 14:50:41.025631 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:41.025646 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:41.025698 (+ 52us) server_negotiation.cc:407] Connection header received
0808 14:50:41.025919 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:41.025924 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:41.025988 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:41.026090 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:41.027457 (+ 1367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:41.028257 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:41.029472 (+ 1215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:41.029869 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:41.030006 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:41.032650 (+ 2644us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:50:41.032665 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:50:41.032687 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:50:41.032729 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:50:41.035444 (+ 2715us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:41.036104 (+ 660us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:41.036112 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:41.036116 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:41.036249 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:41.036621 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:41.036626 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:41.036630 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:41.037028 (+ 398us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:50:41.037331 (+ 303us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:41.037662 (+ 331us) server_negotiation.cc:299] Negotiation successful
0808 14:50:41.037896 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260808 14:50:41.039079 3440 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:50:41.044782 3598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:41.044020 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:40317 (local address 127.0.0.1:41868)
0808 14:50:41.044479 (+ 459us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:41.044584 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:40317: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":329,"thread_start_us":220,"threads_started":1}
I20260808 14:50:41.046075 3598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:41.045670 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:40317 (local address 127.0.0.1:41872)
0808 14:50:41.045858 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:41.045949 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:40317: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
I20260808 14:50:41.159291 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 3302
I20260808 14:50:41.184264 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 2534
I20260808 14:50:41.185295 2734 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:50:41.308270 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 2534
I20260808 14:50:41.333528 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 2655
I20260808 14:50:41.334714 2956 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:50:41.452963 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 2655
2026-08-08T14:50:41Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (11452 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200577490656-27451-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:50:41 dist-test-slave-6k22 krb5kdc[3604](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:50:41 dist-test-slave-6k22 krb5kdc[3604](info): set up 2 sockets
Aug 08 14:50:41 dist-test-slave-6k22 krb5kdc[3604](info): commencing operation
krb5kdc: starting...
W20260808 14:50:42.640360 27451 mini_kdc.cc:121] Time spent starting KDC: real 1.137s user 0.001s sys 0.031s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200577490656-27451-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200577490656-27451-0/krb5kdc/test-user.keytab.
Aug 08 14:50:42 dist-test-slave-6k22 krb5kdc[3604](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200642, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:50:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:50:42Z Disabled control of system clock
WARNING: no policy specified for oryx/127.26.206.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.206.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.206.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200577490656-27451-0/krb5kdc/oryx_127.26.206.254.keytab.
Entry for principal oryx/127.26.206.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200577490656-27451-0/krb5kdc/oryx_127.26.206.254.keytab.
I20260808 14:50:42.874122 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200577490656-27451-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200577490656-27451-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200577490656-27451-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.206.254:33743
--webserver_interface=127.26.206.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200577490656-27451-0/krb5kdc/oryx_127.26.206.254.keytab
--principal=oryx/127.26.206.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.206.212:39179
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.206.254:33743
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:50:43.216796 3621 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:50:43.217104 3621 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:50:43.217275 3621 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:50:43.224654 3621 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:50:43.224807 3621 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260808 14:50:43.224889 3621 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:50:43.224998 3621 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:50:43.225085 3621 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:50:43.225203 3621 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:50:43.234562 3621 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:39179
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200577490656-27451-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200577490656-27451-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.206.254:33743
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200577490656-27451-0/krb5kdc/oryx_127.26.206.254.keytab
--principal=oryx/127.26.206.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.206.254:33743
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.206.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200577490656-27451-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:50:43.235801 3621 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:50:43.237125 3621 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:50:43.249184 3629 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:50:43.249251 3628 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:50:43.249231 3631 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:50:43.249914 3621 server_base.cc:1034] running on GCE node
I20260808 14:50:43.250694 3621 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:50:43.252053 3621 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:50:43.253310 3621 hybrid_clock.cc:648] HybridClock initialized: now 1786200643253241 us; error 53 us; skew 500 ppm
I20260808 14:50:43.253641 3621 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:50:43 dist-test-slave-6k22 krb5kdc[3604](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200643, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.206.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:50:43.256807 3621 init.cc:377] Logged in from keytab as oryx/127.26.206.254@KRBTEST.COM (short username oryx)
I20260808 14:50:43.258185 3621 webserver.cc:460] Webserver started at http://127.26.206.254:45367/ using document root <none> and password file <none>
I20260808 14:50:43.258873 3621 fs_manager.cc:359] Metadata directory not provided
I20260808 14:50:43.259008 3621 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:50:43.259339 3621 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:50:43.262251 3621 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200577490656-27451-0/minicluster-data/master-0/data/instance:
uuid: "d4216fed87a840f587a730f82785f89a"
format_stamp: "Formatted at 2026-08-08 14:50:43 on dist-test-slave-6k22"
server_key: "b61ca8c4858cfbc9e9bb605e72882e44"
server_key_iv: "f564ae59d284e5c71f68bdb05c4ffa17"
server_key_version: "encryptionkey@0"
I20260808 14:50:43.263039 3621 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200577490656-27451-0/minicluster-data/master-0/wal/instance:
uuid: "d4216fed87a840f587a730f82785f89a"
format_stamp: "Formatted at 2026-08-08 14:50:43 on dist-test-slave-6k22"
server_key: "b61ca8c4858cfbc9e9bb605e72882e44"
server_key_iv: "f564ae59d284e5c71f68bdb05c4ffa17"
server_key_version: "encryptionkey@0"
I20260808 14:50:43.268139 3621 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.008s sys 0.000s
I20260808 14:50:43.271399 3638 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:50:43.272718 3621 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 14:50:43.272900 3621 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200577490656-27451-0/minicluster-data/master-0/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200577490656-27451-0/minicluster-data/master-0/wal
uuid: "d4216fed87a840f587a730f82785f89a"
format_stamp: "Formatted at 2026-08-08 14:50:43 on dist-test-slave-6k22"
server_key: "b61ca8c4858cfbc9e9bb605e72882e44"
server_key_iv: "f564ae59d284e5c71f68bdb05c4ffa17"
server_key_version: "encryptionkey@0"
I20260808 14:50:43.273115 3621 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200577490656-27451-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200577490656-27451-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200577490656-27451-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:50:43.286746 3621 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:50:43.290818 3621 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:50:43.291087 3621 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:50:43.312666 3621 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.254:33743
I20260808 14:50:43.312700 3704 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.254:33743 every 8 connection(s)
I20260808 14:50:43.314008 3621 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
I20260808 14:50:43.316382 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 3621
I20260808 14:50:43.316619 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200577490656-27451-0/minicluster-data/master-0/wal/instance
I20260808 14:50:43.317447 27451 external_mini_cluster.cc:1428] Setting key 9c3682eeafa6d1e3c3914a7458a2046e
I20260808 14:50:43.318316 3705 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:50:43.330084 3705 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d4216fed87a840f587a730f82785f89a: Bootstrap starting.
Aug 08 14:50:43 dist-test-slave-6k22 krb5kdc[3604](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200642, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.26.206.254@KRBTEST.COM
I20260808 14:50:43.333541 3705 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d4216fed87a840f587a730f82785f89a: Neither blocks nor log segments found. Creating new log.
I20260808 14:50:43.334604 3705 log.cc:824] T 00000000000000000000000000000000 P d4216fed87a840f587a730f82785f89a: Log is configured to *not* fsync() on all Append() calls
I20260808 14:50:43.337373 3705 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d4216fed87a840f587a730f82785f89a: No bootstrap required, opened a new log
I20260808 14:50:43.338743 3708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:43.319522 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58244 (local address 127.26.206.254:33743)
0808 14:50:43.320308 (+ 786us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:43.320318 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:43.320353 (+ 35us) server_negotiation.cc:407] Connection header received
0808 14:50:43.321897 (+ 1544us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:43.321937 (+ 40us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:43.322360 (+ 423us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:43.322736 (+ 376us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:43.324241 (+ 1505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:43.325554 (+ 1313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:43.326755 (+ 1201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:43.327439 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:43.327660 (+ 221us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:43.331703 (+ 4043us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:50:43.331711 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:50:43.331724 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:50:43.331761 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:50:43.334816 (+ 3055us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:43.335501 (+ 685us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:43.335526 (+ 25us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:43.335531 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:43.335759 (+ 228us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:43.336137 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:43.336142 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:43.336145 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:43.336651 (+ 506us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:50:43.336962 (+ 311us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:43.337396 (+ 434us) server_negotiation.cc:299] Negotiation successful
0808 14:50:43.337809 (+ 413us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":571,"thread_start_us":358,"threads_started":1}
I20260808 14:50:43.345005 3705 raft_consensus.cc:348] T 00000000000000000000000000000000 P d4216fed87a840f587a730f82785f89a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d4216fed87a840f587a730f82785f89a" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 33743 } }
I20260808 14:50:43.345364 3705 raft_consensus.cc:374] T 00000000000000000000000000000000 P d4216fed87a840f587a730f82785f89a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:50:43.345485 3705 raft_consensus.cc:729] T 00000000000000000000000000000000 P d4216fed87a840f587a730f82785f89a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4216fed87a840f587a730f82785f89a, State: Initialized, Role: FOLLOWER
I20260808 14:50:43.346012 3705 consensus_queue.cc:260] T 00000000000000000000000000000000 P d4216fed87a840f587a730f82785f89a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d4216fed87a840f587a730f82785f89a" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 33743 } }
I20260808 14:50:43.346246 3705 raft_consensus.cc:388] T 00000000000000000000000000000000 P d4216fed87a840f587a730f82785f89a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:50:43.346387 3705 raft_consensus.cc:482] T 00000000000000000000000000000000 P d4216fed87a840f587a730f82785f89a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:50:43.346562 3705 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d4216fed87a840f587a730f82785f89a [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:50:43.348939 3705 raft_consensus.cc:504] T 00000000000000000000000000000000 P d4216fed87a840f587a730f82785f89a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d4216fed87a840f587a730f82785f89a" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 33743 } }
I20260808 14:50:43.349419 3705 leader_election.cc:302] T 00000000000000000000000000000000 P d4216fed87a840f587a730f82785f89a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d4216fed87a840f587a730f82785f89a; no voters:
I20260808 14:50:43.349951 3705 leader_election.cc:288] T 00000000000000000000000000000000 P d4216fed87a840f587a730f82785f89a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:50:43.350072 3710 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d4216fed87a840f587a730f82785f89a [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:50:43.350811 3710 raft_consensus.cc:686] T 00000000000000000000000000000000 P d4216fed87a840f587a730f82785f89a [term 1 LEADER]: Becoming Leader. State: Replica: d4216fed87a840f587a730f82785f89a, State: Running, Role: LEADER
I20260808 14:50:43.351320 3710 consensus_queue.cc:237] T 00000000000000000000000000000000 P d4216fed87a840f587a730f82785f89a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d4216fed87a840f587a730f82785f89a" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 33743 } }
I20260808 14:50:43.352066 3705 sys_catalog.cc:564] T 00000000000000000000000000000000 P d4216fed87a840f587a730f82785f89a [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:50:43.354409 3713 sys_catalog.cc:455] T 00000000000000000000000000000000 P d4216fed87a840f587a730f82785f89a [sys.catalog]: SysCatalogTable state changed. Reason: New leader d4216fed87a840f587a730f82785f89a. Latest consensus state: current_term: 1 leader_uuid: "d4216fed87a840f587a730f82785f89a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d4216fed87a840f587a730f82785f89a" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 33743 } } }
I20260808 14:50:43.354805 3713 sys_catalog.cc:458] T 00000000000000000000000000000000 P d4216fed87a840f587a730f82785f89a [sys.catalog]: This master's current role is: LEADER
I20260808 14:50:43.354635 3712 sys_catalog.cc:455] T 00000000000000000000000000000000 P d4216fed87a840f587a730f82785f89a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d4216fed87a840f587a730f82785f89a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d4216fed87a840f587a730f82785f89a" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 33743 } } }
I20260808 14:50:43.355012 3712 sys_catalog.cc:458] T 00000000000000000000000000000000 P d4216fed87a840f587a730f82785f89a [sys.catalog]: This master's current role is: LEADER
I20260808 14:50:43.357108 3720 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:50:43.362239 3720 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:50:43.370997 3720 catalog_manager.cc:1347] Generated new cluster ID: 6bbf1a6ac72b4319862888f8c70371d8
I20260808 14:50:43.371134 3720 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:50:43.398011 3720 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:50:43.399372 3720 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:50:43.410611 3720 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d4216fed87a840f587a730f82785f89a: Generated new TSK 0
I20260808 14:50:43.411398 3720 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.26.206.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.206.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.206.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200577490656-27451-0/krb5kdc/oryx_127.26.206.193.keytab.
Entry for principal oryx/127.26.206.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200577490656-27451-0/krb5kdc/oryx_127.26.206.193.keytab.
I20260808 14:50:43.472502 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200577490656-27451-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200577490656-27451-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200577490656-27451-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200577490656-27451-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.206.193:0
--local_ip_for_outbound_sockets=127.26.206.193
--webserver_interface=127.26.206.193
--webserver_port=0
--tserver_master_addrs=127.26.206.254:33743
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200577490656-27451-0/krb5kdc/oryx_127.26.206.193.keytab
--principal=oryx/127.26.206.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.206.212:39179
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:50:43.808292 3735 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:50:43.808552 3735 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:50:43.808643 3735 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:50:43.815498 3735 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:50:43.815665 3735 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:50:43.815764 3735 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 14:50:43.815848 3735 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.206.193
I20260808 14:50:43.825387 3735 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:39179
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200577490656-27451-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200577490656-27451-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200577490656-27451-0/krb5kdc/oryx_127.26.206.193.keytab
--principal=oryx/127.26.206.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.206.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200577490656-27451-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.206.193
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.26.206.254:33743
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.206.193
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200577490656-27451-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:50:43.826543 3735 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:50:43.827867 3735 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:50:43.841734 3740 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:50:43.841687 3741 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:50:43.841660 3743 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:50:43.842278 3735 server_base.cc:1034] running on GCE node
I20260808 14:50:43.843034 3735 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:50:43.844046 3735 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:50:43.845291 3735 hybrid_clock.cc:648] HybridClock initialized: now 1786200643845223 us; error 48 us; skew 500 ppm
I20260808 14:50:43.845608 3735 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:50:43 dist-test-slave-6k22 krb5kdc[3604](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200643, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.206.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:50:43.848734 3735 init.cc:377] Logged in from keytab as oryx/127.26.206.193@KRBTEST.COM (short username oryx)
I20260808 14:50:43.850153 3735 webserver.cc:460] Webserver started at http://127.26.206.193:44433/ using document root <none> and password file <none>
I20260808 14:50:43.850853 3735 fs_manager.cc:359] Metadata directory not provided
I20260808 14:50:43.850998 3735 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:50:43.851334 3735 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:50:43.854432 3735 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200577490656-27451-0/minicluster-data/ts-0/data/instance:
uuid: "59d0f9ffa2814130809f5d7dc33e2fd7"
format_stamp: "Formatted at 2026-08-08 14:50:43 on dist-test-slave-6k22"
server_key: "869159afd6d29abedd29f2391414381a"
server_key_iv: "5671d11be9013b79ffb27561c4c5132f"
server_key_version: "encryptionkey@0"
I20260808 14:50:43.855250 3735 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200577490656-27451-0/minicluster-data/ts-0/wal/instance:
uuid: "59d0f9ffa2814130809f5d7dc33e2fd7"
format_stamp: "Formatted at 2026-08-08 14:50:43 on dist-test-slave-6k22"
server_key: "869159afd6d29abedd29f2391414381a"
server_key_iv: "5671d11be9013b79ffb27561c4c5132f"
server_key_version: "encryptionkey@0"
I20260808 14:50:43.860718 3735 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260808 14:50:43.864346 3750 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:50:43.865610 3735 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 14:50:43.865808 3735 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200577490656-27451-0/minicluster-data/ts-0/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200577490656-27451-0/minicluster-data/ts-0/wal
uuid: "59d0f9ffa2814130809f5d7dc33e2fd7"
format_stamp: "Formatted at 2026-08-08 14:50:43 on dist-test-slave-6k22"
server_key: "869159afd6d29abedd29f2391414381a"
server_key_iv: "5671d11be9013b79ffb27561c4c5132f"
server_key_version: "encryptionkey@0"
I20260808 14:50:43.866062 3735 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200577490656-27451-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200577490656-27451-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200577490656-27451-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:50:43.890961 3735 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:50:43.894732 3735 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:50:43.895022 3735 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:50:43.897663 3735 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:50:43.897773 3735 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:50:43.897918 3735 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:50:43.897997 3735 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 14:50:43 dist-test-slave-6k22 krb5kdc[3604](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200643, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.206.193@KRBTEST.COM for oryx/127.26.206.254@KRBTEST.COM
I20260808 14:50:43.922343 3760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:43.898349 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.193:44291 (local address 127.26.206.254:33743)
0808 14:50:43.900876 (+ 2527us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:43.900884 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:43.900908 (+ 24us) server_negotiation.cc:407] Connection header received
0808 14:50:43.902633 (+ 1725us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:43.902639 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:43.902734 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:43.902867 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:43.905232 (+ 2365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:43.906304 (+ 1072us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:43.908950 (+ 2646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:43.909748 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:43.909902 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:43.914964 (+ 5062us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:50:43.914986 (+ 22us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:50:43.914993 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:50:43.915041 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:50:43.918424 (+ 3383us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:43.919431 (+ 1007us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:43.919438 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:43.919445 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:43.919628 (+ 183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:43.920183 (+ 555us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:43.920190 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:43.920194 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:43.920516 (+ 322us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:50:43.920689 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:43.921731 (+ 1042us) server_negotiation.cc:299] Negotiation successful
0808 14:50:43.921946 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2393,"thread_start_us":2251,"threads_started":1}
I20260808 14:50:43.923418 3762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:43.899087 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:33743 (local address 127.26.206.193:44291)
0808 14:50:43.900183 (+ 1096us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:43.900247 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0808 14:50:43.902298 (+ 2051us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:50:43.903299 (+ 1001us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:50:43.903308 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:50:43.904076 (+ 768us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:50:43.905010 (+ 934us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:43.905042 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:43.906475 (+ 1433us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:43.906480 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:43.908779 (+ 2299us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:43.908801 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:43.910010 (+ 1209us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:43.910020 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:43.910680 (+ 660us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:43.911471 (+ 791us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:50:43.911500 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:50:43.914708 (+ 3208us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:50:43.918577 (+ 3869us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:50:43.918586 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:50:43.918600 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:50:43.919223 (+ 623us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:50:43.919743 (+ 520us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:50:43.919748 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:50:43.919752 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:50:43.920013 (+ 261us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:50:43.920793 (+ 780us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:50:43.920802 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:50:43.921284 (+ 482us) client_negotiation.cc:769] Sending connection context
0808 14:50:43.921638 (+ 354us) client_negotiation.cc:240] Negotiation successful
0808 14:50:43.922164 (+ 526us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":724,"thread_start_us":423,"threads_started":1}
I20260808 14:50:43.945555 3838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:43.929533 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:33743 (local address 127.26.206.193:41013)
0808 14:50:43.930259 (+ 726us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:43.930293 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0808 14:50:43.930485 (+ 192us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:50:43.930794 (+ 309us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:50:43.930801 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:50:43.931627 (+ 826us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:50:43.932115 (+ 488us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:43.932131 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:43.933062 (+ 931us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:43.933070 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:43.935180 (+ 2110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:43.935197 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:43.935958 (+ 761us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:43.935966 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:43.936133 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:43.936822 (+ 689us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:50:43.936850 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:50:43.938079 (+ 1229us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:50:43.942182 (+ 4103us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:50:43.942186 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:50:43.942190 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:50:43.942782 (+ 592us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:50:43.943169 (+ 387us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:50:43.943176 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:50:43.943182 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:50:43.943415 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:50:43.943994 (+ 579us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:50:43.943999 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:50:43.944304 (+ 305us) client_negotiation.cc:769] Sending connection context
0808 14:50:43.944509 (+ 205us) client_negotiation.cc:240] Negotiation successful
0808 14:50:43.944918 (+ 409us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":542,"thread_start_us":374,"threads_started":1}
I20260808 14:50:43.946173 3760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:43.929548 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.193:41013 (local address 127.26.206.254:33743)
0808 14:50:43.929778 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:43.929787 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:43.930417 (+ 630us) server_negotiation.cc:407] Connection header received
0808 14:50:43.930598 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:43.930602 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:43.930656 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:43.930732 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:43.932271 (+ 1539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:43.932922 (+ 651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:43.935319 (+ 2397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:43.935771 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:43.935896 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:43.938311 (+ 2415us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:50:43.938320 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:50:43.938328 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:50:43.938373 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:50:43.942084 (+ 3711us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:43.942900 (+ 816us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:43.942903 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:43.942920 (+ 17us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:43.943042 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:43.943525 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:43.943530 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:43.943533 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:43.943866 (+ 333us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:50:43.944044 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:43.945386 (+ 1342us) server_negotiation.cc:299] Negotiation successful
0808 14:50:43.945684 (+ 298us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260808 14:50:43.953824 3735 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.193:41307
I20260808 14:50:43.953847 3888 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.193:41307 every 8 connection(s)
I20260808 14:50:43.955022 3735 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200577490656-27451-0/minicluster-data/ts-0/data/info.pb
I20260808 14:50:43.957129 3889 heartbeater.cc:347] Connected to a master server at 127.26.206.254:33743
I20260808 14:50:43.957355 3889 heartbeater.cc:464] Registering TS with master...
I20260808 14:50:43.957962 3889 heartbeater.cc:511] Master 127.26.206.254:33743 requested a full tablet report, sending...
I20260808 14:50:43.958634 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 3735
I20260808 14:50:43.958863 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200577490656-27451-0/minicluster-data/ts-0/wal/instance
I20260808 14:50:43.959683 27451 external_mini_cluster.cc:1428] Setting key acbb7385fcf8b094f703d8133e3e1230
I20260808 14:50:43.960198 3657 ts_manager.cc:194] Registered new tserver with Master: 59d0f9ffa2814130809f5d7dc33e2fd7 (127.26.206.193:41307)
I20260808 14:50:43.961795 3657 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.26.206.193@KRBTEST.COM'} at 127.26.206.193:44291
WARNING: no policy specified for oryx/127.26.206.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.206.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.206.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200577490656-27451-0/krb5kdc/oryx_127.26.206.194.keytab.
Entry for principal oryx/127.26.206.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200577490656-27451-0/krb5kdc/oryx_127.26.206.194.keytab.
I20260808 14:50:44.014849 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200577490656-27451-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200577490656-27451-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200577490656-27451-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200577490656-27451-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.206.194:0
--local_ip_for_outbound_sockets=127.26.206.194
--webserver_interface=127.26.206.194
--webserver_port=0
--tserver_master_addrs=127.26.206.254:33743
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200577490656-27451-0/krb5kdc/oryx_127.26.206.194.keytab
--principal=oryx/127.26.206.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.206.212:39179
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:50:44.337149 3894 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:50:44.337406 3894 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:50:44.337500 3894 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:50:44.344583 3894 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:50:44.344710 3894 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:50:44.344883 3894 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 14:50:44.345005 3894 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.206.194
I20260808 14:50:44.354441 3894 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:39179
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200577490656-27451-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200577490656-27451-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200577490656-27451-0/krb5kdc/oryx_127.26.206.194.keytab
--principal=oryx/127.26.206.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.206.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200577490656-27451-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.206.194
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.26.206.254:33743
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.206.194
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200577490656-27451-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:50:44.355651 3894 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:50:44.357044 3894 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:50:44.369750 3900 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:50:44.369791 3903 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:50:44.369837 3899 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:50:44.371383 3894 server_base.cc:1034] running on GCE node
I20260808 14:50:44.372040 3894 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:50:44.372953 3894 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:50:44.374189 3894 hybrid_clock.cc:648] HybridClock initialized: now 1786200644374120 us; error 51 us; skew 500 ppm
I20260808 14:50:44.374498 3894 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:50:44 dist-test-slave-6k22 krb5kdc[3604](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200644, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.206.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:50:44.377861 3894 init.cc:377] Logged in from keytab as oryx/127.26.206.194@KRBTEST.COM (short username oryx)
I20260808 14:50:44.379267 3894 webserver.cc:460] Webserver started at http://127.26.206.194:44351/ using document root <none> and password file <none>
I20260808 14:50:44.380038 3894 fs_manager.cc:359] Metadata directory not provided
I20260808 14:50:44.380177 3894 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:50:44.380506 3894 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:50:44.383386 3894 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200577490656-27451-0/minicluster-data/ts-1/data/instance:
uuid: "659ff9080dce466990cb873522f6634f"
format_stamp: "Formatted at 2026-08-08 14:50:44 on dist-test-slave-6k22"
server_key: "48b0dda4c24695a4f273c516abd06407"
server_key_iv: "147f29b0ea53dd297730081e30c3f790"
server_key_version: "encryptionkey@0"
I20260808 14:50:44.384301 3894 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200577490656-27451-0/minicluster-data/ts-1/wal/instance:
uuid: "659ff9080dce466990cb873522f6634f"
format_stamp: "Formatted at 2026-08-08 14:50:44 on dist-test-slave-6k22"
server_key: "48b0dda4c24695a4f273c516abd06407"
server_key_iv: "147f29b0ea53dd297730081e30c3f790"
server_key_version: "encryptionkey@0"
I20260808 14:50:44.389423 3894 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260808 14:50:44.393903 3913 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:50:44.395179 3894 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 14:50:44.395370 3894 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200577490656-27451-0/minicluster-data/ts-1/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200577490656-27451-0/minicluster-data/ts-1/wal
uuid: "659ff9080dce466990cb873522f6634f"
format_stamp: "Formatted at 2026-08-08 14:50:44 on dist-test-slave-6k22"
server_key: "48b0dda4c24695a4f273c516abd06407"
server_key_iv: "147f29b0ea53dd297730081e30c3f790"
server_key_version: "encryptionkey@0"
I20260808 14:50:44.395610 3894 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200577490656-27451-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200577490656-27451-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200577490656-27451-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:50:44.426658 3894 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:50:44.431169 3894 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:50:44.431455 3894 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:50:44.434084 3894 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:50:44.434194 3894 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:50:44.434358 3894 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:50:44.434437 3894 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 14:50:44 dist-test-slave-6k22 krb5kdc[3604](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200644, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.206.194@KRBTEST.COM for oryx/127.26.206.254@KRBTEST.COM
I20260808 14:50:44.457792 3760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:44.434928 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.194:44967 (local address 127.26.206.254:33743)
0808 14:50:44.435102 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:44.435108 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:44.436633 (+ 1525us) server_negotiation.cc:407] Connection header received
0808 14:50:44.438834 (+ 2201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:44.438841 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:44.438931 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:44.439077 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:44.441240 (+ 2163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:44.442505 (+ 1265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:44.445082 (+ 2577us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:44.445997 (+ 915us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:44.446146 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:44.450587 (+ 4441us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:50:44.450593 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:50:44.450604 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:50:44.450634 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:50:44.454030 (+ 3396us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:44.455021 (+ 991us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:44.455027 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:44.455030 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:44.455183 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:44.455842 (+ 659us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:44.455848 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:44.455852 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:44.456180 (+ 328us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:50:44.456401 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:44.457194 (+ 793us) server_negotiation.cc:299] Negotiation successful
0808 14:50:44.457439 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260808 14:50:44.458773 3922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:44.435496 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:33743 (local address 127.26.206.194:44967)
0808 14:50:44.436439 (+ 943us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:44.436492 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0808 14:50:44.438492 (+ 2000us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:50:44.439335 (+ 843us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:50:44.439352 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:50:44.440141 (+ 789us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:50:44.441019 (+ 878us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:44.441051 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:44.442680 (+ 1629us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:44.442688 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:44.444957 (+ 2269us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:44.444972 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:44.446292 (+ 1320us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:44.446302 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:44.446519 (+ 217us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:44.447210 (+ 691us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:50:44.447230 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:50:44.450373 (+ 3143us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:50:44.454181 (+ 3808us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:50:44.454190 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:50:44.454205 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:50:44.454894 (+ 689us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:50:44.455351 (+ 457us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:50:44.455359 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:50:44.455364 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:50:44.455695 (+ 331us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:50:44.456362 (+ 667us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:50:44.456371 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:50:44.456769 (+ 398us) client_negotiation.cc:769] Sending connection context
0808 14:50:44.457140 (+ 371us) client_negotiation.cc:240] Negotiation successful
0808 14:50:44.457638 (+ 498us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":697,"thread_start_us":432,"threads_started":1}
I20260808 14:50:44.481681 3760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:44.465043 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.194:42331 (local address 127.26.206.254:33743)
0808 14:50:44.465239 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:44.465247 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:44.466138 (+ 891us) server_negotiation.cc:407] Connection header received
0808 14:50:44.466324 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:44.466328 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:44.466386 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:44.466471 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:44.468116 (+ 1645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:44.469084 (+ 968us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:44.470903 (+ 1819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:44.471457 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:44.471612 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:44.473993 (+ 2381us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:50:44.474002 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:50:44.474010 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:50:44.474068 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:50:44.478273 (+ 4205us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:44.478950 (+ 677us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:44.478955 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:44.478960 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:44.479146 (+ 186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:44.479683 (+ 537us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:44.479688 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:44.479691 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:44.480181 (+ 490us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:50:44.480343 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:44.481131 (+ 788us) server_negotiation.cc:299] Negotiation successful
0808 14:50:44.481368 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260808 14:50:44.481750 3998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:44.465183 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:33743 (local address 127.26.206.194:42331)
0808 14:50:44.466012 (+ 829us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:44.466037 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0808 14:50:44.466203 (+ 166us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:50:44.466543 (+ 340us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:50:44.466551 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:50:44.467314 (+ 763us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:50:44.467931 (+ 617us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:44.467949 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:44.469242 (+ 1293us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:44.469250 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:44.470758 (+ 1508us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:44.470769 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:44.471854 (+ 1085us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:44.471858 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:44.471989 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:44.472679 (+ 690us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:50:44.472695 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:50:44.473778 (+ 1083us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:50:44.478410 (+ 4632us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:50:44.478414 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:50:44.478416 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:50:44.478827 (+ 411us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:50:44.479304 (+ 477us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:50:44.479312 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:50:44.479317 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:50:44.479509 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:50:44.480300 (+ 791us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:50:44.480305 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:50:44.480550 (+ 245us) client_negotiation.cc:769] Sending connection context
0808 14:50:44.480720 (+ 170us) client_negotiation.cc:240] Negotiation successful
0808 14:50:44.481102 (+ 382us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":644,"thread_start_us":447,"threads_started":1}
I20260808 14:50:44.492043 3894 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.194:36935
I20260808 14:50:44.492071 4057 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.194:36935 every 8 connection(s)
I20260808 14:50:44.493217 3894 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200577490656-27451-0/minicluster-data/ts-1/data/info.pb
I20260808 14:50:44.495208 4058 heartbeater.cc:347] Connected to a master server at 127.26.206.254:33743
I20260808 14:50:44.495468 4058 heartbeater.cc:464] Registering TS with master...
I20260808 14:50:44.496127 4058 heartbeater.cc:511] Master 127.26.206.254:33743 requested a full tablet report, sending...
I20260808 14:50:44.497411 3657 ts_manager.cc:194] Registered new tserver with Master: 659ff9080dce466990cb873522f6634f (127.26.206.194:36935)
I20260808 14:50:44.498219 3657 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.26.206.194@KRBTEST.COM'} at 127.26.206.194:44967
I20260808 14:50:44.498418 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 3894
I20260808 14:50:44.498644 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200577490656-27451-0/minicluster-data/ts-1/wal/instance
I20260808 14:50:44.499166 27451 external_mini_cluster.cc:1428] Setting key 629af78ee86cbf8ed859ef3c81fa4e2d
WARNING: no policy specified for oryx/127.26.206.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.206.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.206.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200577490656-27451-0/krb5kdc/oryx_127.26.206.195.keytab.
Entry for principal oryx/127.26.206.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200577490656-27451-0/krb5kdc/oryx_127.26.206.195.keytab.
I20260808 14:50:44.552706 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200577490656-27451-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200577490656-27451-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200577490656-27451-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200577490656-27451-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.206.195:0
--local_ip_for_outbound_sockets=127.26.206.195
--webserver_interface=127.26.206.195
--webserver_port=0
--tserver_master_addrs=127.26.206.254:33743
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200577490656-27451-0/krb5kdc/oryx_127.26.206.195.keytab
--principal=oryx/127.26.206.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.206.212:39179
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:50:44.877381 4062 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:50:44.877642 4062 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:50:44.877735 4062 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:50:44.884843 4062 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:50:44.884943 4062 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:50:44.885022 4062 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 14:50:44.885103 4062 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.206.195
I20260808 14:50:44.894335 4062 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:39179
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200577490656-27451-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200577490656-27451-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200577490656-27451-0/krb5kdc/oryx_127.26.206.195.keytab
--principal=oryx/127.26.206.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.206.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200577490656-27451-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.206.195
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.26.206.254:33743
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.206.195
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200577490656-27451-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:50:44.895539 4062 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:50:44.896842 4062 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:50:44.909456 4067 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:50:44.909569 4071 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:50:44.909742 4069 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:50:44.910656 4062 server_base.cc:1034] running on GCE node
I20260808 14:50:44.911185 4062 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:50:44.912045 4062 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:50:44.913297 4062 hybrid_clock.cc:648] HybridClock initialized: now 1786200644913235 us; error 55 us; skew 500 ppm
I20260808 14:50:44.913625 4062 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:50:44 dist-test-slave-6k22 krb5kdc[3604](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200644, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.206.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:50:44.917011 4062 init.cc:377] Logged in from keytab as oryx/127.26.206.195@KRBTEST.COM (short username oryx)
I20260808 14:50:44.918269 4062 webserver.cc:460] Webserver started at http://127.26.206.195:32781/ using document root <none> and password file <none>
I20260808 14:50:44.918906 4062 fs_manager.cc:359] Metadata directory not provided
I20260808 14:50:44.918994 4062 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:50:44.919261 4062 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:50:44.922091 4062 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200577490656-27451-0/minicluster-data/ts-2/data/instance:
uuid: "7dd600757c0f48eb802132ab9283ab57"
format_stamp: "Formatted at 2026-08-08 14:50:44 on dist-test-slave-6k22"
server_key: "0cc6dfa7f8546a8cdd729f0b587e3547"
server_key_iv: "af5be1aa97bacc0402cc41d2d963c5f5"
server_key_version: "encryptionkey@0"
I20260808 14:50:44.922838 4062 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200577490656-27451-0/minicluster-data/ts-2/wal/instance:
uuid: "7dd600757c0f48eb802132ab9283ab57"
format_stamp: "Formatted at 2026-08-08 14:50:44 on dist-test-slave-6k22"
server_key: "0cc6dfa7f8546a8cdd729f0b587e3547"
server_key_iv: "af5be1aa97bacc0402cc41d2d963c5f5"
server_key_version: "encryptionkey@0"
I20260808 14:50:44.927999 4062 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.003s
I20260808 14:50:44.931200 4078 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:50:44.932542 4062 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 14:50:44.932714 4062 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200577490656-27451-0/minicluster-data/ts-2/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200577490656-27451-0/minicluster-data/ts-2/wal
uuid: "7dd600757c0f48eb802132ab9283ab57"
format_stamp: "Formatted at 2026-08-08 14:50:44 on dist-test-slave-6k22"
server_key: "0cc6dfa7f8546a8cdd729f0b587e3547"
server_key_iv: "af5be1aa97bacc0402cc41d2d963c5f5"
server_key_version: "encryptionkey@0"
I20260808 14:50:44.932895 4062 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200577490656-27451-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200577490656-27451-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200577490656-27451-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:50:44.956696 4062 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:50:44.961338 4062 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:50:44.961563 4062 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:50:44.964148 4062 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:50:44.964265 4062 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:50:44.964394 4062 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:50:44.964469 4062 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:50:44.965178 3889 heartbeater.cc:503] Master 127.26.206.254:33743 was elected leader, sending a full tablet report...
Aug 08 14:50:44 dist-test-slave-6k22 krb5kdc[3604](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200644, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.206.195@KRBTEST.COM for oryx/127.26.206.254@KRBTEST.COM
I20260808 14:50:44.988538 3760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:44.966227 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.195:60785 (local address 127.26.206.254:33743)
0808 14:50:44.966429 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:44.966436 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:44.966625 (+ 189us) server_negotiation.cc:407] Connection header received
0808 14:50:44.969232 (+ 2607us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:44.969237 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:44.969322 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:44.969395 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:44.971845 (+ 2450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:44.972944 (+ 1099us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:44.975494 (+ 2550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:44.976200 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:44.976346 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:44.980787 (+ 4441us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:50:44.980796 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:50:44.980802 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:50:44.980845 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:50:44.984892 (+ 4047us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:44.985803 (+ 911us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:44.985847 (+ 44us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:44.985852 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:44.986017 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:44.986555 (+ 538us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:44.986563 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:44.986568 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:44.987006 (+ 438us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:50:44.987223 (+ 217us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:44.987935 (+ 712us) server_negotiation.cc:299] Negotiation successful
0808 14:50:44.988168 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260808 14:50:44.989492 4088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:44.965518 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:33743 (local address 127.26.206.195:60785)
0808 14:50:44.966462 (+ 944us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:44.966510 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0808 14:50:44.968864 (+ 2354us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:50:44.970015 (+ 1151us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:50:44.970026 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:50:44.970789 (+ 763us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:50:44.971651 (+ 862us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:44.971690 (+ 39us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:44.973107 (+ 1417us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:44.973112 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:44.975351 (+ 2239us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:44.975366 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:44.976473 (+ 1107us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:44.976487 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:44.976695 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:44.977459 (+ 764us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:50:44.977480 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:50:44.980499 (+ 3019us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:50:44.985052 (+ 4553us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:50:44.985058 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:50:44.985069 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:50:44.985642 (+ 573us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:50:44.986174 (+ 532us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:50:44.986181 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:50:44.986187 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:50:44.986381 (+ 194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:50:44.987152 (+ 771us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:50:44.987157 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:50:44.987465 (+ 308us) client_negotiation.cc:769] Sending connection context
0808 14:50:44.987783 (+ 318us) client_negotiation.cc:240] Negotiation successful
0808 14:50:44.988324 (+ 541us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":653,"thread_start_us":806,"threads_started":1}
I20260808 14:50:45.013204 3760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:44.995469 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.195:49059 (local address 127.26.206.254:33743)
0808 14:50:44.995735 (+ 266us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:44.995744 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:44.996279 (+ 535us) server_negotiation.cc:407] Connection header received
0808 14:50:44.996417 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:44.996425 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:44.996535 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:44.996659 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:44.997514 (+ 855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:44.998870 (+ 1356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:45.001678 (+ 2808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:45.002415 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:45.002568 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:45.005441 (+ 2873us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:50:45.005449 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:50:45.005456 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:50:45.005501 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:50:45.009532 (+ 4031us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:45.010492 (+ 960us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:45.010498 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:45.010501 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:45.010685 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:45.011183 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:45.011190 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:45.011195 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:45.011641 (+ 446us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:50:45.011801 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:45.012458 (+ 657us) server_negotiation.cc:299] Negotiation successful
0808 14:50:45.012755 (+ 297us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":112}
I20260808 14:50:45.013882 4150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:44.995483 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:33743 (local address 127.26.206.195:49059)
0808 14:50:44.996175 (+ 692us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:44.996190 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 14:50:44.996310 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:50:44.996671 (+ 361us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:50:44.996674 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:50:44.997068 (+ 394us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:50:44.997380 (+ 312us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:44.997388 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:44.999020 (+ 1632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:44.999023 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:45.001499 (+ 2476us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:45.001520 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:45.002644 (+ 1124us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:45.002654 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:45.002956 (+ 302us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:45.003715 (+ 759us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:50:45.003741 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:50:45.005225 (+ 1484us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:50:45.009664 (+ 4439us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:50:45.009672 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:50:45.009680 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:50:45.010299 (+ 619us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:50:45.010829 (+ 530us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:50:45.010836 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:50:45.010842 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:50:45.011037 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:50:45.011793 (+ 756us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:50:45.011801 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:50:45.012104 (+ 303us) client_negotiation.cc:769] Sending connection context
0808 14:50:45.012310 (+ 206us) client_negotiation.cc:240] Negotiation successful
0808 14:50:45.012804 (+ 494us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":530,"thread_start_us":386,"threads_started":1}
I20260808 14:50:45.018833 4062 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.195:39641
I20260808 14:50:45.018913 4213 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.195:39641 every 8 connection(s)
I20260808 14:50:45.020002 4062 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200577490656-27451-0/minicluster-data/ts-2/data/info.pb
I20260808 14:50:45.021978 4214 heartbeater.cc:347] Connected to a master server at 127.26.206.254:33743
I20260808 14:50:45.022238 4214 heartbeater.cc:464] Registering TS with master...
I20260808 14:50:45.022862 4214 heartbeater.cc:511] Master 127.26.206.254:33743 requested a full tablet report, sending...
I20260808 14:50:45.024199 3657 ts_manager.cc:194] Registered new tserver with Master: 7dd600757c0f48eb802132ab9283ab57 (127.26.206.195:39641)
I20260808 14:50:45.025143 3657 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.26.206.195@KRBTEST.COM'} at 127.26.206.195:60785
I20260808 14:50:45.026696 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 4062
I20260808 14:50:45.026932 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200577490656-27451-0/minicluster-data/ts-2/wal/instance
I20260808 14:50:45.027364 27451 external_mini_cluster.cc:1428] Setting key 26ecf58dd27e40a6f758b52172541f6d
I20260808 14:50:45.030093 27451 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 08 14:50:45 dist-test-slave-6k22 krb5kdc[3604](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200645, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 14:50:45 dist-test-slave-6k22 krb5kdc[3604](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.26.206.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:50:45 dist-test-slave-6k22 krb5kdc[3604](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.26.206.254@KRBTEST.COM, Server not found in Kerberos database
W20260808 14:50:45.088996 3760 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:50:45.077111 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58248 (local address 127.26.206.254:33743)
0808 14:50:45.077309 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:45.077314 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:45.077990 (+ 676us) server_negotiation.cc:407] Connection header received
0808 14:50:45.078203 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:45.078207 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:45.078271 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:45.078366 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:45.079967 (+ 1601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:45.080705 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:45.082101 (+ 1396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:45.082496 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:45.082582 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:45.088668 (+ 6086us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58248: BlockingRecv error: recv got EOF from 127.0.0.1:58248 (error 108)
Metrics: {"server-negotiator.queue_time_us":80}
Aug 08 14:50:45 dist-test-slave-6k22 krb5kdc[3604](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200645, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.26.206.254@KRBTEST.COM
I20260808 14:50:45.105281 3760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:45.092694 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58256 (local address 127.26.206.254:33743)
0808 14:50:45.092856 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:45.092861 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:45.093211 (+ 350us) server_negotiation.cc:407] Connection header received
0808 14:50:45.093327 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:45.093330 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:45.093394 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:45.093466 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:45.094512 (+ 1046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:45.095189 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:45.096399 (+ 1210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:45.096828 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:45.096918 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:45.100546 (+ 3628us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:50:45.100551 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:50:45.100554 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:50:45.100584 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:50:45.102937 (+ 2353us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:45.103547 (+ 610us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:45.103554 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:45.103575 (+ 21us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:45.103730 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:45.104101 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:45.104106 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:45.104109 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:45.104439 (+ 330us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:50:45.104676 (+ 237us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:45.104888 (+ 212us) server_negotiation.cc:299] Negotiation successful
0808 14:50:45.105051 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260808 14:50:45.109237 3657 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58256:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:50:45.116093 3657 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:50:45.140316 4236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:45.128174 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.193:41307 (local address 127.0.0.1:41664)
0808 14:50:45.129203 (+ 1029us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:45.129225 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 14:50:45.129357 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:50:45.132243 (+ 2886us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:50:45.132247 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:50:45.132283 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:50:45.132688 (+ 405us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:45.132699 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:45.134528 (+ 1829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:45.134533 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:45.137059 (+ 2526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:45.137074 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:45.139196 (+ 2122us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:45.139203 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:45.139431 (+ 228us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:45.139490 (+ 59us) client_negotiation.cc:769] Sending connection context
0808 14:50:45.139640 (+ 150us) client_negotiation.cc:240] Negotiation successful
0808 14:50:45.139841 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":860,"mutex_wait_us":55,"thread_start_us":1171,"threads_started":1}
I20260808 14:50:45.140998 4240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:45.128969 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41664 (local address 127.26.206.193:41307)
0808 14:50:45.131456 (+ 2487us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:45.131464 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:45.131490 (+ 26us) server_negotiation.cc:407] Connection header received
0808 14:50:45.131610 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:45.131618 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:45.131850 (+ 232us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:45.132033 (+ 183us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:50:45.132874 (+ 841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:45.134338 (+ 1464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:45.137246 (+ 2908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:45.138688 (+ 1442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:45.138856 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:45.139045 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:45.140555 (+ 1510us) server_negotiation.cc:299] Negotiation successful
0808 14:50:45.140713 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2317,"thread_start_us":2182,"threads_started":1}
I20260808 14:50:45.141660 4239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:45.128544 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45316 (local address 127.26.206.194:36935)
0808 14:50:45.129754 (+ 1210us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:45.129761 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:45.129785 (+ 24us) server_negotiation.cc:407] Connection header received
0808 14:50:45.129860 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:45.129865 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:45.130033 (+ 168us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:45.130224 (+ 191us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:50:45.132034 (+ 1810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:45.133535 (+ 1501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:45.137246 (+ 3711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:45.139705 (+ 2459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:45.139877 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:45.140044 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:45.141196 (+ 1152us) server_negotiation.cc:299] Negotiation successful
0808 14:50:45.141368 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1085,"thread_start_us":968,"threads_started":1}
I20260808 14:50:45.141062 4237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:45.127900 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.194:36935 (local address 127.0.0.1:45316)
0808 14:50:45.129067 (+ 1167us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:45.129132 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0808 14:50:45.129304 (+ 172us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:50:45.130232 (+ 928us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:50:45.130239 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:50:45.130267 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:50:45.130676 (+ 409us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:45.130690 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:45.133695 (+ 3005us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:45.133701 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:45.137059 (+ 3358us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:45.137074 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:45.140198 (+ 3124us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:45.140204 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:45.140391 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:45.140432 (+ 41us) client_negotiation.cc:769] Sending connection context
0808 14:50:45.140528 (+ 96us) client_negotiation.cc:240] Negotiation successful
0808 14:50:45.140647 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":745,"mutex_wait_us":39,"thread_start_us":966,"threads_started":1}
I20260808 14:50:45.146128 3808 tablet_service.cc:1467] Processing CreateTablet for tablet ab45c48b739842a4b94f6e0c629d9abc (DEFAULT_TABLE table=test-table [id=310a8d03e6cf4327ad5ce3c9d63f51b4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:50:45.147395 3808 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ab45c48b739842a4b94f6e0c629d9abc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:50:45.148751 4236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:45.131237 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.195:39641 (local address 127.0.0.1:53870)
0808 14:50:45.141445 (+ 10208us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:45.141464 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 14:50:45.141556 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:50:45.142610 (+ 1054us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:50:45.142615 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:50:45.142641 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:50:45.142828 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:45.142839 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:45.144635 (+ 1796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:45.144642 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:45.146227 (+ 1585us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:45.146245 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:45.148035 (+ 1790us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:45.148041 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:45.148222 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:45.148253 (+ 31us) client_negotiation.cc:769] Sending connection context
0808 14:50:45.148360 (+ 107us) client_negotiation.cc:240] Negotiation successful
0808 14:50:45.148488 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10116,"thread_start_us":13540,"threads_started":1}
I20260808 14:50:45.148288 3977 tablet_service.cc:1467] Processing CreateTablet for tablet ab45c48b739842a4b94f6e0c629d9abc (DEFAULT_TABLE table=test-table [id=310a8d03e6cf4327ad5ce3c9d63f51b4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:50:45.148921 4243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:45.131885 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53870 (local address 127.26.206.195:39641)
0808 14:50:45.142137 (+ 10252us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:45.142145 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:45.142181 (+ 36us) server_negotiation.cc:407] Connection header received
0808 14:50:45.142255 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:45.142268 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:45.142418 (+ 150us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:45.142625 (+ 207us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:50:45.142987 (+ 362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:45.144508 (+ 1521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:45.146433 (+ 1925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:45.147848 (+ 1415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:45.148064 (+ 216us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:45.148218 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:45.148420 (+ 202us) server_negotiation.cc:299] Negotiation successful
0808 14:50:45.148576 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10085,"thread_start_us":13113,"threads_started":1}
I20260808 14:50:45.149677 3977 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ab45c48b739842a4b94f6e0c629d9abc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:50:45.153105 4136 tablet_service.cc:1467] Processing CreateTablet for tablet ab45c48b739842a4b94f6e0c629d9abc (DEFAULT_TABLE table=test-table [id=310a8d03e6cf4327ad5ce3c9d63f51b4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:50:45.154436 4136 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ab45c48b739842a4b94f6e0c629d9abc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:50:45.159477 4244 tablet_bootstrap.cc:492] T ab45c48b739842a4b94f6e0c629d9abc P 59d0f9ffa2814130809f5d7dc33e2fd7: Bootstrap starting.
I20260808 14:50:45.162703 4244 tablet_bootstrap.cc:654] T ab45c48b739842a4b94f6e0c629d9abc P 59d0f9ffa2814130809f5d7dc33e2fd7: Neither blocks nor log segments found. Creating new log.
I20260808 14:50:45.163900 4244 log.cc:824] T ab45c48b739842a4b94f6e0c629d9abc P 59d0f9ffa2814130809f5d7dc33e2fd7: Log is configured to *not* fsync() on all Append() calls
I20260808 14:50:45.164112 4245 tablet_bootstrap.cc:492] T ab45c48b739842a4b94f6e0c629d9abc P 659ff9080dce466990cb873522f6634f: Bootstrap starting.
I20260808 14:50:45.167506 4245 tablet_bootstrap.cc:654] T ab45c48b739842a4b94f6e0c629d9abc P 659ff9080dce466990cb873522f6634f: Neither blocks nor log segments found. Creating new log.
I20260808 14:50:45.167819 4244 tablet_bootstrap.cc:492] T ab45c48b739842a4b94f6e0c629d9abc P 59d0f9ffa2814130809f5d7dc33e2fd7: No bootstrap required, opened a new log
I20260808 14:50:45.168023 4247 tablet_bootstrap.cc:492] T ab45c48b739842a4b94f6e0c629d9abc P 7dd600757c0f48eb802132ab9283ab57: Bootstrap starting.
I20260808 14:50:45.168089 4244 ts_tablet_manager.cc:1397] T ab45c48b739842a4b94f6e0c629d9abc P 59d0f9ffa2814130809f5d7dc33e2fd7: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.005s
I20260808 14:50:45.168967 4245 log.cc:824] T ab45c48b739842a4b94f6e0c629d9abc P 659ff9080dce466990cb873522f6634f: Log is configured to *not* fsync() on all Append() calls
I20260808 14:50:45.171082 4247 tablet_bootstrap.cc:654] T ab45c48b739842a4b94f6e0c629d9abc P 7dd600757c0f48eb802132ab9283ab57: Neither blocks nor log segments found. Creating new log.
I20260808 14:50:45.172027 4245 tablet_bootstrap.cc:492] T ab45c48b739842a4b94f6e0c629d9abc P 659ff9080dce466990cb873522f6634f: No bootstrap required, opened a new log
I20260808 14:50:45.172178 4247 log.cc:824] T ab45c48b739842a4b94f6e0c629d9abc P 7dd600757c0f48eb802132ab9283ab57: Log is configured to *not* fsync() on all Append() calls
I20260808 14:50:45.172309 4245 ts_tablet_manager.cc:1397] T ab45c48b739842a4b94f6e0c629d9abc P 659ff9080dce466990cb873522f6634f: Time spent bootstrapping tablet: real 0.008s user 0.004s sys 0.003s
I20260808 14:50:45.174463 4247 tablet_bootstrap.cc:492] T ab45c48b739842a4b94f6e0c629d9abc P 7dd600757c0f48eb802132ab9283ab57: No bootstrap required, opened a new log
I20260808 14:50:45.174696 4247 ts_tablet_manager.cc:1397] T ab45c48b739842a4b94f6e0c629d9abc P 7dd600757c0f48eb802132ab9283ab57: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260808 14:50:45.179267 4244 raft_consensus.cc:348] T ab45c48b739842a4b94f6e0c629d9abc P 59d0f9ffa2814130809f5d7dc33e2fd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "659ff9080dce466990cb873522f6634f" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 36935 } } peers { permanent_uuid: "59d0f9ffa2814130809f5d7dc33e2fd7" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 41307 } } peers { permanent_uuid: "7dd600757c0f48eb802132ab9283ab57" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 39641 } }
I20260808 14:50:45.179700 4244 raft_consensus.cc:374] T ab45c48b739842a4b94f6e0c629d9abc P 59d0f9ffa2814130809f5d7dc33e2fd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:50:45.179806 4244 raft_consensus.cc:729] T ab45c48b739842a4b94f6e0c629d9abc P 59d0f9ffa2814130809f5d7dc33e2fd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59d0f9ffa2814130809f5d7dc33e2fd7, State: Initialized, Role: FOLLOWER
I20260808 14:50:45.180393 4244 consensus_queue.cc:260] T ab45c48b739842a4b94f6e0c629d9abc P 59d0f9ffa2814130809f5d7dc33e2fd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "659ff9080dce466990cb873522f6634f" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 36935 } } peers { permanent_uuid: "59d0f9ffa2814130809f5d7dc33e2fd7" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 41307 } } peers { permanent_uuid: "7dd600757c0f48eb802132ab9283ab57" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 39641 } }
I20260808 14:50:45.182055 4244 ts_tablet_manager.cc:1428] T ab45c48b739842a4b94f6e0c629d9abc P 59d0f9ffa2814130809f5d7dc33e2fd7: Time spent starting tablet: real 0.014s user 0.007s sys 0.005s
I20260808 14:50:45.182339 4245 raft_consensus.cc:348] T ab45c48b739842a4b94f6e0c629d9abc P 659ff9080dce466990cb873522f6634f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "659ff9080dce466990cb873522f6634f" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 36935 } } peers { permanent_uuid: "59d0f9ffa2814130809f5d7dc33e2fd7" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 41307 } } peers { permanent_uuid: "7dd600757c0f48eb802132ab9283ab57" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 39641 } }
I20260808 14:50:45.182826 4245 raft_consensus.cc:374] T ab45c48b739842a4b94f6e0c629d9abc P 659ff9080dce466990cb873522f6634f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:50:45.182956 4245 raft_consensus.cc:729] T ab45c48b739842a4b94f6e0c629d9abc P 659ff9080dce466990cb873522f6634f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 659ff9080dce466990cb873522f6634f, State: Initialized, Role: FOLLOWER
I20260808 14:50:45.182899 4247 raft_consensus.cc:348] T ab45c48b739842a4b94f6e0c629d9abc P 7dd600757c0f48eb802132ab9283ab57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "659ff9080dce466990cb873522f6634f" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 36935 } } peers { permanent_uuid: "59d0f9ffa2814130809f5d7dc33e2fd7" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 41307 } } peers { permanent_uuid: "7dd600757c0f48eb802132ab9283ab57" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 39641 } }
I20260808 14:50:45.183224 4247 raft_consensus.cc:374] T ab45c48b739842a4b94f6e0c629d9abc P 7dd600757c0f48eb802132ab9283ab57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:50:45.183331 4247 raft_consensus.cc:729] T ab45c48b739842a4b94f6e0c629d9abc P 7dd600757c0f48eb802132ab9283ab57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7dd600757c0f48eb802132ab9283ab57, State: Initialized, Role: FOLLOWER
I20260808 14:50:45.183521 4245 consensus_queue.cc:260] T ab45c48b739842a4b94f6e0c629d9abc P 659ff9080dce466990cb873522f6634f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "659ff9080dce466990cb873522f6634f" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 36935 } } peers { permanent_uuid: "59d0f9ffa2814130809f5d7dc33e2fd7" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 41307 } } peers { permanent_uuid: "7dd600757c0f48eb802132ab9283ab57" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 39641 } }
I20260808 14:50:45.183846 4247 consensus_queue.cc:260] T ab45c48b739842a4b94f6e0c629d9abc P 7dd600757c0f48eb802132ab9283ab57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "659ff9080dce466990cb873522f6634f" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 36935 } } peers { permanent_uuid: "59d0f9ffa2814130809f5d7dc33e2fd7" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 41307 } } peers { permanent_uuid: "7dd600757c0f48eb802132ab9283ab57" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 39641 } }
I20260808 14:50:45.184508 4058 heartbeater.cc:503] Master 127.26.206.254:33743 was elected leader, sending a full tablet report...
I20260808 14:50:45.186299 4245 ts_tablet_manager.cc:1428] T ab45c48b739842a4b94f6e0c629d9abc P 659ff9080dce466990cb873522f6634f: Time spent starting tablet: real 0.014s user 0.012s sys 0.000s
I20260808 14:50:45.187103 4214 heartbeater.cc:503] Master 127.26.206.254:33743 was elected leader, sending a full tablet report...
I20260808 14:50:45.187834 4247 ts_tablet_manager.cc:1428] T ab45c48b739842a4b94f6e0c629d9abc P 7dd600757c0f48eb802132ab9283ab57: Time spent starting tablet: real 0.013s user 0.010s sys 0.004s
W20260808 14:50:45.207702 3890 tablet.cc:2369] T ab45c48b739842a4b94f6e0c629d9abc P 59d0f9ffa2814130809f5d7dc33e2fd7: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 14:50:45.245405 4059 tablet.cc:2369] T ab45c48b739842a4b94f6e0c629d9abc P 659ff9080dce466990cb873522f6634f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:50:45.253713 4250 raft_consensus.cc:482] T ab45c48b739842a4b94f6e0c629d9abc P 59d0f9ffa2814130809f5d7dc33e2fd7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:50:45.253986 4250 raft_consensus.cc:504] T ab45c48b739842a4b94f6e0c629d9abc P 59d0f9ffa2814130809f5d7dc33e2fd7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "659ff9080dce466990cb873522f6634f" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 36935 } } peers { permanent_uuid: "59d0f9ffa2814130809f5d7dc33e2fd7" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 41307 } } peers { permanent_uuid: "7dd600757c0f48eb802132ab9283ab57" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 39641 } }
I20260808 14:50:45.255718 4250 leader_election.cc:288] T ab45c48b739842a4b94f6e0c629d9abc P 59d0f9ffa2814130809f5d7dc33e2fd7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 659ff9080dce466990cb873522f6634f (127.26.206.194:36935), 7dd600757c0f48eb802132ab9283ab57 (127.26.206.195:39641)
I20260808 14:50:45.263485 4239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:45.255996 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.193:48805 (local address 127.26.206.194:36935)
0808 14:50:45.256201 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:45.256210 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:45.256768 (+ 558us) server_negotiation.cc:407] Connection header received
0808 14:50:45.256987 (+ 219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:45.256996 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:45.257106 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:45.257197 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:50:45.257844 (+ 647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:45.258906 (+ 1062us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:45.261473 (+ 2567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:45.262649 (+ 1176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:45.262819 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:45.262897 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:45.263154 (+ 257us) server_negotiation.cc:299] Negotiation successful
0808 14:50:45.263274 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260808 14:50:45.263832 4243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:45.256911 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.193:40043 (local address 127.26.206.195:39641)
0808 14:50:45.257143 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:45.257151 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:45.257542 (+ 391us) server_negotiation.cc:407] Connection header received
0808 14:50:45.257696 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:45.257700 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:45.257773 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:45.257868 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:50:45.258364 (+ 496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:45.259329 (+ 965us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:45.261691 (+ 2362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:45.262907 (+ 1216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:45.263076 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:45.263166 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:45.263506 (+ 340us) server_negotiation.cc:299] Negotiation successful
0808 14:50:45.263654 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260808 14:50:45.263903 4254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:45.255967 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.194:36935 (local address 127.26.206.193:48805)
0808 14:50:45.256617 (+ 650us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:45.256633 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 14:50:45.256813 (+ 180us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:50:45.257244 (+ 431us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:50:45.257248 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:50:45.257274 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:50:45.257694 (+ 420us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:45.257705 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:45.259026 (+ 1321us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:45.259029 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:45.261331 (+ 2302us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:45.261346 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:45.262830 (+ 1484us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:45.262834 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:45.262960 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:45.262984 (+ 24us) client_negotiation.cc:769] Sending connection context
0808 14:50:45.263125 (+ 141us) client_negotiation.cc:240] Negotiation successful
0808 14:50:45.263253 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":531,"mutex_wait_us":64,"thread_start_us":369,"threads_started":1}
I20260808 14:50:45.264043 4255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:45.256735 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.195:39641 (local address 127.26.206.193:40043)
0808 14:50:45.257427 (+ 692us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:45.257443 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 14:50:45.257572 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:50:45.257886 (+ 314us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:50:45.257889 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:50:45.257909 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:50:45.258172 (+ 263us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:45.258178 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:45.259468 (+ 1290us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:45.259472 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:45.261551 (+ 2079us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:45.261561 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:45.263152 (+ 1591us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:45.263158 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:45.263322 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:45.263359 (+ 37us) client_negotiation.cc:769] Sending connection context
0808 14:50:45.263450 (+ 91us) client_negotiation.cc:240] Negotiation successful
0808 14:50:45.263593 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":550,"mutex_wait_us":1,"thread_start_us":339,"threads_started":1}
I20260808 14:50:45.264827 4004 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab45c48b739842a4b94f6e0c629d9abc" candidate_uuid: "59d0f9ffa2814130809f5d7dc33e2fd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "659ff9080dce466990cb873522f6634f" is_pre_election: true
I20260808 14:50:45.265198 4163 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab45c48b739842a4b94f6e0c629d9abc" candidate_uuid: "59d0f9ffa2814130809f5d7dc33e2fd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7dd600757c0f48eb802132ab9283ab57" is_pre_election: true
I20260808 14:50:45.265403 4004 raft_consensus.cc:2454] T ab45c48b739842a4b94f6e0c629d9abc P 659ff9080dce466990cb873522f6634f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59d0f9ffa2814130809f5d7dc33e2fd7 in term 0.
I20260808 14:50:45.265743 4163 raft_consensus.cc:2454] T ab45c48b739842a4b94f6e0c629d9abc P 7dd600757c0f48eb802132ab9283ab57 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59d0f9ffa2814130809f5d7dc33e2fd7 in term 0.
I20260808 14:50:45.266028 3751 leader_election.cc:302] T ab45c48b739842a4b94f6e0c629d9abc P 59d0f9ffa2814130809f5d7dc33e2fd7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59d0f9ffa2814130809f5d7dc33e2fd7, 659ff9080dce466990cb873522f6634f; no voters:
I20260808 14:50:45.266419 4250 raft_consensus.cc:2781] T ab45c48b739842a4b94f6e0c629d9abc P 59d0f9ffa2814130809f5d7dc33e2fd7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:50:45.266556 4250 raft_consensus.cc:482] T ab45c48b739842a4b94f6e0c629d9abc P 59d0f9ffa2814130809f5d7dc33e2fd7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:50:45.266665 4250 raft_consensus.cc:3037] T ab45c48b739842a4b94f6e0c629d9abc P 59d0f9ffa2814130809f5d7dc33e2fd7 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:50:45.268802 4250 raft_consensus.cc:504] T ab45c48b739842a4b94f6e0c629d9abc P 59d0f9ffa2814130809f5d7dc33e2fd7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "659ff9080dce466990cb873522f6634f" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 36935 } } peers { permanent_uuid: "59d0f9ffa2814130809f5d7dc33e2fd7" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 41307 } } peers { permanent_uuid: "7dd600757c0f48eb802132ab9283ab57" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 39641 } }
I20260808 14:50:45.269457 4250 leader_election.cc:288] T ab45c48b739842a4b94f6e0c629d9abc P 59d0f9ffa2814130809f5d7dc33e2fd7 [CANDIDATE]: Term 1 election: Requested vote from peers 659ff9080dce466990cb873522f6634f (127.26.206.194:36935), 7dd600757c0f48eb802132ab9283ab57 (127.26.206.195:39641)
I20260808 14:50:45.269722 4004 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab45c48b739842a4b94f6e0c629d9abc" candidate_uuid: "59d0f9ffa2814130809f5d7dc33e2fd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "659ff9080dce466990cb873522f6634f"
I20260808 14:50:45.269896 4163 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab45c48b739842a4b94f6e0c629d9abc" candidate_uuid: "59d0f9ffa2814130809f5d7dc33e2fd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7dd600757c0f48eb802132ab9283ab57"
I20260808 14:50:45.269918 4004 raft_consensus.cc:3037] T ab45c48b739842a4b94f6e0c629d9abc P 659ff9080dce466990cb873522f6634f [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:50:45.270093 4163 raft_consensus.cc:3037] T ab45c48b739842a4b94f6e0c629d9abc P 7dd600757c0f48eb802132ab9283ab57 [term 0 FOLLOWER]: Advancing to term 1
W20260808 14:50:45.271605 4215 tablet.cc:2369] T ab45c48b739842a4b94f6e0c629d9abc P 7dd600757c0f48eb802132ab9283ab57: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:50:45.272502 4163 raft_consensus.cc:2454] T ab45c48b739842a4b94f6e0c629d9abc P 7dd600757c0f48eb802132ab9283ab57 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59d0f9ffa2814130809f5d7dc33e2fd7 in term 1.
I20260808 14:50:45.272876 4004 raft_consensus.cc:2454] T ab45c48b739842a4b94f6e0c629d9abc P 659ff9080dce466990cb873522f6634f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59d0f9ffa2814130809f5d7dc33e2fd7 in term 1.
I20260808 14:50:45.272903 3751 leader_election.cc:302] T ab45c48b739842a4b94f6e0c629d9abc P 59d0f9ffa2814130809f5d7dc33e2fd7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59d0f9ffa2814130809f5d7dc33e2fd7, 7dd600757c0f48eb802132ab9283ab57; no voters:
I20260808 14:50:45.273243 4250 raft_consensus.cc:2781] T ab45c48b739842a4b94f6e0c629d9abc P 59d0f9ffa2814130809f5d7dc33e2fd7 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:50:45.273672 4250 raft_consensus.cc:686] T ab45c48b739842a4b94f6e0c629d9abc P 59d0f9ffa2814130809f5d7dc33e2fd7 [term 1 LEADER]: Becoming Leader. State: Replica: 59d0f9ffa2814130809f5d7dc33e2fd7, State: Running, Role: LEADER
I20260808 14:50:45.274120 4250 consensus_queue.cc:237] T ab45c48b739842a4b94f6e0c629d9abc P 59d0f9ffa2814130809f5d7dc33e2fd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "659ff9080dce466990cb873522f6634f" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 36935 } } peers { permanent_uuid: "59d0f9ffa2814130809f5d7dc33e2fd7" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 41307 } } peers { permanent_uuid: "7dd600757c0f48eb802132ab9283ab57" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 39641 } }
I20260808 14:50:45.278673 3657 catalog_manager.cc:5495] T ab45c48b739842a4b94f6e0c629d9abc P 59d0f9ffa2814130809f5d7dc33e2fd7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 59d0f9ffa2814130809f5d7dc33e2fd7 (127.26.206.193). New cstate: current_term: 1 leader_uuid: "59d0f9ffa2814130809f5d7dc33e2fd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "659ff9080dce466990cb873522f6634f" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 36935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59d0f9ffa2814130809f5d7dc33e2fd7" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 41307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7dd600757c0f48eb802132ab9283ab57" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 39641 } health_report { overall_health: UNKNOWN } } }
I20260808 14:50:45.327505 4240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:45.322079 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41674 (local address 127.26.206.193:41307)
0808 14:50:45.322290 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:45.322295 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:45.322314 (+ 19us) server_negotiation.cc:407] Connection header received
0808 14:50:45.322518 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:45.322522 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:45.322620 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:45.322797 (+ 177us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:50:45.323159 (+ 362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:45.323938 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:45.325284 (+ 1346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:45.325728 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:45.325888 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:45.326305 (+ 417us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:50:45.326886 (+ 581us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:50:45.327041 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:45.327151 (+ 110us) server_negotiation.cc:299] Negotiation successful
0808 14:50:45.327230 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260808 14:50:45.335309 4004 raft_consensus.cc:1261] T ab45c48b739842a4b94f6e0c629d9abc P 659ff9080dce466990cb873522f6634f [term 1 FOLLOWER]: Refusing update from remote peer 59d0f9ffa2814130809f5d7dc33e2fd7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:50:45.335361 4163 raft_consensus.cc:1261] T ab45c48b739842a4b94f6e0c629d9abc P 7dd600757c0f48eb802132ab9283ab57 [term 1 FOLLOWER]: Refusing update from remote peer 59d0f9ffa2814130809f5d7dc33e2fd7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:50:45.336313 4257 consensus_queue.cc:1035] T ab45c48b739842a4b94f6e0c629d9abc P 59d0f9ffa2814130809f5d7dc33e2fd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "659ff9080dce466990cb873522f6634f" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 36935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:50:45.336700 4250 consensus_queue.cc:1035] T ab45c48b739842a4b94f6e0c629d9abc P 59d0f9ffa2814130809f5d7dc33e2fd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7dd600757c0f48eb802132ab9283ab57" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 39641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:50:45.364544 3657 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58256:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:50:45.364796 3657 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58256:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:50:45.368432 3657 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d4216fed87a840f587a730f82785f89a: Sending DeleteTablet for 3 replicas of tablet ab45c48b739842a4b94f6e0c629d9abc
I20260808 14:50:45.369544 3808 tablet_service.cc:1514] Processing DeleteTablet for tablet ab45c48b739842a4b94f6e0c629d9abc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:50:45 UTC) from {username='oryx', principal='oryx/127.26.206.254@KRBTEST.COM'} at 127.0.0.1:41664
I20260808 14:50:45.369639 3977 tablet_service.cc:1514] Processing DeleteTablet for tablet ab45c48b739842a4b94f6e0c629d9abc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:50:45 UTC) from {username='oryx', principal='oryx/127.26.206.254@KRBTEST.COM'} at 127.0.0.1:45316
I20260808 14:50:45.369666 4136 tablet_service.cc:1514] Processing DeleteTablet for tablet ab45c48b739842a4b94f6e0c629d9abc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:50:45 UTC) from {username='oryx', principal='oryx/127.26.206.254@KRBTEST.COM'} at 127.0.0.1:53870
I20260808 14:50:45.371814 3657 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58256:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:50:45.372684 3657 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:50:45.380647 4274 tablet_replica.cc:330] T ab45c48b739842a4b94f6e0c629d9abc P 7dd600757c0f48eb802132ab9283ab57: stopping tablet replica
I20260808 14:50:45.381165 4274 raft_consensus.cc:2229] T ab45c48b739842a4b94f6e0c629d9abc P 7dd600757c0f48eb802132ab9283ab57 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:50:45.381696 4274 raft_consensus.cc:2258] T ab45c48b739842a4b94f6e0c629d9abc P 7dd600757c0f48eb802132ab9283ab57 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:50:45.383893 3807 tablet_service.cc:1467] Processing CreateTablet for tablet 96b9c7e8e2044198944036e043098544 (DEFAULT_TABLE table=test-table [id=40af4086ee63458e9125b2f78221d39d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:50:45.384790 3807 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 96b9c7e8e2044198944036e043098544. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:50:45.387400 4136 tablet_service.cc:1467] Processing CreateTablet for tablet 96b9c7e8e2044198944036e043098544 (DEFAULT_TABLE table=test-table [id=40af4086ee63458e9125b2f78221d39d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:50:45.387895 4136 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 96b9c7e8e2044198944036e043098544. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:50:45.390203 3975 tablet_service.cc:1467] Processing CreateTablet for tablet 96b9c7e8e2044198944036e043098544 (DEFAULT_TABLE table=test-table [id=40af4086ee63458e9125b2f78221d39d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:50:45.390818 3975 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 96b9c7e8e2044198944036e043098544. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:50:45.394430 4247 tablet_bootstrap.cc:492] T 96b9c7e8e2044198944036e043098544 P 7dd600757c0f48eb802132ab9283ab57: Bootstrap starting.
I20260808 14:50:45.396132 4247 tablet_bootstrap.cc:654] T 96b9c7e8e2044198944036e043098544 P 7dd600757c0f48eb802132ab9283ab57: Neither blocks nor log segments found. Creating new log.
I20260808 14:50:45.402228 4273 tablet_replica.cc:330] T ab45c48b739842a4b94f6e0c629d9abc P 659ff9080dce466990cb873522f6634f: stopping tablet replica
I20260808 14:50:45.402906 4273 raft_consensus.cc:2229] T ab45c48b739842a4b94f6e0c629d9abc P 659ff9080dce466990cb873522f6634f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:50:45.403512 4273 raft_consensus.cc:2258] T ab45c48b739842a4b94f6e0c629d9abc P 659ff9080dce466990cb873522f6634f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:50:45.404495 4272 tablet_replica.cc:330] T ab45c48b739842a4b94f6e0c629d9abc P 59d0f9ffa2814130809f5d7dc33e2fd7: stopping tablet replica
I20260808 14:50:45.406031 4272 raft_consensus.cc:2229] T ab45c48b739842a4b94f6e0c629d9abc P 59d0f9ffa2814130809f5d7dc33e2fd7 [term 1 LEADER]: Raft consensus shutting down.
I20260808 14:50:45.406327 4244 tablet_bootstrap.cc:492] T 96b9c7e8e2044198944036e043098544 P 59d0f9ffa2814130809f5d7dc33e2fd7: Bootstrap starting.
I20260808 14:50:45.406821 4272 raft_consensus.cc:2258] T ab45c48b739842a4b94f6e0c629d9abc P 59d0f9ffa2814130809f5d7dc33e2fd7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:50:45.407907 4245 tablet_bootstrap.cc:492] T 96b9c7e8e2044198944036e043098544 P 659ff9080dce466990cb873522f6634f: Bootstrap starting.
I20260808 14:50:45.408085 4244 tablet_bootstrap.cc:654] T 96b9c7e8e2044198944036e043098544 P 59d0f9ffa2814130809f5d7dc33e2fd7: Neither blocks nor log segments found. Creating new log.
I20260808 14:50:45.409515 4245 tablet_bootstrap.cc:654] T 96b9c7e8e2044198944036e043098544 P 659ff9080dce466990cb873522f6634f: Neither blocks nor log segments found. Creating new log.
I20260808 14:50:45.409705 4247 tablet_bootstrap.cc:492] T 96b9c7e8e2044198944036e043098544 P 7dd600757c0f48eb802132ab9283ab57: No bootstrap required, opened a new log
I20260808 14:50:45.409868 4247 ts_tablet_manager.cc:1397] T 96b9c7e8e2044198944036e043098544 P 7dd600757c0f48eb802132ab9283ab57: Time spent bootstrapping tablet: real 0.016s user 0.003s sys 0.009s
I20260808 14:50:45.410422 4272 ts_tablet_manager.cc:1905] T ab45c48b739842a4b94f6e0c629d9abc P 59d0f9ffa2814130809f5d7dc33e2fd7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:50:45.410746 4247 raft_consensus.cc:348] T 96b9c7e8e2044198944036e043098544 P 7dd600757c0f48eb802132ab9283ab57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59d0f9ffa2814130809f5d7dc33e2fd7" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 41307 } } peers { permanent_uuid: "659ff9080dce466990cb873522f6634f" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 36935 } } peers { permanent_uuid: "7dd600757c0f48eb802132ab9283ab57" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 39641 } }
I20260808 14:50:45.410997 4247 raft_consensus.cc:374] T 96b9c7e8e2044198944036e043098544 P 7dd600757c0f48eb802132ab9283ab57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:50:45.411124 4247 raft_consensus.cc:729] T 96b9c7e8e2044198944036e043098544 P 7dd600757c0f48eb802132ab9283ab57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7dd600757c0f48eb802132ab9283ab57, State: Initialized, Role: FOLLOWER
I20260808 14:50:45.411444 4247 consensus_queue.cc:260] T 96b9c7e8e2044198944036e043098544 P 7dd600757c0f48eb802132ab9283ab57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59d0f9ffa2814130809f5d7dc33e2fd7" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 41307 } } peers { permanent_uuid: "659ff9080dce466990cb873522f6634f" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 36935 } } peers { permanent_uuid: "7dd600757c0f48eb802132ab9283ab57" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 39641 } }
I20260808 14:50:45.412369 4274 ts_tablet_manager.cc:1905] T ab45c48b739842a4b94f6e0c629d9abc P 7dd600757c0f48eb802132ab9283ab57: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:50:45.412626 4252 raft_consensus.cc:482] T 96b9c7e8e2044198944036e043098544 P 7dd600757c0f48eb802132ab9283ab57 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:50:45.412782 4252 raft_consensus.cc:504] T 96b9c7e8e2044198944036e043098544 P 7dd600757c0f48eb802132ab9283ab57 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59d0f9ffa2814130809f5d7dc33e2fd7" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 41307 } } peers { permanent_uuid: "659ff9080dce466990cb873522f6634f" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 36935 } } peers { permanent_uuid: "7dd600757c0f48eb802132ab9283ab57" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 39641 } }
I20260808 14:50:45.414517 4252 leader_election.cc:288] T 96b9c7e8e2044198944036e043098544 P 7dd600757c0f48eb802132ab9283ab57 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59d0f9ffa2814130809f5d7dc33e2fd7 (127.26.206.193:41307), 659ff9080dce466990cb873522f6634f (127.26.206.194:36935)
I20260808 14:50:45.416869 4272 ts_tablet_manager.cc:1918] T ab45c48b739842a4b94f6e0c629d9abc P 59d0f9ffa2814130809f5d7dc33e2fd7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:50:45.417012 4272 log.cc:1196] T ab45c48b739842a4b94f6e0c629d9abc P 59d0f9ffa2814130809f5d7dc33e2fd7: Deleting WAL directory at /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200577490656-27451-0/minicluster-data/ts-0/wal/wals/ab45c48b739842a4b94f6e0c629d9abc
I20260808 14:50:45.417536 4272 ts_tablet_manager.cc:1939] T ab45c48b739842a4b94f6e0c629d9abc P 59d0f9ffa2814130809f5d7dc33e2fd7: Deleting consensus metadata
I20260808 14:50:45.419198 3642 catalog_manager.cc:4841] TS 59d0f9ffa2814130809f5d7dc33e2fd7 (127.26.206.193:41307): tablet ab45c48b739842a4b94f6e0c629d9abc (table test-table [id=310a8d03e6cf4327ad5ce3c9d63f51b4]) successfully deleted
I20260808 14:50:45.420547 4244 tablet_bootstrap.cc:492] T 96b9c7e8e2044198944036e043098544 P 59d0f9ffa2814130809f5d7dc33e2fd7: No bootstrap required, opened a new log
I20260808 14:50:45.420702 4244 ts_tablet_manager.cc:1397] T 96b9c7e8e2044198944036e043098544 P 59d0f9ffa2814130809f5d7dc33e2fd7: Time spent bootstrapping tablet: real 0.014s user 0.002s sys 0.001s
I20260808 14:50:45.421326 4274 ts_tablet_manager.cc:1918] T ab45c48b739842a4b94f6e0c629d9abc P 7dd600757c0f48eb802132ab9283ab57: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:50:45.421519 4274 log.cc:1196] T ab45c48b739842a4b94f6e0c629d9abc P 7dd600757c0f48eb802132ab9283ab57: Deleting WAL directory at /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200577490656-27451-0/minicluster-data/ts-2/wal/wals/ab45c48b739842a4b94f6e0c629d9abc
I20260808 14:50:45.421497 4244 raft_consensus.cc:348] T 96b9c7e8e2044198944036e043098544 P 59d0f9ffa2814130809f5d7dc33e2fd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59d0f9ffa2814130809f5d7dc33e2fd7" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 41307 } } peers { permanent_uuid: "659ff9080dce466990cb873522f6634f" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 36935 } } peers { permanent_uuid: "7dd600757c0f48eb802132ab9283ab57" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 39641 } }
I20260808 14:50:45.421751 4244 raft_consensus.cc:374] T 96b9c7e8e2044198944036e043098544 P 59d0f9ffa2814130809f5d7dc33e2fd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:50:45.421859 4244 raft_consensus.cc:729] T 96b9c7e8e2044198944036e043098544 P 59d0f9ffa2814130809f5d7dc33e2fd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59d0f9ffa2814130809f5d7dc33e2fd7, State: Initialized, Role: FOLLOWER
I20260808 14:50:45.422216 4274 ts_tablet_manager.cc:1939] T ab45c48b739842a4b94f6e0c629d9abc P 7dd600757c0f48eb802132ab9283ab57: Deleting consensus metadata
I20260808 14:50:45.422140 4244 consensus_queue.cc:260] T 96b9c7e8e2044198944036e043098544 P 59d0f9ffa2814130809f5d7dc33e2fd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59d0f9ffa2814130809f5d7dc33e2fd7" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 41307 } } peers { permanent_uuid: "659ff9080dce466990cb873522f6634f" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 36935 } } peers { permanent_uuid: "7dd600757c0f48eb802132ab9283ab57" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 39641 } }
I20260808 14:50:45.422758 4244 ts_tablet_manager.cc:1428] T 96b9c7e8e2044198944036e043098544 P 59d0f9ffa2814130809f5d7dc33e2fd7: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 14:50:45.423350 4088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:45.414864 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.193:41307 (local address 127.26.206.195:45273)
0808 14:50:45.415023 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:45.415046 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 14:50:45.415157 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:50:45.415876 (+ 719us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:50:45.415881 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:50:45.415908 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:50:45.416092 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:45.416101 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:45.417739 (+ 1638us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:45.417747 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:45.419874 (+ 2127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:45.419891 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:45.422513 (+ 2622us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:45.422518 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:45.422749 (+ 231us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:45.422792 (+ 43us) client_negotiation.cc:769] Sending connection context
0808 14:50:45.422942 (+ 150us) client_negotiation.cc:240] Negotiation successful
0808 14:50:45.423071 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":40}
I20260808 14:50:45.424050 4240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:45.415226 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.195:45273 (local address 127.26.206.193:41307)
0808 14:50:45.415406 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:45.415412 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:45.415431 (+ 19us) server_negotiation.cc:407] Connection header received
0808 14:50:45.415490 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:45.415495 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:45.415604 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:45.415706 (+ 102us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:50:45.416241 (+ 535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:45.417399 (+ 1158us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:45.420649 (+ 3250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:45.421938 (+ 1289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:45.422097 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:45.422182 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:45.423619 (+ 1437us) server_negotiation.cc:299] Negotiation successful
0808 14:50:45.423755 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260808 14:50:45.423617 4247 ts_tablet_manager.cc:1428] T 96b9c7e8e2044198944036e043098544 P 7dd600757c0f48eb802132ab9283ab57: Time spent starting tablet: real 0.014s user 0.003s sys 0.000s
I20260808 14:50:45.425621 3839 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "96b9c7e8e2044198944036e043098544" candidate_uuid: "7dd600757c0f48eb802132ab9283ab57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59d0f9ffa2814130809f5d7dc33e2fd7" is_pre_election: true
I20260808 14:50:45.426033 3839 raft_consensus.cc:2454] T 96b9c7e8e2044198944036e043098544 P 59d0f9ffa2814130809f5d7dc33e2fd7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7dd600757c0f48eb802132ab9283ab57 in term 0.
I20260808 14:50:45.426687 4083 leader_election.cc:302] T 96b9c7e8e2044198944036e043098544 P 7dd600757c0f48eb802132ab9283ab57 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59d0f9ffa2814130809f5d7dc33e2fd7, 7dd600757c0f48eb802132ab9283ab57; no voters:
I20260808 14:50:45.427114 4252 raft_consensus.cc:2781] T 96b9c7e8e2044198944036e043098544 P 7dd600757c0f48eb802132ab9283ab57 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:50:45.427268 4252 raft_consensus.cc:482] T 96b9c7e8e2044198944036e043098544 P 7dd600757c0f48eb802132ab9283ab57 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:50:45.427383 4252 raft_consensus.cc:3037] T 96b9c7e8e2044198944036e043098544 P 7dd600757c0f48eb802132ab9283ab57 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:50:45.429442 4273 ts_tablet_manager.cc:1905] T ab45c48b739842a4b94f6e0c629d9abc P 659ff9080dce466990cb873522f6634f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:50:45.431885 4239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:45.415319 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.195:37915 (local address 127.26.206.194:36935)
0808 14:50:45.415487 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:45.415494 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:45.424823 (+ 9329us) server_negotiation.cc:407] Connection header received
0808 14:50:45.424900 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:45.424905 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:45.424978 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:45.425077 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:50:45.425582 (+ 505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:45.426655 (+ 1073us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:45.429323 (+ 2668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:45.430590 (+ 1267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:45.430716 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:45.430802 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:45.431415 (+ 613us) server_negotiation.cc:299] Negotiation successful
0808 14:50:45.431575 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260808 14:50:45.432013 4245 tablet_bootstrap.cc:492] T 96b9c7e8e2044198944036e043098544 P 659ff9080dce466990cb873522f6634f: No bootstrap required, opened a new log
I20260808 14:50:45.432199 4245 ts_tablet_manager.cc:1397] T 96b9c7e8e2044198944036e043098544 P 659ff9080dce466990cb873522f6634f: Time spent bootstrapping tablet: real 0.024s user 0.003s sys 0.000s
I20260808 14:50:45.432793 4088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:45.414963 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.194:36935 (local address 127.26.206.195:37915)
0808 14:50:45.424638 (+ 9675us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:45.424656 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 14:50:45.424761 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:50:45.425128 (+ 367us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:50:45.425134 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:50:45.425160 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:50:45.425382 (+ 222us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:45.425398 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:45.426992 (+ 1594us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:45.426998 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:45.429104 (+ 2106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:45.429121 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:45.431024 (+ 1903us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:45.431030 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:45.431211 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:45.431249 (+ 38us) client_negotiation.cc:769] Sending connection context
0808 14:50:45.432350 (+ 1101us) client_negotiation.cc:240] Negotiation successful
0808 14:50:45.432482 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9575,"threads_started":1}
I20260808 14:50:45.433212 4245 raft_consensus.cc:348] T 96b9c7e8e2044198944036e043098544 P 659ff9080dce466990cb873522f6634f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59d0f9ffa2814130809f5d7dc33e2fd7" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 41307 } } peers { permanent_uuid: "659ff9080dce466990cb873522f6634f" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 36935 } } peers { permanent_uuid: "7dd600757c0f48eb802132ab9283ab57" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 39641 } }
I20260808 14:50:45.433521 4245 raft_consensus.cc:374] T 96b9c7e8e2044198944036e043098544 P 659ff9080dce466990cb873522f6634f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:50:45.433656 4245 raft_consensus.cc:729] T 96b9c7e8e2044198944036e043098544 P 659ff9080dce466990cb873522f6634f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 659ff9080dce466990cb873522f6634f, State: Initialized, Role: FOLLOWER
I20260808 14:50:45.433979 4245 consensus_queue.cc:260] T 96b9c7e8e2044198944036e043098544 P 659ff9080dce466990cb873522f6634f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59d0f9ffa2814130809f5d7dc33e2fd7" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 41307 } } peers { permanent_uuid: "659ff9080dce466990cb873522f6634f" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 36935 } } peers { permanent_uuid: "7dd600757c0f48eb802132ab9283ab57" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 39641 } }
I20260808 14:50:45.434890 4245 ts_tablet_manager.cc:1428] T 96b9c7e8e2044198944036e043098544 P 659ff9080dce466990cb873522f6634f: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 14:50:45.440649 4252 raft_consensus.cc:504] T 96b9c7e8e2044198944036e043098544 P 7dd600757c0f48eb802132ab9283ab57 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59d0f9ffa2814130809f5d7dc33e2fd7" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 41307 } } peers { permanent_uuid: "659ff9080dce466990cb873522f6634f" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 36935 } } peers { permanent_uuid: "7dd600757c0f48eb802132ab9283ab57" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 39641 } }
I20260808 14:50:45.441541 4252 leader_election.cc:288] T 96b9c7e8e2044198944036e043098544 P 7dd600757c0f48eb802132ab9283ab57 [CANDIDATE]: Term 1 election: Requested vote from peers 59d0f9ffa2814130809f5d7dc33e2fd7 (127.26.206.193:41307), 659ff9080dce466990cb873522f6634f (127.26.206.194:36935)
I20260808 14:50:45.441912 3839 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "96b9c7e8e2044198944036e043098544" candidate_uuid: "7dd600757c0f48eb802132ab9283ab57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59d0f9ffa2814130809f5d7dc33e2fd7"
I20260808 14:50:45.442101 3839 raft_consensus.cc:3037] T 96b9c7e8e2044198944036e043098544 P 59d0f9ffa2814130809f5d7dc33e2fd7 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:50:45.444339 3839 raft_consensus.cc:2454] T 96b9c7e8e2044198944036e043098544 P 59d0f9ffa2814130809f5d7dc33e2fd7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7dd600757c0f48eb802132ab9283ab57 in term 1.
I20260808 14:50:45.444855 4083 leader_election.cc:302] T 96b9c7e8e2044198944036e043098544 P 7dd600757c0f48eb802132ab9283ab57 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59d0f9ffa2814130809f5d7dc33e2fd7, 7dd600757c0f48eb802132ab9283ab57; no voters:
I20260808 14:50:45.445151 4252 raft_consensus.cc:2781] T 96b9c7e8e2044198944036e043098544 P 7dd600757c0f48eb802132ab9283ab57 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:50:45.445652 4252 raft_consensus.cc:686] T 96b9c7e8e2044198944036e043098544 P 7dd600757c0f48eb802132ab9283ab57 [term 1 LEADER]: Becoming Leader. State: Replica: 7dd600757c0f48eb802132ab9283ab57, State: Running, Role: LEADER
I20260808 14:50:45.446475 4252 consensus_queue.cc:237] T 96b9c7e8e2044198944036e043098544 P 7dd600757c0f48eb802132ab9283ab57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59d0f9ffa2814130809f5d7dc33e2fd7" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 41307 } } peers { permanent_uuid: "659ff9080dce466990cb873522f6634f" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 36935 } } peers { permanent_uuid: "7dd600757c0f48eb802132ab9283ab57" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 39641 } }
I20260808 14:50:45.449008 3639 catalog_manager.cc:4841] TS 7dd600757c0f48eb802132ab9283ab57 (127.26.206.195:39641): tablet ab45c48b739842a4b94f6e0c629d9abc (table test-table [id=310a8d03e6cf4327ad5ce3c9d63f51b4]) successfully deleted
I20260808 14:50:45.449834 4004 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "96b9c7e8e2044198944036e043098544" candidate_uuid: "7dd600757c0f48eb802132ab9283ab57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "659ff9080dce466990cb873522f6634f" is_pre_election: true
I20260808 14:50:45.450067 4004 raft_consensus.cc:2454] T 96b9c7e8e2044198944036e043098544 P 659ff9080dce466990cb873522f6634f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7dd600757c0f48eb802132ab9283ab57 in term 0.
I20260808 14:50:45.450767 4004 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "96b9c7e8e2044198944036e043098544" candidate_uuid: "7dd600757c0f48eb802132ab9283ab57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "659ff9080dce466990cb873522f6634f"
I20260808 14:50:45.450947 4004 raft_consensus.cc:3037] T 96b9c7e8e2044198944036e043098544 P 659ff9080dce466990cb873522f6634f [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:50:45.450687 3656 catalog_manager.cc:5495] T 96b9c7e8e2044198944036e043098544 P 7dd600757c0f48eb802132ab9283ab57 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7dd600757c0f48eb802132ab9283ab57 (127.26.206.195). New cstate: current_term: 1 leader_uuid: "7dd600757c0f48eb802132ab9283ab57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59d0f9ffa2814130809f5d7dc33e2fd7" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 41307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "659ff9080dce466990cb873522f6634f" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 36935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7dd600757c0f48eb802132ab9283ab57" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 39641 } health_report { overall_health: HEALTHY } } }
I20260808 14:50:45.453811 4004 raft_consensus.cc:2454] T 96b9c7e8e2044198944036e043098544 P 659ff9080dce466990cb873522f6634f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7dd600757c0f48eb802132ab9283ab57 in term 1.
I20260808 14:50:45.456348 4273 ts_tablet_manager.cc:1918] T ab45c48b739842a4b94f6e0c629d9abc P 659ff9080dce466990cb873522f6634f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:50:45.456506 4273 log.cc:1196] T ab45c48b739842a4b94f6e0c629d9abc P 659ff9080dce466990cb873522f6634f: Deleting WAL directory at /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200577490656-27451-0/minicluster-data/ts-1/wal/wals/ab45c48b739842a4b94f6e0c629d9abc
I20260808 14:50:45.456985 4273 ts_tablet_manager.cc:1939] T ab45c48b739842a4b94f6e0c629d9abc P 659ff9080dce466990cb873522f6634f: Deleting consensus metadata
I20260808 14:50:45.458359 3639 catalog_manager.cc:4841] TS 659ff9080dce466990cb873522f6634f (127.26.206.194:36935): tablet ab45c48b739842a4b94f6e0c629d9abc (table test-table [id=310a8d03e6cf4327ad5ce3c9d63f51b4]) successfully deleted
Aug 08 14:50:45 dist-test-slave-6k22 krb5kdc[3604](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200643, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.206.254@KRBTEST.COM for oryx/127.26.206.254@KRBTEST.COM
I20260808 14:50:45.512405 4288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:45.494164 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:33743 (local address 127.0.0.1:58272)
0808 14:50:45.494859 (+ 695us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:45.494875 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 14:50:45.495041 (+ 166us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:50:45.495356 (+ 315us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:50:45.495360 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:50:45.496134 (+ 774us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:50:45.496533 (+ 399us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:45.496548 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:45.497602 (+ 1054us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:45.497608 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:45.498633 (+ 1025us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:45.498645 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:45.499405 (+ 760us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:45.499411 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:45.499635 (+ 224us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:45.500374 (+ 739us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:50:45.500405 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:50:45.502613 (+ 2208us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:50:45.509865 (+ 7252us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:50:45.509879 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:50:45.509886 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:50:45.510289 (+ 403us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:50:45.510647 (+ 358us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:50:45.510653 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:50:45.510656 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:50:45.510792 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:50:45.511296 (+ 504us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:50:45.511305 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:50:45.511475 (+ 170us) client_negotiation.cc:769] Sending connection context
0808 14:50:45.511657 (+ 182us) client_negotiation.cc:240] Negotiation successful
0808 14:50:45.511938 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":546,"thread_start_us":384,"threads_started":1}
I20260808 14:50:45.512422 3760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:45.494148 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58272 (local address 127.26.206.254:33743)
0808 14:50:45.494370 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:45.494378 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:45.494969 (+ 591us) server_negotiation.cc:407] Connection header received
0808 14:50:45.495167 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:45.495172 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:45.495233 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:45.495333 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:45.496688 (+ 1355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:45.497468 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:45.498787 (+ 1319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:45.499176 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:45.499352 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:45.502800 (+ 3448us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:50:45.502805 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:50:45.502807 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:50:45.502834 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:50:45.509718 (+ 6884us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:45.510404 (+ 686us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:45.510411 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:45.510415 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:45.510538 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:45.510909 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:45.510914 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:45.510917 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:45.511171 (+ 254us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:50:45.511347 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:45.511739 (+ 392us) server_negotiation.cc:299] Negotiation successful
0808 14:50:45.512066 (+ 327us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":130,"server-negotiator.queue_time_us":70}
I20260808 14:50:45.517841 3656 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.26.206.254@KRBTEST.COM'} at 127.0.0.1:58272:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260808 14:50:45.518987 3656 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:50:45.526328 3807 tablet_service.cc:1467] Processing CreateTablet for tablet 5ad233430fd04c0d92788b5feed2c15c (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=af066b28aeca4d77a533d71df5f46b30]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 14:50:45.526410 3975 tablet_service.cc:1467] Processing CreateTablet for tablet 5ad233430fd04c0d92788b5feed2c15c (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=af066b28aeca4d77a533d71df5f46b30]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 14:50:45.526922 3975 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5ad233430fd04c0d92788b5feed2c15c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:50:45.526933 3807 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5ad233430fd04c0d92788b5feed2c15c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:50:45.528218 4136 tablet_service.cc:1467] Processing CreateTablet for tablet 5ad233430fd04c0d92788b5feed2c15c (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=af066b28aeca4d77a533d71df5f46b30]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 14:50:45.528800 4136 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5ad233430fd04c0d92788b5feed2c15c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:50:45.534221 4245 tablet_bootstrap.cc:492] T 5ad233430fd04c0d92788b5feed2c15c P 659ff9080dce466990cb873522f6634f: Bootstrap starting.
I20260808 14:50:45.534229 4244 tablet_bootstrap.cc:492] T 5ad233430fd04c0d92788b5feed2c15c P 59d0f9ffa2814130809f5d7dc33e2fd7: Bootstrap starting.
I20260808 14:50:45.536070 4244 tablet_bootstrap.cc:654] T 5ad233430fd04c0d92788b5feed2c15c P 59d0f9ffa2814130809f5d7dc33e2fd7: Neither blocks nor log segments found. Creating new log.
I20260808 14:50:45.536062 4245 tablet_bootstrap.cc:654] T 5ad233430fd04c0d92788b5feed2c15c P 659ff9080dce466990cb873522f6634f: Neither blocks nor log segments found. Creating new log.
I20260808 14:50:45.537241 4247 tablet_bootstrap.cc:492] T 5ad233430fd04c0d92788b5feed2c15c P 7dd600757c0f48eb802132ab9283ab57: Bootstrap starting.
I20260808 14:50:45.539165 4247 tablet_bootstrap.cc:654] T 5ad233430fd04c0d92788b5feed2c15c P 7dd600757c0f48eb802132ab9283ab57: Neither blocks nor log segments found. Creating new log.
I20260808 14:50:45.539252 4245 tablet_bootstrap.cc:492] T 5ad233430fd04c0d92788b5feed2c15c P 659ff9080dce466990cb873522f6634f: No bootstrap required, opened a new log
I20260808 14:50:45.539400 4245 ts_tablet_manager.cc:1397] T 5ad233430fd04c0d92788b5feed2c15c P 659ff9080dce466990cb873522f6634f: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260808 14:50:45.540266 4245 raft_consensus.cc:348] T 5ad233430fd04c0d92788b5feed2c15c P 659ff9080dce466990cb873522f6634f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59d0f9ffa2814130809f5d7dc33e2fd7" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 41307 } } peers { permanent_uuid: "659ff9080dce466990cb873522f6634f" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 36935 } } peers { permanent_uuid: "7dd600757c0f48eb802132ab9283ab57" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 39641 } }
I20260808 14:50:45.540602 4245 raft_consensus.cc:374] T 5ad233430fd04c0d92788b5feed2c15c P 659ff9080dce466990cb873522f6634f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:50:45.540702 4245 raft_consensus.cc:729] T 5ad233430fd04c0d92788b5feed2c15c P 659ff9080dce466990cb873522f6634f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 659ff9080dce466990cb873522f6634f, State: Initialized, Role: FOLLOWER
I20260808 14:50:45.541079 4245 consensus_queue.cc:260] T 5ad233430fd04c0d92788b5feed2c15c P 659ff9080dce466990cb873522f6634f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59d0f9ffa2814130809f5d7dc33e2fd7" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 41307 } } peers { permanent_uuid: "659ff9080dce466990cb873522f6634f" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 36935 } } peers { permanent_uuid: "7dd600757c0f48eb802132ab9283ab57" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 39641 } }
I20260808 14:50:45.541782 4244 tablet_bootstrap.cc:492] T 5ad233430fd04c0d92788b5feed2c15c P 59d0f9ffa2814130809f5d7dc33e2fd7: No bootstrap required, opened a new log
I20260808 14:50:45.541620 4251 tablet_replica.cc:439] T 5ad233430fd04c0d92788b5feed2c15c P 659ff9080dce466990cb873522f6634f: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59d0f9ffa2814130809f5d7dc33e2fd7" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 41307 } } peers { permanent_uuid: "659ff9080dce466990cb873522f6634f" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 36935 } } peers { permanent_uuid: "7dd600757c0f48eb802132ab9283ab57" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 39641 } } }
I20260808 14:50:45.541996 4244 ts_tablet_manager.cc:1397] T 5ad233430fd04c0d92788b5feed2c15c P 59d0f9ffa2814130809f5d7dc33e2fd7: Time spent bootstrapping tablet: real 0.008s user 0.004s sys 0.000s
I20260808 14:50:45.542078 4251 tablet_replica.cc:442] T 5ad233430fd04c0d92788b5feed2c15c P 659ff9080dce466990cb873522f6634f: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 14:50:45.543812 4244 raft_consensus.cc:348] T 5ad233430fd04c0d92788b5feed2c15c P 59d0f9ffa2814130809f5d7dc33e2fd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59d0f9ffa2814130809f5d7dc33e2fd7" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 41307 } } peers { permanent_uuid: "659ff9080dce466990cb873522f6634f" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 36935 } } peers { permanent_uuid: "7dd600757c0f48eb802132ab9283ab57" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 39641 } }
I20260808 14:50:45.544138 4244 raft_consensus.cc:374] T 5ad233430fd04c0d92788b5feed2c15c P 59d0f9ffa2814130809f5d7dc33e2fd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:50:45.544276 4244 raft_consensus.cc:729] T 5ad233430fd04c0d92788b5feed2c15c P 59d0f9ffa2814130809f5d7dc33e2fd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59d0f9ffa2814130809f5d7dc33e2fd7, State: Initialized, Role: FOLLOWER
I20260808 14:50:45.544560 4244 consensus_queue.cc:260] T 5ad233430fd04c0d92788b5feed2c15c P 59d0f9ffa2814130809f5d7dc33e2fd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59d0f9ffa2814130809f5d7dc33e2fd7" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 41307 } } peers { permanent_uuid: "659ff9080dce466990cb873522f6634f" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 36935 } } peers { permanent_uuid: "7dd600757c0f48eb802132ab9283ab57" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 39641 } }
I20260808 14:50:45.545252 4244 ts_tablet_manager.cc:1428] T 5ad233430fd04c0d92788b5feed2c15c P 59d0f9ffa2814130809f5d7dc33e2fd7: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260808 14:50:45.545207 4267 tablet_replica.cc:439] T 5ad233430fd04c0d92788b5feed2c15c P 59d0f9ffa2814130809f5d7dc33e2fd7: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59d0f9ffa2814130809f5d7dc33e2fd7" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 41307 } } peers { permanent_uuid: "659ff9080dce466990cb873522f6634f" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 36935 } } peers { permanent_uuid: "7dd600757c0f48eb802132ab9283ab57" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 39641 } } }
I20260808 14:50:45.545735 4267 tablet_replica.cc:442] T 5ad233430fd04c0d92788b5feed2c15c P 59d0f9ffa2814130809f5d7dc33e2fd7: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 14:50:45.546850 4247 tablet_bootstrap.cc:492] T 5ad233430fd04c0d92788b5feed2c15c P 7dd600757c0f48eb802132ab9283ab57: No bootstrap required, opened a new log
I20260808 14:50:45.547013 4247 ts_tablet_manager.cc:1397] T 5ad233430fd04c0d92788b5feed2c15c P 7dd600757c0f48eb802132ab9283ab57: Time spent bootstrapping tablet: real 0.010s user 0.006s sys 0.003s
I20260808 14:50:45.547446 4245 ts_tablet_manager.cc:1428] T 5ad233430fd04c0d92788b5feed2c15c P 659ff9080dce466990cb873522f6634f: Time spent starting tablet: real 0.008s user 0.003s sys 0.000s
I20260808 14:50:45.548389 4247 raft_consensus.cc:348] T 5ad233430fd04c0d92788b5feed2c15c P 7dd600757c0f48eb802132ab9283ab57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59d0f9ffa2814130809f5d7dc33e2fd7" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 41307 } } peers { permanent_uuid: "659ff9080dce466990cb873522f6634f" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 36935 } } peers { permanent_uuid: "7dd600757c0f48eb802132ab9283ab57" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 39641 } }
I20260808 14:50:45.548658 4247 raft_consensus.cc:374] T 5ad233430fd04c0d92788b5feed2c15c P 7dd600757c0f48eb802132ab9283ab57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:50:45.548753 4247 raft_consensus.cc:729] T 5ad233430fd04c0d92788b5feed2c15c P 7dd600757c0f48eb802132ab9283ab57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7dd600757c0f48eb802132ab9283ab57, State: Initialized, Role: FOLLOWER
I20260808 14:50:45.549005 4247 consensus_queue.cc:260] T 5ad233430fd04c0d92788b5feed2c15c P 7dd600757c0f48eb802132ab9283ab57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59d0f9ffa2814130809f5d7dc33e2fd7" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 41307 } } peers { permanent_uuid: "659ff9080dce466990cb873522f6634f" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 36935 } } peers { permanent_uuid: "7dd600757c0f48eb802132ab9283ab57" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 39641 } }
I20260808 14:50:45.549609 4247 ts_tablet_manager.cc:1428] T 5ad233430fd04c0d92788b5feed2c15c P 7dd600757c0f48eb802132ab9283ab57: Time spent starting tablet: real 0.002s user 0.002s sys 0.001s
I20260808 14:50:45.549507 4252 tablet_replica.cc:439] T 5ad233430fd04c0d92788b5feed2c15c P 7dd600757c0f48eb802132ab9283ab57: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59d0f9ffa2814130809f5d7dc33e2fd7" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 41307 } } peers { permanent_uuid: "659ff9080dce466990cb873522f6634f" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 36935 } } peers { permanent_uuid: "7dd600757c0f48eb802132ab9283ab57" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 39641 } } }
I20260808 14:50:45.549829 4252 tablet_replica.cc:442] T 5ad233430fd04c0d92788b5feed2c15c P 7dd600757c0f48eb802132ab9283ab57: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 14:50:45.761760 4267 raft_consensus.cc:482] T 5ad233430fd04c0d92788b5feed2c15c P 59d0f9ffa2814130809f5d7dc33e2fd7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:50:45.761958 4252 raft_consensus.cc:482] T 5ad233430fd04c0d92788b5feed2c15c P 7dd600757c0f48eb802132ab9283ab57 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:50:45.762073 4267 raft_consensus.cc:504] T 5ad233430fd04c0d92788b5feed2c15c P 59d0f9ffa2814130809f5d7dc33e2fd7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59d0f9ffa2814130809f5d7dc33e2fd7" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 41307 } } peers { permanent_uuid: "659ff9080dce466990cb873522f6634f" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 36935 } } peers { permanent_uuid: "7dd600757c0f48eb802132ab9283ab57" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 39641 } }
I20260808 14:50:45.762158 4252 raft_consensus.cc:504] T 5ad233430fd04c0d92788b5feed2c15c P 7dd600757c0f48eb802132ab9283ab57 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59d0f9ffa2814130809f5d7dc33e2fd7" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 41307 } } peers { permanent_uuid: "659ff9080dce466990cb873522f6634f" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 36935 } } peers { permanent_uuid: "7dd600757c0f48eb802132ab9283ab57" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 39641 } }
I20260808 14:50:45.762903 4252 leader_election.cc:288] T 5ad233430fd04c0d92788b5feed2c15c P 7dd600757c0f48eb802132ab9283ab57 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59d0f9ffa2814130809f5d7dc33e2fd7 (127.26.206.193:41307), 659ff9080dce466990cb873522f6634f (127.26.206.194:36935)
I20260808 14:50:45.762912 4267 leader_election.cc:288] T 5ad233430fd04c0d92788b5feed2c15c P 59d0f9ffa2814130809f5d7dc33e2fd7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 659ff9080dce466990cb873522f6634f (127.26.206.194:36935), 7dd600757c0f48eb802132ab9283ab57 (127.26.206.195:39641)
I20260808 14:50:45.763568 4163 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ad233430fd04c0d92788b5feed2c15c" candidate_uuid: "59d0f9ffa2814130809f5d7dc33e2fd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7dd600757c0f48eb802132ab9283ab57" is_pre_election: true
I20260808 14:50:45.763552 4004 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ad233430fd04c0d92788b5feed2c15c" candidate_uuid: "59d0f9ffa2814130809f5d7dc33e2fd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "659ff9080dce466990cb873522f6634f" is_pre_election: true
I20260808 14:50:45.763824 4163 raft_consensus.cc:2454] T 5ad233430fd04c0d92788b5feed2c15c P 7dd600757c0f48eb802132ab9283ab57 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59d0f9ffa2814130809f5d7dc33e2fd7 in term 0.
I20260808 14:50:45.763842 4004 raft_consensus.cc:2454] T 5ad233430fd04c0d92788b5feed2c15c P 659ff9080dce466990cb873522f6634f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59d0f9ffa2814130809f5d7dc33e2fd7 in term 0.
I20260808 14:50:45.763804 3839 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ad233430fd04c0d92788b5feed2c15c" candidate_uuid: "7dd600757c0f48eb802132ab9283ab57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59d0f9ffa2814130809f5d7dc33e2fd7" is_pre_election: true
I20260808 14:50:45.764068 3839 raft_consensus.cc:2454] T 5ad233430fd04c0d92788b5feed2c15c P 59d0f9ffa2814130809f5d7dc33e2fd7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7dd600757c0f48eb802132ab9283ab57 in term 0.
I20260808 14:50:45.764573 3751 leader_election.cc:302] T 5ad233430fd04c0d92788b5feed2c15c P 59d0f9ffa2814130809f5d7dc33e2fd7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59d0f9ffa2814130809f5d7dc33e2fd7, 7dd600757c0f48eb802132ab9283ab57; no voters:
I20260808 14:50:45.764648 4004 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ad233430fd04c0d92788b5feed2c15c" candidate_uuid: "7dd600757c0f48eb802132ab9283ab57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "659ff9080dce466990cb873522f6634f" is_pre_election: true
I20260808 14:50:45.764750 4083 leader_election.cc:302] T 5ad233430fd04c0d92788b5feed2c15c P 7dd600757c0f48eb802132ab9283ab57 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59d0f9ffa2814130809f5d7dc33e2fd7, 7dd600757c0f48eb802132ab9283ab57; no voters:
I20260808 14:50:45.764846 4004 raft_consensus.cc:2454] T 5ad233430fd04c0d92788b5feed2c15c P 659ff9080dce466990cb873522f6634f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7dd600757c0f48eb802132ab9283ab57 in term 0.
I20260808 14:50:45.765014 4267 raft_consensus.cc:2781] T 5ad233430fd04c0d92788b5feed2c15c P 59d0f9ffa2814130809f5d7dc33e2fd7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:50:45.765136 4267 raft_consensus.cc:482] T 5ad233430fd04c0d92788b5feed2c15c P 59d0f9ffa2814130809f5d7dc33e2fd7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:50:45.765244 4267 raft_consensus.cc:3037] T 5ad233430fd04c0d92788b5feed2c15c P 59d0f9ffa2814130809f5d7dc33e2fd7 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:50:45.765424 4252 raft_consensus.cc:2781] T 5ad233430fd04c0d92788b5feed2c15c P 7dd600757c0f48eb802132ab9283ab57 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:50:45.765524 4252 raft_consensus.cc:482] T 5ad233430fd04c0d92788b5feed2c15c P 7dd600757c0f48eb802132ab9283ab57 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:50:45.765645 4252 raft_consensus.cc:3037] T 5ad233430fd04c0d92788b5feed2c15c P 7dd600757c0f48eb802132ab9283ab57 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:50:45.768482 4252 raft_consensus.cc:504] T 5ad233430fd04c0d92788b5feed2c15c P 7dd600757c0f48eb802132ab9283ab57 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59d0f9ffa2814130809f5d7dc33e2fd7" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 41307 } } peers { permanent_uuid: "659ff9080dce466990cb873522f6634f" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 36935 } } peers { permanent_uuid: "7dd600757c0f48eb802132ab9283ab57" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 39641 } }
I20260808 14:50:45.768507 4267 raft_consensus.cc:504] T 5ad233430fd04c0d92788b5feed2c15c P 59d0f9ffa2814130809f5d7dc33e2fd7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59d0f9ffa2814130809f5d7dc33e2fd7" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 41307 } } peers { permanent_uuid: "659ff9080dce466990cb873522f6634f" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 36935 } } peers { permanent_uuid: "7dd600757c0f48eb802132ab9283ab57" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 39641 } }
I20260808 14:50:45.769423 4004 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ad233430fd04c0d92788b5feed2c15c" candidate_uuid: "59d0f9ffa2814130809f5d7dc33e2fd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "659ff9080dce466990cb873522f6634f"
I20260808 14:50:45.769454 3839 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ad233430fd04c0d92788b5feed2c15c" candidate_uuid: "7dd600757c0f48eb802132ab9283ab57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59d0f9ffa2814130809f5d7dc33e2fd7"
I20260808 14:50:45.769656 4004 raft_consensus.cc:3037] T 5ad233430fd04c0d92788b5feed2c15c P 659ff9080dce466990cb873522f6634f [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:50:45.769785 3839 raft_consensus.cc:2379] T 5ad233430fd04c0d92788b5feed2c15c P 59d0f9ffa2814130809f5d7dc33e2fd7 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7dd600757c0f48eb802132ab9283ab57 in current term 1: Already voted for candidate 59d0f9ffa2814130809f5d7dc33e2fd7 in this term.
I20260808 14:50:45.769726 4002 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ad233430fd04c0d92788b5feed2c15c" candidate_uuid: "7dd600757c0f48eb802132ab9283ab57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "659ff9080dce466990cb873522f6634f"
I20260808 14:50:45.770546 4252 leader_election.cc:288] T 5ad233430fd04c0d92788b5feed2c15c P 7dd600757c0f48eb802132ab9283ab57 [CANDIDATE]: Term 1 election: Requested vote from peers 59d0f9ffa2814130809f5d7dc33e2fd7 (127.26.206.193:41307), 659ff9080dce466990cb873522f6634f (127.26.206.194:36935)
I20260808 14:50:45.770614 4083 leader_election.cc:302] T 5ad233430fd04c0d92788b5feed2c15c P 7dd600757c0f48eb802132ab9283ab57 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7dd600757c0f48eb802132ab9283ab57; no voters: 59d0f9ffa2814130809f5d7dc33e2fd7, 659ff9080dce466990cb873522f6634f
I20260808 14:50:45.771256 4252 raft_consensus.cc:2726] T 5ad233430fd04c0d92788b5feed2c15c P 7dd600757c0f48eb802132ab9283ab57 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260808 14:50:45.771351 4163 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ad233430fd04c0d92788b5feed2c15c" candidate_uuid: "59d0f9ffa2814130809f5d7dc33e2fd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7dd600757c0f48eb802132ab9283ab57"
I20260808 14:50:45.771679 4163 raft_consensus.cc:2379] T 5ad233430fd04c0d92788b5feed2c15c P 7dd600757c0f48eb802132ab9283ab57 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 59d0f9ffa2814130809f5d7dc33e2fd7 in current term 1: Already voted for candidate 7dd600757c0f48eb802132ab9283ab57 in this term.
I20260808 14:50:45.771932 4267 leader_election.cc:288] T 5ad233430fd04c0d92788b5feed2c15c P 59d0f9ffa2814130809f5d7dc33e2fd7 [CANDIDATE]: Term 1 election: Requested vote from peers 659ff9080dce466990cb873522f6634f (127.26.206.194:36935), 7dd600757c0f48eb802132ab9283ab57 (127.26.206.195:39641)
I20260808 14:50:45.772683 4004 raft_consensus.cc:2454] T 5ad233430fd04c0d92788b5feed2c15c P 659ff9080dce466990cb873522f6634f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59d0f9ffa2814130809f5d7dc33e2fd7 in term 1.
I20260808 14:50:45.773110 3751 leader_election.cc:302] T 5ad233430fd04c0d92788b5feed2c15c P 59d0f9ffa2814130809f5d7dc33e2fd7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59d0f9ffa2814130809f5d7dc33e2fd7, 659ff9080dce466990cb873522f6634f; no voters: 7dd600757c0f48eb802132ab9283ab57
I20260808 14:50:45.773437 4267 raft_consensus.cc:2781] T 5ad233430fd04c0d92788b5feed2c15c P 59d0f9ffa2814130809f5d7dc33e2fd7 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:50:45.773643 4267 raft_consensus.cc:686] T 5ad233430fd04c0d92788b5feed2c15c P 59d0f9ffa2814130809f5d7dc33e2fd7 [term 1 LEADER]: Becoming Leader. State: Replica: 59d0f9ffa2814130809f5d7dc33e2fd7, State: Running, Role: LEADER
I20260808 14:50:45.773965 4267 consensus_queue.cc:237] T 5ad233430fd04c0d92788b5feed2c15c P 59d0f9ffa2814130809f5d7dc33e2fd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59d0f9ffa2814130809f5d7dc33e2fd7" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 41307 } } peers { permanent_uuid: "659ff9080dce466990cb873522f6634f" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 36935 } } peers { permanent_uuid: "7dd600757c0f48eb802132ab9283ab57" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 39641 } }
I20260808 14:50:45.775650 4250 tablet_replica.cc:439] T 5ad233430fd04c0d92788b5feed2c15c P 59d0f9ffa2814130809f5d7dc33e2fd7: TxnStatusTablet state changed. Reason: New leader 59d0f9ffa2814130809f5d7dc33e2fd7. Latest consensus state: current_term: 1 leader_uuid: "59d0f9ffa2814130809f5d7dc33e2fd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59d0f9ffa2814130809f5d7dc33e2fd7" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 41307 } } peers { permanent_uuid: "659ff9080dce466990cb873522f6634f" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 36935 } } peers { permanent_uuid: "7dd600757c0f48eb802132ab9283ab57" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 39641 } } }
I20260808 14:50:45.775952 4250 tablet_replica.cc:442] T 5ad233430fd04c0d92788b5feed2c15c P 59d0f9ffa2814130809f5d7dc33e2fd7: This TxnStatusTablet replica's current role is: LEADER
I20260808 14:50:45.776564 4295 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260808 14:50:45.776829 4295 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260808 14:50:45.777297 3657 catalog_manager.cc:5495] T 5ad233430fd04c0d92788b5feed2c15c P 59d0f9ffa2814130809f5d7dc33e2fd7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 59d0f9ffa2814130809f5d7dc33e2fd7 (127.26.206.193). New cstate: current_term: 1 leader_uuid: "59d0f9ffa2814130809f5d7dc33e2fd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59d0f9ffa2814130809f5d7dc33e2fd7" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 41307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "659ff9080dce466990cb873522f6634f" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 36935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7dd600757c0f48eb802132ab9283ab57" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 39641 } health_report { overall_health: UNKNOWN } } }
I20260808 14:50:45.842314 4240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:45.836896 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41686 (local address 127.26.206.193:41307)
0808 14:50:45.837180 (+ 284us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:45.837184 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:45.837227 (+ 43us) server_negotiation.cc:407] Connection header received
0808 14:50:45.837491 (+ 264us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:45.837495 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:45.837560 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:45.837637 (+ 77us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:50:45.838021 (+ 384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:45.838764 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:45.840694 (+ 1930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:45.841121 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:45.841214 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:45.841699 (+ 485us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:50:45.841801 (+ 102us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:50:45.841867 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:45.842026 (+ 159us) server_negotiation.cc:299] Negotiation successful
0808 14:50:45.842085 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":146}
I20260808 14:50:45.842446 4288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:45.836800 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.193:41307 (local address 127.0.0.1:41686)
0808 14:50:45.837074 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:45.837096 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 14:50:45.837273 (+ 177us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:50:45.837682 (+ 409us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:50:45.837687 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:50:45.837701 (+ 14us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 14:50:45.837891 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:45.837901 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:45.838883 (+ 982us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:45.838888 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:45.840558 (+ 1670us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:45.840574 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:45.841264 (+ 690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:45.841270 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:45.841468 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:45.841541 (+ 73us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 14:50:45.841890 (+ 349us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 14:50:45.841908 (+ 18us) client_negotiation.cc:769] Sending connection context
0808 14:50:45.841986 (+ 78us) client_negotiation.cc:240] Negotiation successful
0808 14:50:45.842147 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":55}
I20260808 14:50:45.846271 4163 raft_consensus.cc:1261] T 5ad233430fd04c0d92788b5feed2c15c P 7dd600757c0f48eb802132ab9283ab57 [term 1 FOLLOWER]: Refusing update from remote peer 59d0f9ffa2814130809f5d7dc33e2fd7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:50:45.846293 4004 raft_consensus.cc:1261] T 5ad233430fd04c0d92788b5feed2c15c P 659ff9080dce466990cb873522f6634f [term 1 FOLLOWER]: Refusing update from remote peer 59d0f9ffa2814130809f5d7dc33e2fd7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:50:45.846902 4250 consensus_queue.cc:1035] T 5ad233430fd04c0d92788b5feed2c15c P 59d0f9ffa2814130809f5d7dc33e2fd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "659ff9080dce466990cb873522f6634f" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 36935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:50:45.847189 4267 consensus_queue.cc:1035] T 5ad233430fd04c0d92788b5feed2c15c P 59d0f9ffa2814130809f5d7dc33e2fd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7dd600757c0f48eb802132ab9283ab57" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 39641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:50:45.851058 4251 tablet_replica.cc:439] T 5ad233430fd04c0d92788b5feed2c15c P 659ff9080dce466990cb873522f6634f: TxnStatusTablet state changed. Reason: New leader 59d0f9ffa2814130809f5d7dc33e2fd7. Latest consensus state: current_term: 1 leader_uuid: "59d0f9ffa2814130809f5d7dc33e2fd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59d0f9ffa2814130809f5d7dc33e2fd7" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 41307 } } peers { permanent_uuid: "659ff9080dce466990cb873522f6634f" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 36935 } } peers { permanent_uuid: "7dd600757c0f48eb802132ab9283ab57" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 39641 } } }
I20260808 14:50:45.851363 4251 tablet_replica.cc:442] T 5ad233430fd04c0d92788b5feed2c15c P 659ff9080dce466990cb873522f6634f: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 14:50:45.853557 4262 mvcc.cc:205] Tried to move back new op lower bound from 7316277845379870720 to 7316277845092442112. Current Snapshot: MvccSnapshot[applied={T|T < 7316277845379870720}]
I20260808 14:50:45.854095 4251 tablet_replica.cc:439] T 5ad233430fd04c0d92788b5feed2c15c P 659ff9080dce466990cb873522f6634f: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "59d0f9ffa2814130809f5d7dc33e2fd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59d0f9ffa2814130809f5d7dc33e2fd7" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 41307 } } peers { permanent_uuid: "659ff9080dce466990cb873522f6634f" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 36935 } } peers { permanent_uuid: "7dd600757c0f48eb802132ab9283ab57" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 39641 } } }
I20260808 14:50:45.854328 4251 tablet_replica.cc:442] T 5ad233430fd04c0d92788b5feed2c15c P 659ff9080dce466990cb873522f6634f: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 14:50:45.854534 4267 tablet_replica.cc:439] T 5ad233430fd04c0d92788b5feed2c15c P 59d0f9ffa2814130809f5d7dc33e2fd7: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "59d0f9ffa2814130809f5d7dc33e2fd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59d0f9ffa2814130809f5d7dc33e2fd7" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 41307 } } peers { permanent_uuid: "659ff9080dce466990cb873522f6634f" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 36935 } } peers { permanent_uuid: "7dd600757c0f48eb802132ab9283ab57" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 39641 } } }
I20260808 14:50:45.854800 4267 tablet_replica.cc:442] T 5ad233430fd04c0d92788b5feed2c15c P 59d0f9ffa2814130809f5d7dc33e2fd7: This TxnStatusTablet replica's current role is: LEADER
I20260808 14:50:45.867844 4303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:45.860397 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53878 (local address 127.26.206.195:39641)
0808 14:50:45.861128 (+ 731us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:45.861137 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:45.862415 (+ 1278us) server_negotiation.cc:407] Connection header received
0808 14:50:45.862597 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:45.862601 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:45.862673 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:45.862845 (+ 172us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:50:45.863317 (+ 472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:45.864138 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:45.865583 (+ 1445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:45.866006 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:45.866132 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:45.866556 (+ 424us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:50:45.867065 (+ 509us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:50:45.867229 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:45.867330 (+ 101us) server_negotiation.cc:299] Negotiation successful
0808 14:50:45.867429 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":546,"thread_start_us":314,"threads_started":1}
I20260808 14:50:45.869390 4250 tablet_replica.cc:439] T 5ad233430fd04c0d92788b5feed2c15c P 59d0f9ffa2814130809f5d7dc33e2fd7: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "59d0f9ffa2814130809f5d7dc33e2fd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59d0f9ffa2814130809f5d7dc33e2fd7" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 41307 } } peers { permanent_uuid: "659ff9080dce466990cb873522f6634f" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 36935 } } peers { permanent_uuid: "7dd600757c0f48eb802132ab9283ab57" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 39641 } } }
I20260808 14:50:45.869468 4252 tablet_replica.cc:439] T 5ad233430fd04c0d92788b5feed2c15c P 7dd600757c0f48eb802132ab9283ab57: TxnStatusTablet state changed. Reason: New leader 59d0f9ffa2814130809f5d7dc33e2fd7. Latest consensus state: current_term: 1 leader_uuid: "59d0f9ffa2814130809f5d7dc33e2fd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59d0f9ffa2814130809f5d7dc33e2fd7" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 41307 } } peers { permanent_uuid: "659ff9080dce466990cb873522f6634f" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 36935 } } peers { permanent_uuid: "7dd600757c0f48eb802132ab9283ab57" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 39641 } } }
I20260808 14:50:45.869685 4250 tablet_replica.cc:442] T 5ad233430fd04c0d92788b5feed2c15c P 59d0f9ffa2814130809f5d7dc33e2fd7: This TxnStatusTablet replica's current role is: LEADER
I20260808 14:50:45.869720 4252 tablet_replica.cc:442] T 5ad233430fd04c0d92788b5feed2c15c P 7dd600757c0f48eb802132ab9283ab57: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 14:50:45.871676 4252 tablet_replica.cc:439] T 5ad233430fd04c0d92788b5feed2c15c P 7dd600757c0f48eb802132ab9283ab57: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "59d0f9ffa2814130809f5d7dc33e2fd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59d0f9ffa2814130809f5d7dc33e2fd7" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 41307 } } peers { permanent_uuid: "659ff9080dce466990cb873522f6634f" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 36935 } } peers { permanent_uuid: "7dd600757c0f48eb802132ab9283ab57" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 39641 } } }
I20260808 14:50:45.871929 4252 tablet_replica.cc:442] T 5ad233430fd04c0d92788b5feed2c15c P 7dd600757c0f48eb802132ab9283ab57: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 14:50:45.885190 4308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:45.879209 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.193:41307 (local address 127.26.206.195:45293)
0808 14:50:45.879932 (+ 723us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:45.879949 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 14:50:45.880058 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:50:45.880394 (+ 336us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:50:45.880397 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:50:45.880406 (+ 9us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 14:50:45.880641 (+ 235us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:45.880647 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:45.882025 (+ 1378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:45.882028 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:45.883109 (+ 1081us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:45.883120 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:45.884157 (+ 1037us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:45.884161 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:45.884278 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:45.884327 (+ 49us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 14:50:45.884745 (+ 418us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 14:50:45.884760 (+ 15us) client_negotiation.cc:769] Sending connection context
0808 14:50:45.884820 (+ 60us) client_negotiation.cc:240] Negotiation successful
0808 14:50:45.884913 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":537,"thread_start_us":390,"threads_started":1}
I20260808 14:50:45.885250 4240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:45.879218 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.195:45293 (local address 127.26.206.193:41307)
0808 14:50:45.879415 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:45.879421 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:45.880033 (+ 612us) server_negotiation.cc:407] Connection header received
0808 14:50:45.880173 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:45.880186 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:45.880269 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:45.880379 (+ 110us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:50:45.880773 (+ 394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:45.881899 (+ 1126us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:45.883253 (+ 1354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:45.883988 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:45.884130 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:45.884493 (+ 363us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:50:45.884646 (+ 153us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:50:45.884747 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:45.884859 (+ 112us) server_negotiation.cc:299] Negotiation successful
0808 14:50:45.884943 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260808 14:50:45.895308 4004 raft_consensus.cc:1261] T 96b9c7e8e2044198944036e043098544 P 659ff9080dce466990cb873522f6634f [term 1 FOLLOWER]: Refusing update from remote peer 7dd600757c0f48eb802132ab9283ab57: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:50:45.895546 3839 raft_consensus.cc:1261] T 96b9c7e8e2044198944036e043098544 P 59d0f9ffa2814130809f5d7dc33e2fd7 [term 1 FOLLOWER]: Refusing update from remote peer 7dd600757c0f48eb802132ab9283ab57: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:50:45.895918 4280 consensus_queue.cc:1035] T 96b9c7e8e2044198944036e043098544 P 7dd600757c0f48eb802132ab9283ab57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "659ff9080dce466990cb873522f6634f" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 36935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:50:45.896308 4252 consensus_queue.cc:1035] T 96b9c7e8e2044198944036e043098544 P 7dd600757c0f48eb802132ab9283ab57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59d0f9ffa2814130809f5d7dc33e2fd7" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 41307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:50:45.935827 4303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:45.929348 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.193:58811 (local address 127.26.206.195:39641)
0808 14:50:45.929521 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:45.929526 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:45.930176 (+ 650us) server_negotiation.cc:407] Connection header received
0808 14:50:45.930373 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:45.930377 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:45.930436 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:45.930507 (+ 71us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:50:45.931140 (+ 633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:45.932035 (+ 895us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:45.933990 (+ 1955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:45.934422 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:45.934558 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:45.935035 (+ 477us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:50:45.935157 (+ 122us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:50:45.935268 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:45.935415 (+ 147us) server_negotiation.cc:299] Negotiation successful
0808 14:50:45.935502 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260808 14:50:45.936744 4314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:45.929417 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.195:39641 (local address 127.26.206.193:58811)
0808 14:50:45.930065 (+ 648us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:45.930086 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 14:50:45.930235 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:50:45.930547 (+ 312us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:50:45.930552 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:50:45.930590 (+ 38us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 14:50:45.930970 (+ 380us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:45.930983 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:45.932197 (+ 1214us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:45.932203 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:45.933823 (+ 1620us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:45.933837 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:45.934608 (+ 771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:45.934619 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:45.934768 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:45.934820 (+ 52us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 14:50:45.935262 (+ 442us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 14:50:45.935275 (+ 13us) client_negotiation.cc:769] Sending connection context
0808 14:50:45.936069 (+ 794us) client_negotiation.cc:240] Negotiation successful
0808 14:50:45.936243 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":454,"thread_start_us":297,"threads_started":1}
I20260808 14:50:45.978493 3657 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58256:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:50:45.978770 3657 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58256:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:50:45.982508 3657 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d4216fed87a840f587a730f82785f89a: Sending DeleteTablet for 3 replicas of tablet 96b9c7e8e2044198944036e043098544
I20260808 14:50:45.983940 3975 tablet_service.cc:1514] Processing DeleteTablet for tablet 96b9c7e8e2044198944036e043098544 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:50:45 UTC) from {username='oryx', principal='oryx/127.26.206.254@KRBTEST.COM'} at 127.0.0.1:45316
I20260808 14:50:45.984385 4136 tablet_service.cc:1514] Processing DeleteTablet for tablet 96b9c7e8e2044198944036e043098544 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:50:45 UTC) from {username='oryx', principal='oryx/127.26.206.254@KRBTEST.COM'} at 127.0.0.1:53870
I20260808 14:50:45.987955 4317 tablet_replica.cc:330] T 96b9c7e8e2044198944036e043098544 P 659ff9080dce466990cb873522f6634f: stopping tablet replica
I20260808 14:50:45.988265 4317 raft_consensus.cc:2229] T 96b9c7e8e2044198944036e043098544 P 659ff9080dce466990cb873522f6634f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:50:45.988593 4317 raft_consensus.cc:2258] T 96b9c7e8e2044198944036e043098544 P 659ff9080dce466990cb873522f6634f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:50:45.988608 3807 tablet_service.cc:1514] Processing DeleteTablet for tablet 96b9c7e8e2044198944036e043098544 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:50:45 UTC) from {username='oryx', principal='oryx/127.26.206.254@KRBTEST.COM'} at 127.0.0.1:41664
I20260808 14:50:45.990170 4318 tablet_replica.cc:330] T 96b9c7e8e2044198944036e043098544 P 7dd600757c0f48eb802132ab9283ab57: stopping tablet replica
I20260808 14:50:45.990425 4318 raft_consensus.cc:2229] T 96b9c7e8e2044198944036e043098544 P 7dd600757c0f48eb802132ab9283ab57 [term 1 LEADER]: Raft consensus shutting down.
I20260808 14:50:45.991072 4318 raft_consensus.cc:2258] T 96b9c7e8e2044198944036e043098544 P 7dd600757c0f48eb802132ab9283ab57 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:50:45.992390 4318 ts_tablet_manager.cc:1905] T 96b9c7e8e2044198944036e043098544 P 7dd600757c0f48eb802132ab9283ab57: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:50:46.000804 4317 ts_tablet_manager.cc:1905] T 96b9c7e8e2044198944036e043098544 P 659ff9080dce466990cb873522f6634f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:50:46.006460 4318 ts_tablet_manager.cc:1918] T 96b9c7e8e2044198944036e043098544 P 7dd600757c0f48eb802132ab9283ab57: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 14:50:46.006597 4318 log.cc:1196] T 96b9c7e8e2044198944036e043098544 P 7dd600757c0f48eb802132ab9283ab57: Deleting WAL directory at /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200577490656-27451-0/minicluster-data/ts-2/wal/wals/96b9c7e8e2044198944036e043098544
I20260808 14:50:46.007047 4318 ts_tablet_manager.cc:1939] T 96b9c7e8e2044198944036e043098544 P 7dd600757c0f48eb802132ab9283ab57: Deleting consensus metadata
I20260808 14:50:46.009045 4317 ts_tablet_manager.cc:1918] T 96b9c7e8e2044198944036e043098544 P 659ff9080dce466990cb873522f6634f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 14:50:46.009306 4317 log.cc:1196] T 96b9c7e8e2044198944036e043098544 P 659ff9080dce466990cb873522f6634f: Deleting WAL directory at /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200577490656-27451-0/minicluster-data/ts-1/wal/wals/96b9c7e8e2044198944036e043098544
I20260808 14:50:46.009912 4317 ts_tablet_manager.cc:1939] T 96b9c7e8e2044198944036e043098544 P 659ff9080dce466990cb873522f6634f: Deleting consensus metadata
I20260808 14:50:46.010475 4319 tablet_replica.cc:330] T 96b9c7e8e2044198944036e043098544 P 59d0f9ffa2814130809f5d7dc33e2fd7: stopping tablet replica
I20260808 14:50:46.010748 4319 raft_consensus.cc:2229] T 96b9c7e8e2044198944036e043098544 P 59d0f9ffa2814130809f5d7dc33e2fd7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:50:46.011054 4319 raft_consensus.cc:2258] T 96b9c7e8e2044198944036e043098544 P 59d0f9ffa2814130809f5d7dc33e2fd7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:50:46.011726 3639 catalog_manager.cc:4841] TS 659ff9080dce466990cb873522f6634f (127.26.206.194:36935): tablet 96b9c7e8e2044198944036e043098544 (table test-table [id=40af4086ee63458e9125b2f78221d39d]) successfully deleted
I20260808 14:50:46.014416 3639 catalog_manager.cc:4841] TS 7dd600757c0f48eb802132ab9283ab57 (127.26.206.195:39641): tablet 96b9c7e8e2044198944036e043098544 (table test-table [id=40af4086ee63458e9125b2f78221d39d]) successfully deleted
I20260808 14:50:46.016628 4319 ts_tablet_manager.cc:1905] T 96b9c7e8e2044198944036e043098544 P 59d0f9ffa2814130809f5d7dc33e2fd7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:50:46.032272 4319 ts_tablet_manager.cc:1918] T 96b9c7e8e2044198944036e043098544 P 59d0f9ffa2814130809f5d7dc33e2fd7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 14:50:46.032505 4319 log.cc:1196] T 96b9c7e8e2044198944036e043098544 P 59d0f9ffa2814130809f5d7dc33e2fd7: Deleting WAL directory at /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200577490656-27451-0/minicluster-data/ts-0/wal/wals/96b9c7e8e2044198944036e043098544
I20260808 14:50:46.033131 4319 ts_tablet_manager.cc:1939] T 96b9c7e8e2044198944036e043098544 P 59d0f9ffa2814130809f5d7dc33e2fd7: Deleting consensus metadata
I20260808 14:50:46.034396 3642 catalog_manager.cc:4841] TS 59d0f9ffa2814130809f5d7dc33e2fd7 (127.26.206.193:41307): tablet 96b9c7e8e2044198944036e043098544 (table test-table [id=40af4086ee63458e9125b2f78221d39d]) successfully deleted
Aug 08 14:50:46 dist-test-slave-6k22 krb5kdc[3604](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200646, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 14:50:46 dist-test-slave-6k22 krb5kdc[3604](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.26.206.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:50:46 dist-test-slave-6k22 krb5kdc[3604](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.26.206.254@KRBTEST.COM, Server not found in Kerberos database
W20260808 14:50:46.119462 4328 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:50:46.083819 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58280 (local address 127.26.206.254:33743)
0808 14:50:46.099095 (+ 15276us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:46.099105 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:46.099584 (+ 479us) server_negotiation.cc:407] Connection header received
0808 14:50:46.099809 (+ 225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:46.099815 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:46.099890 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:46.100008 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:46.101437 (+ 1429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:46.102302 (+ 865us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:46.103485 (+ 1183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:46.103956 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:46.104086 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:46.113012 (+ 8926us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58280: BlockingRecv error: recv got EOF from 127.0.0.1:58280 (error 108)
Metrics: {"server-negotiator.queue_time_us":15134,"thread_start_us":15306,"threads_started":1}
Aug 08 14:50:46 dist-test-slave-6k22 krb5kdc[3604](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200646, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.26.206.254@KRBTEST.COM
I20260808 14:50:46.138149 4328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:46.113590 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58294 (local address 127.26.206.254:33743)
0808 14:50:46.120466 (+ 6876us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:46.120476 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:46.121502 (+ 1026us) server_negotiation.cc:407] Connection header received
0808 14:50:46.121741 (+ 239us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:46.121746 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:46.121811 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:46.121931 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:46.123331 (+ 1400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:46.124253 (+ 922us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:46.125913 (+ 1660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:46.126555 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:46.126820 (+ 265us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:46.131367 (+ 4547us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:50:46.131372 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:50:46.131376 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:50:46.131411 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:50:46.134658 (+ 3247us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:46.135404 (+ 746us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:46.135416 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:46.135419 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:46.135678 (+ 259us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:46.136224 (+ 546us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:46.136228 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:46.136230 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:46.136544 (+ 314us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:50:46.136903 (+ 359us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:46.137398 (+ 495us) server_negotiation.cc:299] Negotiation successful
0808 14:50:46.137662 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6698,"thread_start_us":7296,"threads_started":1}
I20260808 14:50:46.142292 3657 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58294:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:50:46.143051 3657 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:50:46.151296 3807 tablet_service.cc:1467] Processing CreateTablet for tablet 6623c95a9fa24ec99de681e619318592 (DEFAULT_TABLE table=test-table [id=dbc4a169a8d94b44a00a3a3fb8a46fb4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:50:46.152249 3975 tablet_service.cc:1467] Processing CreateTablet for tablet 6623c95a9fa24ec99de681e619318592 (DEFAULT_TABLE table=test-table [id=dbc4a169a8d94b44a00a3a3fb8a46fb4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:50:46.152848 3975 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6623c95a9fa24ec99de681e619318592. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:50:46.155990 4136 tablet_service.cc:1467] Processing CreateTablet for tablet 6623c95a9fa24ec99de681e619318592 (DEFAULT_TABLE table=test-table [id=dbc4a169a8d94b44a00a3a3fb8a46fb4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:50:46.156461 4136 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6623c95a9fa24ec99de681e619318592. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:50:46.159967 3807 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6623c95a9fa24ec99de681e619318592. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:50:46.181795 4335 tablet_bootstrap.cc:492] T 6623c95a9fa24ec99de681e619318592 P 7dd600757c0f48eb802132ab9283ab57: Bootstrap starting.
I20260808 14:50:46.184569 4335 tablet_bootstrap.cc:654] T 6623c95a9fa24ec99de681e619318592 P 7dd600757c0f48eb802132ab9283ab57: Neither blocks nor log segments found. Creating new log.
I20260808 14:50:46.188100 4337 tablet_bootstrap.cc:492] T 6623c95a9fa24ec99de681e619318592 P 59d0f9ffa2814130809f5d7dc33e2fd7: Bootstrap starting.
I20260808 14:50:46.189189 4336 tablet_bootstrap.cc:492] T 6623c95a9fa24ec99de681e619318592 P 659ff9080dce466990cb873522f6634f: Bootstrap starting.
I20260808 14:50:46.189922 4337 tablet_bootstrap.cc:654] T 6623c95a9fa24ec99de681e619318592 P 59d0f9ffa2814130809f5d7dc33e2fd7: Neither blocks nor log segments found. Creating new log.
I20260808 14:50:46.195844 4336 tablet_bootstrap.cc:654] T 6623c95a9fa24ec99de681e619318592 P 659ff9080dce466990cb873522f6634f: Neither blocks nor log segments found. Creating new log.
I20260808 14:50:46.201287 4335 tablet_bootstrap.cc:492] T 6623c95a9fa24ec99de681e619318592 P 7dd600757c0f48eb802132ab9283ab57: No bootstrap required, opened a new log
I20260808 14:50:46.201568 4335 ts_tablet_manager.cc:1397] T 6623c95a9fa24ec99de681e619318592 P 7dd600757c0f48eb802132ab9283ab57: Time spent bootstrapping tablet: real 0.020s user 0.005s sys 0.011s
I20260808 14:50:46.202803 4335 raft_consensus.cc:348] T 6623c95a9fa24ec99de681e619318592 P 7dd600757c0f48eb802132ab9283ab57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59d0f9ffa2814130809f5d7dc33e2fd7" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 41307 } } peers { permanent_uuid: "659ff9080dce466990cb873522f6634f" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 36935 } } peers { permanent_uuid: "7dd600757c0f48eb802132ab9283ab57" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 39641 } }
I20260808 14:50:46.203470 4335 raft_consensus.cc:374] T 6623c95a9fa24ec99de681e619318592 P 7dd600757c0f48eb802132ab9283ab57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:50:46.203675 4335 raft_consensus.cc:729] T 6623c95a9fa24ec99de681e619318592 P 7dd600757c0f48eb802132ab9283ab57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7dd600757c0f48eb802132ab9283ab57, State: Initialized, Role: FOLLOWER
I20260808 14:50:46.204067 4335 consensus_queue.cc:260] T 6623c95a9fa24ec99de681e619318592 P 7dd600757c0f48eb802132ab9283ab57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59d0f9ffa2814130809f5d7dc33e2fd7" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 41307 } } peers { permanent_uuid: "659ff9080dce466990cb873522f6634f" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 36935 } } peers { permanent_uuid: "7dd600757c0f48eb802132ab9283ab57" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 39641 } }
I20260808 14:50:46.204852 4335 ts_tablet_manager.cc:1428] T 6623c95a9fa24ec99de681e619318592 P 7dd600757c0f48eb802132ab9283ab57: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260808 14:50:46.210671 4337 tablet_bootstrap.cc:492] T 6623c95a9fa24ec99de681e619318592 P 59d0f9ffa2814130809f5d7dc33e2fd7: No bootstrap required, opened a new log
I20260808 14:50:46.210902 4337 ts_tablet_manager.cc:1397] T 6623c95a9fa24ec99de681e619318592 P 59d0f9ffa2814130809f5d7dc33e2fd7: Time spent bootstrapping tablet: real 0.023s user 0.004s sys 0.013s
I20260808 14:50:46.211848 4337 raft_consensus.cc:348] T 6623c95a9fa24ec99de681e619318592 P 59d0f9ffa2814130809f5d7dc33e2fd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59d0f9ffa2814130809f5d7dc33e2fd7" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 41307 } } peers { permanent_uuid: "659ff9080dce466990cb873522f6634f" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 36935 } } peers { permanent_uuid: "7dd600757c0f48eb802132ab9283ab57" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 39641 } }
I20260808 14:50:46.212199 4337 raft_consensus.cc:374] T 6623c95a9fa24ec99de681e619318592 P 59d0f9ffa2814130809f5d7dc33e2fd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:50:46.212342 4337 raft_consensus.cc:729] T 6623c95a9fa24ec99de681e619318592 P 59d0f9ffa2814130809f5d7dc33e2fd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59d0f9ffa2814130809f5d7dc33e2fd7, State: Initialized, Role: FOLLOWER
I20260808 14:50:46.212680 4337 consensus_queue.cc:260] T 6623c95a9fa24ec99de681e619318592 P 59d0f9ffa2814130809f5d7dc33e2fd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59d0f9ffa2814130809f5d7dc33e2fd7" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 41307 } } peers { permanent_uuid: "659ff9080dce466990cb873522f6634f" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 36935 } } peers { permanent_uuid: "7dd600757c0f48eb802132ab9283ab57" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 39641 } }
I20260808 14:50:46.215394 4337 ts_tablet_manager.cc:1428] T 6623c95a9fa24ec99de681e619318592 P 59d0f9ffa2814130809f5d7dc33e2fd7: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260808 14:50:46.216998 4336 tablet_bootstrap.cc:492] T 6623c95a9fa24ec99de681e619318592 P 659ff9080dce466990cb873522f6634f: No bootstrap required, opened a new log
I20260808 14:50:46.217187 4336 ts_tablet_manager.cc:1397] T 6623c95a9fa24ec99de681e619318592 P 659ff9080dce466990cb873522f6634f: Time spent bootstrapping tablet: real 0.045s user 0.006s sys 0.009s
I20260808 14:50:46.218060 4336 raft_consensus.cc:348] T 6623c95a9fa24ec99de681e619318592 P 659ff9080dce466990cb873522f6634f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59d0f9ffa2814130809f5d7dc33e2fd7" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 41307 } } peers { permanent_uuid: "659ff9080dce466990cb873522f6634f" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 36935 } } peers { permanent_uuid: "7dd600757c0f48eb802132ab9283ab57" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 39641 } }
I20260808 14:50:46.218827 4336 raft_consensus.cc:374] T 6623c95a9fa24ec99de681e619318592 P 659ff9080dce466990cb873522f6634f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:50:46.218961 4336 raft_consensus.cc:729] T 6623c95a9fa24ec99de681e619318592 P 659ff9080dce466990cb873522f6634f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 659ff9080dce466990cb873522f6634f, State: Initialized, Role: FOLLOWER
I20260808 14:50:46.219215 4336 consensus_queue.cc:260] T 6623c95a9fa24ec99de681e619318592 P 659ff9080dce466990cb873522f6634f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59d0f9ffa2814130809f5d7dc33e2fd7" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 41307 } } peers { permanent_uuid: "659ff9080dce466990cb873522f6634f" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 36935 } } peers { permanent_uuid: "7dd600757c0f48eb802132ab9283ab57" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 39641 } }
I20260808 14:50:46.219758 4336 ts_tablet_manager.cc:1428] T 6623c95a9fa24ec99de681e619318592 P 659ff9080dce466990cb873522f6634f: Time spent starting tablet: real 0.002s user 0.001s sys 0.002s
I20260808 14:50:46.268648 4251 raft_consensus.cc:482] T 6623c95a9fa24ec99de681e619318592 P 659ff9080dce466990cb873522f6634f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:50:46.268916 4251 raft_consensus.cc:504] T 6623c95a9fa24ec99de681e619318592 P 659ff9080dce466990cb873522f6634f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59d0f9ffa2814130809f5d7dc33e2fd7" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 41307 } } peers { permanent_uuid: "659ff9080dce466990cb873522f6634f" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 36935 } } peers { permanent_uuid: "7dd600757c0f48eb802132ab9283ab57" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 39641 } }
I20260808 14:50:46.270691 4251 leader_election.cc:288] T 6623c95a9fa24ec99de681e619318592 P 659ff9080dce466990cb873522f6634f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59d0f9ffa2814130809f5d7dc33e2fd7 (127.26.206.193:41307), 7dd600757c0f48eb802132ab9283ab57 (127.26.206.195:39641)
I20260808 14:50:46.292050 4240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:46.271263 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.194:39747 (local address 127.26.206.193:41307)
0808 14:50:46.271472 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:46.271479 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:46.283861 (+ 12382us) server_negotiation.cc:407] Connection header received
0808 14:50:46.284362 (+ 501us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:46.284368 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:46.284453 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:46.284520 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:50:46.285333 (+ 813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:46.286567 (+ 1234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:46.289326 (+ 2759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:46.290693 (+ 1367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:46.290835 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:46.290905 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:46.291593 (+ 688us) server_negotiation.cc:299] Negotiation successful
0808 14:50:46.291739 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260808 14:50:46.292104 4303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:46.271701 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.194:52907 (local address 127.26.206.195:39641)
0808 14:50:46.271936 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:46.271943 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:46.284299 (+ 12356us) server_negotiation.cc:407] Connection header received
0808 14:50:46.284694 (+ 395us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:46.284699 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:46.284777 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:46.284845 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:50:46.285679 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:46.286743 (+ 1064us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:46.289337 (+ 2594us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:46.290709 (+ 1372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:46.290833 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:46.290905 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:46.291590 (+ 685us) server_negotiation.cc:299] Negotiation successful
0808 14:50:46.291736 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260808 14:50:46.292932 4343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:46.271192 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.195:39641 (local address 127.26.206.194:52907)
0808 14:50:46.284193 (+ 13001us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:46.284210 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 14:50:46.284525 (+ 315us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:50:46.285087 (+ 562us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:50:46.285092 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:50:46.285113 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:50:46.285495 (+ 382us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:46.285517 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:46.286903 (+ 1386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:46.286909 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:46.289115 (+ 2206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:46.289148 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:46.291078 (+ 1930us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:46.291084 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:46.291332 (+ 248us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:46.291412 (+ 80us) client_negotiation.cc:769] Sending connection context
0808 14:50:46.292376 (+ 964us) client_negotiation.cc:240] Negotiation successful
0808 14:50:46.292511 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12889,"mutex_wait_us":83,"thread_start_us":13120,"threads_started":1}
I20260808 14:50:46.293655 4162 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6623c95a9fa24ec99de681e619318592" candidate_uuid: "659ff9080dce466990cb873522f6634f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7dd600757c0f48eb802132ab9283ab57" is_pre_election: true
I20260808 14:50:46.293416 4342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:46.270888 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.193:41307 (local address 127.26.206.194:39747)
0808 14:50:46.283714 (+ 12826us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:46.283743 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0808 14:50:46.284161 (+ 418us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:50:46.284744 (+ 583us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:50:46.284748 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:50:46.284770 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:50:46.285104 (+ 334us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:46.285114 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:46.286745 (+ 1631us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:46.286749 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:46.289139 (+ 2390us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:46.289148 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:46.291088 (+ 1940us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:46.291092 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:46.291337 (+ 245us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:46.291415 (+ 78us) client_negotiation.cc:769] Sending connection context
0808 14:50:46.292624 (+ 1209us) client_negotiation.cc:240] Negotiation successful
0808 14:50:46.292753 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12606,"mutex_wait_us":152,"thread_start_us":13011,"threads_started":1}
I20260808 14:50:46.293977 4162 raft_consensus.cc:2454] T 6623c95a9fa24ec99de681e619318592 P 7dd600757c0f48eb802132ab9283ab57 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 659ff9080dce466990cb873522f6634f in term 0.
I20260808 14:50:46.294559 3914 leader_election.cc:302] T 6623c95a9fa24ec99de681e619318592 P 659ff9080dce466990cb873522f6634f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 659ff9080dce466990cb873522f6634f, 7dd600757c0f48eb802132ab9283ab57; no voters:
I20260808 14:50:46.294982 4251 raft_consensus.cc:2781] T 6623c95a9fa24ec99de681e619318592 P 659ff9080dce466990cb873522f6634f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:50:46.295105 4251 raft_consensus.cc:482] T 6623c95a9fa24ec99de681e619318592 P 659ff9080dce466990cb873522f6634f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:50:46.295197 4251 raft_consensus.cc:3037] T 6623c95a9fa24ec99de681e619318592 P 659ff9080dce466990cb873522f6634f [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:50:46.295480 3839 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6623c95a9fa24ec99de681e619318592" candidate_uuid: "659ff9080dce466990cb873522f6634f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59d0f9ffa2814130809f5d7dc33e2fd7" is_pre_election: true
I20260808 14:50:46.295825 3839 raft_consensus.cc:2454] T 6623c95a9fa24ec99de681e619318592 P 59d0f9ffa2814130809f5d7dc33e2fd7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 659ff9080dce466990cb873522f6634f in term 0.
I20260808 14:50:46.298902 4251 raft_consensus.cc:504] T 6623c95a9fa24ec99de681e619318592 P 659ff9080dce466990cb873522f6634f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59d0f9ffa2814130809f5d7dc33e2fd7" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 41307 } } peers { permanent_uuid: "659ff9080dce466990cb873522f6634f" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 36935 } } peers { permanent_uuid: "7dd600757c0f48eb802132ab9283ab57" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 39641 } }
I20260808 14:50:46.299698 4251 leader_election.cc:288] T 6623c95a9fa24ec99de681e619318592 P 659ff9080dce466990cb873522f6634f [CANDIDATE]: Term 1 election: Requested vote from peers 59d0f9ffa2814130809f5d7dc33e2fd7 (127.26.206.193:41307), 7dd600757c0f48eb802132ab9283ab57 (127.26.206.195:39641)
I20260808 14:50:46.300336 3839 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6623c95a9fa24ec99de681e619318592" candidate_uuid: "659ff9080dce466990cb873522f6634f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59d0f9ffa2814130809f5d7dc33e2fd7"
I20260808 14:50:46.300386 4162 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6623c95a9fa24ec99de681e619318592" candidate_uuid: "659ff9080dce466990cb873522f6634f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7dd600757c0f48eb802132ab9283ab57"
I20260808 14:50:46.300576 3839 raft_consensus.cc:3037] T 6623c95a9fa24ec99de681e619318592 P 59d0f9ffa2814130809f5d7dc33e2fd7 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:50:46.300613 4162 raft_consensus.cc:3037] T 6623c95a9fa24ec99de681e619318592 P 7dd600757c0f48eb802132ab9283ab57 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:50:46.303927 4162 raft_consensus.cc:2454] T 6623c95a9fa24ec99de681e619318592 P 7dd600757c0f48eb802132ab9283ab57 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 659ff9080dce466990cb873522f6634f in term 1.
I20260808 14:50:46.304226 3839 raft_consensus.cc:2454] T 6623c95a9fa24ec99de681e619318592 P 59d0f9ffa2814130809f5d7dc33e2fd7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 659ff9080dce466990cb873522f6634f in term 1.
I20260808 14:50:46.304827 3917 leader_election.cc:302] T 6623c95a9fa24ec99de681e619318592 P 659ff9080dce466990cb873522f6634f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59d0f9ffa2814130809f5d7dc33e2fd7, 659ff9080dce466990cb873522f6634f; no voters:
I20260808 14:50:46.305235 4251 raft_consensus.cc:2781] T 6623c95a9fa24ec99de681e619318592 P 659ff9080dce466990cb873522f6634f [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:50:46.313053 4251 raft_consensus.cc:686] T 6623c95a9fa24ec99de681e619318592 P 659ff9080dce466990cb873522f6634f [term 1 LEADER]: Becoming Leader. State: Replica: 659ff9080dce466990cb873522f6634f, State: Running, Role: LEADER
I20260808 14:50:46.313602 4251 consensus_queue.cc:237] T 6623c95a9fa24ec99de681e619318592 P 659ff9080dce466990cb873522f6634f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59d0f9ffa2814130809f5d7dc33e2fd7" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 41307 } } peers { permanent_uuid: "659ff9080dce466990cb873522f6634f" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 36935 } } peers { permanent_uuid: "7dd600757c0f48eb802132ab9283ab57" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 39641 } }
I20260808 14:50:46.325122 3657 catalog_manager.cc:5495] T 6623c95a9fa24ec99de681e619318592 P 659ff9080dce466990cb873522f6634f reported cstate change: term changed from 0 to 1, leader changed from <none> to 659ff9080dce466990cb873522f6634f (127.26.206.194). New cstate: current_term: 1 leader_uuid: "659ff9080dce466990cb873522f6634f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59d0f9ffa2814130809f5d7dc33e2fd7" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 41307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "659ff9080dce466990cb873522f6634f" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 36935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7dd600757c0f48eb802132ab9283ab57" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 39641 } health_report { overall_health: UNKNOWN } } }
I20260808 14:50:46.357204 4347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:46.348258 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45326 (local address 127.26.206.194:36935)
0808 14:50:46.349201 (+ 943us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:46.349207 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:46.349233 (+ 26us) server_negotiation.cc:407] Connection header received
0808 14:50:46.349348 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:46.349355 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:46.349469 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:46.349659 (+ 190us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:50:46.350207 (+ 548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:46.351441 (+ 1234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:46.353646 (+ 2205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:46.354313 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:46.354452 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:46.355155 (+ 703us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:50:46.355991 (+ 836us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:50:46.356666 (+ 675us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:46.356727 (+ 61us) server_negotiation.cc:299] Negotiation successful
0808 14:50:46.356824 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":784,"thread_start_us":625,"threads_started":1}
I20260808 14:50:46.361614 4162 raft_consensus.cc:1261] T 6623c95a9fa24ec99de681e619318592 P 7dd600757c0f48eb802132ab9283ab57 [term 1 FOLLOWER]: Refusing update from remote peer 659ff9080dce466990cb873522f6634f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:50:46.361675 3839 raft_consensus.cc:1261] T 6623c95a9fa24ec99de681e619318592 P 59d0f9ffa2814130809f5d7dc33e2fd7 [term 1 FOLLOWER]: Refusing update from remote peer 659ff9080dce466990cb873522f6634f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:50:46.362541 4344 consensus_queue.cc:1035] T 6623c95a9fa24ec99de681e619318592 P 659ff9080dce466990cb873522f6634f [LEADER]: Connected to new peer: Peer: permanent_uuid: "59d0f9ffa2814130809f5d7dc33e2fd7" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 41307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:50:46.363121 4251 consensus_queue.cc:1035] T 6623c95a9fa24ec99de681e619318592 P 659ff9080dce466990cb873522f6634f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7dd600757c0f48eb802132ab9283ab57" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 39641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:50:46.394714 3655 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58294:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:50:46.394963 3655 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58294:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:50:46.398852 3655 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d4216fed87a840f587a730f82785f89a: Sending DeleteTablet for 3 replicas of tablet 6623c95a9fa24ec99de681e619318592
I20260808 14:50:46.400491 3807 tablet_service.cc:1514] Processing DeleteTablet for tablet 6623c95a9fa24ec99de681e619318592 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:50:46 UTC) from {username='oryx', principal='oryx/127.26.206.254@KRBTEST.COM'} at 127.0.0.1:41664
I20260808 14:50:46.400818 4319 tablet_replica.cc:330] T 6623c95a9fa24ec99de681e619318592 P 59d0f9ffa2814130809f5d7dc33e2fd7: stopping tablet replica
I20260808 14:50:46.401073 4319 raft_consensus.cc:2229] T 6623c95a9fa24ec99de681e619318592 P 59d0f9ffa2814130809f5d7dc33e2fd7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:50:46.401110 3975 tablet_service.cc:1514] Processing DeleteTablet for tablet 6623c95a9fa24ec99de681e619318592 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:50:46 UTC) from {username='oryx', principal='oryx/127.26.206.254@KRBTEST.COM'} at 127.0.0.1:45316
I20260808 14:50:46.401382 4319 raft_consensus.cc:2258] T 6623c95a9fa24ec99de681e619318592 P 59d0f9ffa2814130809f5d7dc33e2fd7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:50:46.401472 4317 tablet_replica.cc:330] T 6623c95a9fa24ec99de681e619318592 P 659ff9080dce466990cb873522f6634f: stopping tablet replica
I20260808 14:50:46.401489 4136 tablet_service.cc:1514] Processing DeleteTablet for tablet 6623c95a9fa24ec99de681e619318592 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:50:46 UTC) from {username='oryx', principal='oryx/127.26.206.254@KRBTEST.COM'} at 127.0.0.1:53870
I20260808 14:50:46.401661 4317 raft_consensus.cc:2229] T 6623c95a9fa24ec99de681e619318592 P 659ff9080dce466990cb873522f6634f [term 1 LEADER]: Raft consensus shutting down.
I20260808 14:50:46.401844 4318 tablet_replica.cc:330] T 6623c95a9fa24ec99de681e619318592 P 7dd600757c0f48eb802132ab9283ab57: stopping tablet replica
I20260808 14:50:46.402086 4318 raft_consensus.cc:2229] T 6623c95a9fa24ec99de681e619318592 P 7dd600757c0f48eb802132ab9283ab57 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:50:46.402133 4317 raft_consensus.cc:2258] T 6623c95a9fa24ec99de681e619318592 P 659ff9080dce466990cb873522f6634f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:50:46.402379 4318 raft_consensus.cc:2258] T 6623c95a9fa24ec99de681e619318592 P 7dd600757c0f48eb802132ab9283ab57 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:50:46.403513 4318 ts_tablet_manager.cc:1905] T 6623c95a9fa24ec99de681e619318592 P 7dd600757c0f48eb802132ab9283ab57: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:50:46.403693 4317 ts_tablet_manager.cc:1905] T 6623c95a9fa24ec99de681e619318592 P 659ff9080dce466990cb873522f6634f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:50:46.410090 3655 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58294:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:50:46.410785 3655 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:50:46.411280 4318 ts_tablet_manager.cc:1918] T 6623c95a9fa24ec99de681e619318592 P 7dd600757c0f48eb802132ab9283ab57: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:50:46.411594 4318 log.cc:1196] T 6623c95a9fa24ec99de681e619318592 P 7dd600757c0f48eb802132ab9283ab57: Deleting WAL directory at /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200577490656-27451-0/minicluster-data/ts-2/wal/wals/6623c95a9fa24ec99de681e619318592
I20260808 14:50:46.412196 4318 ts_tablet_manager.cc:1939] T 6623c95a9fa24ec99de681e619318592 P 7dd600757c0f48eb802132ab9283ab57: Deleting consensus metadata
I20260808 14:50:46.413647 3639 catalog_manager.cc:4841] TS 7dd600757c0f48eb802132ab9283ab57 (127.26.206.195:39641): tablet 6623c95a9fa24ec99de681e619318592 (table test-table [id=dbc4a169a8d94b44a00a3a3fb8a46fb4]) successfully deleted
I20260808 14:50:46.417061 4317 ts_tablet_manager.cc:1918] T 6623c95a9fa24ec99de681e619318592 P 659ff9080dce466990cb873522f6634f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:50:46.417243 4317 log.cc:1196] T 6623c95a9fa24ec99de681e619318592 P 659ff9080dce466990cb873522f6634f: Deleting WAL directory at /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200577490656-27451-0/minicluster-data/ts-1/wal/wals/6623c95a9fa24ec99de681e619318592
I20260808 14:50:46.418718 3807 tablet_service.cc:1467] Processing CreateTablet for tablet fd8606592e694f618c397dca27b9acac (DEFAULT_TABLE table=test-table [id=1902965f35b24af9807ab095404816b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:50:46.419196 3807 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fd8606592e694f618c397dca27b9acac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:50:46.420462 4317 ts_tablet_manager.cc:1939] T 6623c95a9fa24ec99de681e619318592 P 659ff9080dce466990cb873522f6634f: Deleting consensus metadata
I20260808 14:50:46.426510 4136 tablet_service.cc:1467] Processing CreateTablet for tablet fd8606592e694f618c397dca27b9acac (DEFAULT_TABLE table=test-table [id=1902965f35b24af9807ab095404816b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:50:46.426971 4136 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fd8606592e694f618c397dca27b9acac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:50:46.439445 4335 tablet_bootstrap.cc:492] T fd8606592e694f618c397dca27b9acac P 7dd600757c0f48eb802132ab9283ab57: Bootstrap starting.
I20260808 14:50:46.439819 4337 tablet_bootstrap.cc:492] T fd8606592e694f618c397dca27b9acac P 59d0f9ffa2814130809f5d7dc33e2fd7: Bootstrap starting.
I20260808 14:50:46.441519 4335 tablet_bootstrap.cc:654] T fd8606592e694f618c397dca27b9acac P 7dd600757c0f48eb802132ab9283ab57: Neither blocks nor log segments found. Creating new log.
I20260808 14:50:46.441634 4337 tablet_bootstrap.cc:654] T fd8606592e694f618c397dca27b9acac P 59d0f9ffa2814130809f5d7dc33e2fd7: Neither blocks nor log segments found. Creating new log.
I20260808 14:50:46.420521 3975 tablet_service.cc:1467] Processing CreateTablet for tablet fd8606592e694f618c397dca27b9acac (DEFAULT_TABLE table=test-table [id=1902965f35b24af9807ab095404816b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:50:46.448961 3975 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fd8606592e694f618c397dca27b9acac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:50:46.457422 4336 tablet_bootstrap.cc:492] T fd8606592e694f618c397dca27b9acac P 659ff9080dce466990cb873522f6634f: Bootstrap starting.
I20260808 14:50:46.459227 4336 tablet_bootstrap.cc:654] T fd8606592e694f618c397dca27b9acac P 659ff9080dce466990cb873522f6634f: Neither blocks nor log segments found. Creating new log.
I20260808 14:50:46.460872 4335 tablet_bootstrap.cc:492] T fd8606592e694f618c397dca27b9acac P 7dd600757c0f48eb802132ab9283ab57: No bootstrap required, opened a new log
I20260808 14:50:46.461081 4335 ts_tablet_manager.cc:1397] T fd8606592e694f618c397dca27b9acac P 7dd600757c0f48eb802132ab9283ab57: Time spent bootstrapping tablet: real 0.022s user 0.013s sys 0.000s
I20260808 14:50:46.461963 4335 raft_consensus.cc:348] T fd8606592e694f618c397dca27b9acac P 7dd600757c0f48eb802132ab9283ab57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59d0f9ffa2814130809f5d7dc33e2fd7" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 41307 } } peers { permanent_uuid: "659ff9080dce466990cb873522f6634f" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 36935 } } peers { permanent_uuid: "7dd600757c0f48eb802132ab9283ab57" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 39641 } }
I20260808 14:50:46.462285 4335 raft_consensus.cc:374] T fd8606592e694f618c397dca27b9acac P 7dd600757c0f48eb802132ab9283ab57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:50:46.462387 4335 raft_consensus.cc:729] T fd8606592e694f618c397dca27b9acac P 7dd600757c0f48eb802132ab9283ab57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7dd600757c0f48eb802132ab9283ab57, State: Initialized, Role: FOLLOWER
I20260808 14:50:46.462715 4335 consensus_queue.cc:260] T fd8606592e694f618c397dca27b9acac P 7dd600757c0f48eb802132ab9283ab57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59d0f9ffa2814130809f5d7dc33e2fd7" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 41307 } } peers { permanent_uuid: "659ff9080dce466990cb873522f6634f" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 36935 } } peers { permanent_uuid: "7dd600757c0f48eb802132ab9283ab57" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 39641 } }
I20260808 14:50:46.464579 4335 ts_tablet_manager.cc:1428] T fd8606592e694f618c397dca27b9acac P 7dd600757c0f48eb802132ab9283ab57: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260808 14:50:46.474320 4319 ts_tablet_manager.cc:1905] T 6623c95a9fa24ec99de681e619318592 P 59d0f9ffa2814130809f5d7dc33e2fd7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:50:46.482540 4319 ts_tablet_manager.cc:1918] T 6623c95a9fa24ec99de681e619318592 P 59d0f9ffa2814130809f5d7dc33e2fd7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:50:46.482730 4319 log.cc:1196] T 6623c95a9fa24ec99de681e619318592 P 59d0f9ffa2814130809f5d7dc33e2fd7: Deleting WAL directory at /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200577490656-27451-0/minicluster-data/ts-0/wal/wals/6623c95a9fa24ec99de681e619318592
I20260808 14:50:46.483238 4319 ts_tablet_manager.cc:1939] T 6623c95a9fa24ec99de681e619318592 P 59d0f9ffa2814130809f5d7dc33e2fd7: Deleting consensus metadata
I20260808 14:50:46.487430 3642 catalog_manager.cc:4841] TS 59d0f9ffa2814130809f5d7dc33e2fd7 (127.26.206.193:41307): tablet 6623c95a9fa24ec99de681e619318592 (table test-table [id=dbc4a169a8d94b44a00a3a3fb8a46fb4]) successfully deleted
I20260808 14:50:46.487987 3639 catalog_manager.cc:4841] TS 659ff9080dce466990cb873522f6634f (127.26.206.194:36935): tablet 6623c95a9fa24ec99de681e619318592 (table test-table [id=dbc4a169a8d94b44a00a3a3fb8a46fb4]) successfully deleted
I20260808 14:50:46.490303 4336 tablet_bootstrap.cc:492] T fd8606592e694f618c397dca27b9acac P 659ff9080dce466990cb873522f6634f: No bootstrap required, opened a new log
I20260808 14:50:46.490500 4336 ts_tablet_manager.cc:1397] T fd8606592e694f618c397dca27b9acac P 659ff9080dce466990cb873522f6634f: Time spent bootstrapping tablet: real 0.033s user 0.002s sys 0.006s
I20260808 14:50:46.491391 4336 raft_consensus.cc:348] T fd8606592e694f618c397dca27b9acac P 659ff9080dce466990cb873522f6634f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59d0f9ffa2814130809f5d7dc33e2fd7" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 41307 } } peers { permanent_uuid: "659ff9080dce466990cb873522f6634f" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 36935 } } peers { permanent_uuid: "7dd600757c0f48eb802132ab9283ab57" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 39641 } }
I20260808 14:50:46.491667 4336 raft_consensus.cc:374] T fd8606592e694f618c397dca27b9acac P 659ff9080dce466990cb873522f6634f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:50:46.492874 4336 raft_consensus.cc:729] T fd8606592e694f618c397dca27b9acac P 659ff9080dce466990cb873522f6634f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 659ff9080dce466990cb873522f6634f, State: Initialized, Role: FOLLOWER
I20260808 14:50:46.493191 4336 consensus_queue.cc:260] T fd8606592e694f618c397dca27b9acac P 659ff9080dce466990cb873522f6634f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59d0f9ffa2814130809f5d7dc33e2fd7" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 41307 } } peers { permanent_uuid: "659ff9080dce466990cb873522f6634f" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 36935 } } peers { permanent_uuid: "7dd600757c0f48eb802132ab9283ab57" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 39641 } }
I20260808 14:50:46.494676 4337 tablet_bootstrap.cc:492] T fd8606592e694f618c397dca27b9acac P 59d0f9ffa2814130809f5d7dc33e2fd7: No bootstrap required, opened a new log
I20260808 14:50:46.494925 4337 ts_tablet_manager.cc:1397] T fd8606592e694f618c397dca27b9acac P 59d0f9ffa2814130809f5d7dc33e2fd7: Time spent bootstrapping tablet: real 0.055s user 0.002s sys 0.009s
I20260808 14:50:46.495987 4336 ts_tablet_manager.cc:1428] T fd8606592e694f618c397dca27b9acac P 659ff9080dce466990cb873522f6634f: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20260808 14:50:46.495921 4337 raft_consensus.cc:348] T fd8606592e694f618c397dca27b9acac P 59d0f9ffa2814130809f5d7dc33e2fd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59d0f9ffa2814130809f5d7dc33e2fd7" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 41307 } } peers { permanent_uuid: "659ff9080dce466990cb873522f6634f" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 36935 } } peers { permanent_uuid: "7dd600757c0f48eb802132ab9283ab57" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 39641 } }
I20260808 14:50:46.496330 4337 raft_consensus.cc:374] T fd8606592e694f618c397dca27b9acac P 59d0f9ffa2814130809f5d7dc33e2fd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:50:46.496472 4337 raft_consensus.cc:729] T fd8606592e694f618c397dca27b9acac P 59d0f9ffa2814130809f5d7dc33e2fd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59d0f9ffa2814130809f5d7dc33e2fd7, State: Initialized, Role: FOLLOWER
I20260808 14:50:46.496810 4337 consensus_queue.cc:260] T fd8606592e694f618c397dca27b9acac P 59d0f9ffa2814130809f5d7dc33e2fd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59d0f9ffa2814130809f5d7dc33e2fd7" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 41307 } } peers { permanent_uuid: "659ff9080dce466990cb873522f6634f" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 36935 } } peers { permanent_uuid: "7dd600757c0f48eb802132ab9283ab57" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 39641 } }
I20260808 14:50:46.497502 4337 ts_tablet_manager.cc:1428] T fd8606592e694f618c397dca27b9acac P 59d0f9ffa2814130809f5d7dc33e2fd7: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 14:50:46.591706 4251 raft_consensus.cc:482] T fd8606592e694f618c397dca27b9acac P 659ff9080dce466990cb873522f6634f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:50:46.591962 4251 raft_consensus.cc:504] T fd8606592e694f618c397dca27b9acac P 659ff9080dce466990cb873522f6634f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59d0f9ffa2814130809f5d7dc33e2fd7" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 41307 } } peers { permanent_uuid: "659ff9080dce466990cb873522f6634f" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 36935 } } peers { permanent_uuid: "7dd600757c0f48eb802132ab9283ab57" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 39641 } }
I20260808 14:50:46.592780 4251 leader_election.cc:288] T fd8606592e694f618c397dca27b9acac P 659ff9080dce466990cb873522f6634f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59d0f9ffa2814130809f5d7dc33e2fd7 (127.26.206.193:41307), 7dd600757c0f48eb802132ab9283ab57 (127.26.206.195:39641)
I20260808 14:50:46.593551 4162 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd8606592e694f618c397dca27b9acac" candidate_uuid: "659ff9080dce466990cb873522f6634f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7dd600757c0f48eb802132ab9283ab57" is_pre_election: true
I20260808 14:50:46.593626 3839 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd8606592e694f618c397dca27b9acac" candidate_uuid: "659ff9080dce466990cb873522f6634f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59d0f9ffa2814130809f5d7dc33e2fd7" is_pre_election: true
I20260808 14:50:46.593829 4162 raft_consensus.cc:2454] T fd8606592e694f618c397dca27b9acac P 7dd600757c0f48eb802132ab9283ab57 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 659ff9080dce466990cb873522f6634f in term 0.
I20260808 14:50:46.593976 3839 raft_consensus.cc:2454] T fd8606592e694f618c397dca27b9acac P 59d0f9ffa2814130809f5d7dc33e2fd7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 659ff9080dce466990cb873522f6634f in term 0.
I20260808 14:50:46.594321 3914 leader_election.cc:302] T fd8606592e694f618c397dca27b9acac P 659ff9080dce466990cb873522f6634f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 659ff9080dce466990cb873522f6634f, 7dd600757c0f48eb802132ab9283ab57; no voters:
I20260808 14:50:46.594604 4251 raft_consensus.cc:2781] T fd8606592e694f618c397dca27b9acac P 659ff9080dce466990cb873522f6634f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:50:46.594718 4251 raft_consensus.cc:482] T fd8606592e694f618c397dca27b9acac P 659ff9080dce466990cb873522f6634f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:50:46.594805 4251 raft_consensus.cc:3037] T fd8606592e694f618c397dca27b9acac P 659ff9080dce466990cb873522f6634f [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:50:46.598064 4251 raft_consensus.cc:504] T fd8606592e694f618c397dca27b9acac P 659ff9080dce466990cb873522f6634f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59d0f9ffa2814130809f5d7dc33e2fd7" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 41307 } } peers { permanent_uuid: "659ff9080dce466990cb873522f6634f" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 36935 } } peers { permanent_uuid: "7dd600757c0f48eb802132ab9283ab57" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 39641 } }
I20260808 14:50:46.598876 4251 leader_election.cc:288] T fd8606592e694f618c397dca27b9acac P 659ff9080dce466990cb873522f6634f [CANDIDATE]: Term 1 election: Requested vote from peers 59d0f9ffa2814130809f5d7dc33e2fd7 (127.26.206.193:41307), 7dd600757c0f48eb802132ab9283ab57 (127.26.206.195:39641)
I20260808 14:50:46.599442 4162 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd8606592e694f618c397dca27b9acac" candidate_uuid: "659ff9080dce466990cb873522f6634f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7dd600757c0f48eb802132ab9283ab57"
I20260808 14:50:46.599687 4162 raft_consensus.cc:3037] T fd8606592e694f618c397dca27b9acac P 7dd600757c0f48eb802132ab9283ab57 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:50:46.599597 3839 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd8606592e694f618c397dca27b9acac" candidate_uuid: "659ff9080dce466990cb873522f6634f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59d0f9ffa2814130809f5d7dc33e2fd7"
I20260808 14:50:46.599864 3839 raft_consensus.cc:3037] T fd8606592e694f618c397dca27b9acac P 59d0f9ffa2814130809f5d7dc33e2fd7 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:50:46.602901 4162 raft_consensus.cc:2454] T fd8606592e694f618c397dca27b9acac P 7dd600757c0f48eb802132ab9283ab57 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 659ff9080dce466990cb873522f6634f in term 1.
I20260808 14:50:46.603498 3839 raft_consensus.cc:2454] T fd8606592e694f618c397dca27b9acac P 59d0f9ffa2814130809f5d7dc33e2fd7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 659ff9080dce466990cb873522f6634f in term 1.
I20260808 14:50:46.603523 3914 leader_election.cc:302] T fd8606592e694f618c397dca27b9acac P 659ff9080dce466990cb873522f6634f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 659ff9080dce466990cb873522f6634f, 7dd600757c0f48eb802132ab9283ab57; no voters:
I20260808 14:50:46.603946 4251 raft_consensus.cc:2781] T fd8606592e694f618c397dca27b9acac P 659ff9080dce466990cb873522f6634f [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:50:46.604585 4251 raft_consensus.cc:686] T fd8606592e694f618c397dca27b9acac P 659ff9080dce466990cb873522f6634f [term 1 LEADER]: Becoming Leader. State: Replica: 659ff9080dce466990cb873522f6634f, State: Running, Role: LEADER
I20260808 14:50:46.604979 4251 consensus_queue.cc:237] T fd8606592e694f618c397dca27b9acac P 659ff9080dce466990cb873522f6634f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59d0f9ffa2814130809f5d7dc33e2fd7" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 41307 } } peers { permanent_uuid: "659ff9080dce466990cb873522f6634f" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 36935 } } peers { permanent_uuid: "7dd600757c0f48eb802132ab9283ab57" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 39641 } }
I20260808 14:50:46.608072 3655 catalog_manager.cc:5495] T fd8606592e694f618c397dca27b9acac P 659ff9080dce466990cb873522f6634f reported cstate change: term changed from 0 to 1, leader changed from <none> to 659ff9080dce466990cb873522f6634f (127.26.206.194). New cstate: current_term: 1 leader_uuid: "659ff9080dce466990cb873522f6634f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59d0f9ffa2814130809f5d7dc33e2fd7" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 41307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "659ff9080dce466990cb873522f6634f" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 36935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7dd600757c0f48eb802132ab9283ab57" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 39641 } health_report { overall_health: UNKNOWN } } }
I20260808 14:50:46.712908 4240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:46.701659 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.194:37397 (local address 127.26.206.193:41307)
0808 14:50:46.702218 (+ 559us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:46.702224 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:46.704368 (+ 2144us) server_negotiation.cc:407] Connection header received
0808 14:50:46.704642 (+ 274us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:46.704650 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:46.704804 (+ 154us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:46.704919 (+ 115us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:50:46.705703 (+ 784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:46.707171 (+ 1468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:46.709895 (+ 2724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:46.710688 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:46.710814 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:46.711857 (+ 1043us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:50:46.712057 (+ 200us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:50:46.712138 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:46.712442 (+ 304us) server_negotiation.cc:299] Negotiation successful
0808 14:50:46.712538 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":95}
I20260808 14:50:46.713828 4360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:46.702863 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.193:41307 (local address 127.26.206.194:37397)
0808 14:50:46.704229 (+ 1366us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:46.704254 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0808 14:50:46.704449 (+ 195us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:50:46.704958 (+ 509us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:50:46.704967 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:50:46.704987 (+ 20us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 14:50:46.705531 (+ 544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:46.705547 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:46.707381 (+ 1834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:46.707389 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:46.709675 (+ 2286us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:46.709700 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:46.711055 (+ 1355us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:46.711063 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:46.711301 (+ 238us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:46.711390 (+ 89us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 14:50:46.712256 (+ 866us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 14:50:46.712271 (+ 15us) client_negotiation.cc:769] Sending connection context
0808 14:50:46.713140 (+ 869us) client_negotiation.cc:240] Negotiation successful
0808 14:50:46.713335 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1092,"thread_start_us":934,"threads_started":1}
I20260808 14:50:46.730767 4163 raft_consensus.cc:1261] T fd8606592e694f618c397dca27b9acac P 7dd600757c0f48eb802132ab9283ab57 [term 1 FOLLOWER]: Refusing update from remote peer 659ff9080dce466990cb873522f6634f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:50:46.731467 4344 consensus_queue.cc:1035] T fd8606592e694f618c397dca27b9acac P 659ff9080dce466990cb873522f6634f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7dd600757c0f48eb802132ab9283ab57" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 39641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:50:46.733114 3839 raft_consensus.cc:1261] T fd8606592e694f618c397dca27b9acac P 59d0f9ffa2814130809f5d7dc33e2fd7 [term 1 FOLLOWER]: Refusing update from remote peer 659ff9080dce466990cb873522f6634f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:50:46.735513 4344 consensus_queue.cc:1035] T fd8606592e694f618c397dca27b9acac P 659ff9080dce466990cb873522f6634f [LEADER]: Connected to new peer: Peer: permanent_uuid: "59d0f9ffa2814130809f5d7dc33e2fd7" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 41307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:50:46.797780 4347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:46.781632 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.193:45231 (local address 127.26.206.194:36935)
0808 14:50:46.781929 (+ 297us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:46.781940 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:46.789447 (+ 7507us) server_negotiation.cc:407] Connection header received
0808 14:50:46.789679 (+ 232us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:46.789688 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:46.789818 (+ 130us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:46.789945 (+ 127us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:50:46.790506 (+ 561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:46.791941 (+ 1435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:46.795171 (+ 3230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:46.796007 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:46.796175 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:46.796756 (+ 581us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:50:46.796911 (+ 155us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:50:46.797011 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:46.797260 (+ 249us) server_negotiation.cc:299] Negotiation successful
0808 14:50:46.797371 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":96}
I20260808 14:50:46.798781 4365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:46.781532 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.194:36935 (local address 127.26.206.193:45231)
0808 14:50:46.789300 (+ 7768us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:46.789327 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0808 14:50:46.789499 (+ 172us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:50:46.789985 (+ 486us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:50:46.789991 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:50:46.790007 (+ 16us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 14:50:46.790326 (+ 319us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:46.790341 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:46.792130 (+ 1789us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:46.792138 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:46.794978 (+ 2840us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:46.795000 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:46.796213 (+ 1213us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:46.796221 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:46.796471 (+ 250us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:46.796538 (+ 67us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 14:50:46.797037 (+ 499us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 14:50:46.797054 (+ 17us) client_negotiation.cc:769] Sending connection context
0808 14:50:46.798055 (+ 1001us) client_negotiation.cc:240] Negotiation successful
0808 14:50:46.798292 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7544,"thread_start_us":7374,"threads_started":1}
I20260808 14:50:46.848316 3657 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58294:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:50:46.848654 3657 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58294:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:50:46.853292 3657 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d4216fed87a840f587a730f82785f89a: Sending DeleteTablet for 3 replicas of tablet fd8606592e694f618c397dca27b9acac
I20260808 14:50:46.854226 3807 tablet_service.cc:1514] Processing DeleteTablet for tablet fd8606592e694f618c397dca27b9acac with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:50:46 UTC) from {username='oryx', principal='oryx/127.26.206.254@KRBTEST.COM'} at 127.0.0.1:41664
I20260808 14:50:46.854581 4319 tablet_replica.cc:330] T fd8606592e694f618c397dca27b9acac P 59d0f9ffa2814130809f5d7dc33e2fd7: stopping tablet replica
I20260808 14:50:46.854650 4136 tablet_service.cc:1514] Processing DeleteTablet for tablet fd8606592e694f618c397dca27b9acac with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:50:46 UTC) from {username='oryx', principal='oryx/127.26.206.254@KRBTEST.COM'} at 127.0.0.1:53870
I20260808 14:50:46.854794 4319 raft_consensus.cc:2229] T fd8606592e694f618c397dca27b9acac P 59d0f9ffa2814130809f5d7dc33e2fd7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:50:46.854991 4318 tablet_replica.cc:330] T fd8606592e694f618c397dca27b9acac P 7dd600757c0f48eb802132ab9283ab57: stopping tablet replica
I20260808 14:50:46.855038 4319 raft_consensus.cc:2258] T fd8606592e694f618c397dca27b9acac P 59d0f9ffa2814130809f5d7dc33e2fd7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:50:46.855234 4318 raft_consensus.cc:2229] T fd8606592e694f618c397dca27b9acac P 7dd600757c0f48eb802132ab9283ab57 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:50:46.855504 4318 raft_consensus.cc:2258] T fd8606592e694f618c397dca27b9acac P 7dd600757c0f48eb802132ab9283ab57 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:50:46.856683 4319 ts_tablet_manager.cc:1905] T fd8606592e694f618c397dca27b9acac P 59d0f9ffa2814130809f5d7dc33e2fd7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:50:46.857273 4318 ts_tablet_manager.cc:1905] T fd8606592e694f618c397dca27b9acac P 7dd600757c0f48eb802132ab9283ab57: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:50:46.862114 3975 tablet_service.cc:1514] Processing DeleteTablet for tablet fd8606592e694f618c397dca27b9acac with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:50:46 UTC) from {username='oryx', principal='oryx/127.26.206.254@KRBTEST.COM'} at 127.0.0.1:45316
I20260808 14:50:46.862484 4317 tablet_replica.cc:330] T fd8606592e694f618c397dca27b9acac P 659ff9080dce466990cb873522f6634f: stopping tablet replica
I20260808 14:50:46.862702 4317 raft_consensus.cc:2229] T fd8606592e694f618c397dca27b9acac P 659ff9080dce466990cb873522f6634f [term 1 LEADER]: Raft consensus shutting down.
I20260808 14:50:46.862774 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 3735
I20260808 14:50:46.863165 4317 raft_consensus.cc:2258] T fd8606592e694f618c397dca27b9acac P 659ff9080dce466990cb873522f6634f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:50:46.864948 4317 ts_tablet_manager.cc:1905] T fd8606592e694f618c397dca27b9acac P 659ff9080dce466990cb873522f6634f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:50:46.871693 4318 ts_tablet_manager.cc:1918] T fd8606592e694f618c397dca27b9acac P 7dd600757c0f48eb802132ab9283ab57: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 14:50:46.871912 4318 log.cc:1196] T fd8606592e694f618c397dca27b9acac P 7dd600757c0f48eb802132ab9283ab57: Deleting WAL directory at /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200577490656-27451-0/minicluster-data/ts-2/wal/wals/fd8606592e694f618c397dca27b9acac
I20260808 14:50:46.872467 4318 ts_tablet_manager.cc:1939] T fd8606592e694f618c397dca27b9acac P 7dd600757c0f48eb802132ab9283ab57: Deleting consensus metadata
I20260808 14:50:46.873980 3639 catalog_manager.cc:4841] TS 7dd600757c0f48eb802132ab9283ab57 (127.26.206.195:39641): tablet fd8606592e694f618c397dca27b9acac (table test-table [id=1902965f35b24af9807ab095404816b2]) successfully deleted
I20260808 14:50:46.878847 4317 ts_tablet_manager.cc:1918] T fd8606592e694f618c397dca27b9acac P 659ff9080dce466990cb873522f6634f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 14:50:46.879029 4317 log.cc:1196] T fd8606592e694f618c397dca27b9acac P 659ff9080dce466990cb873522f6634f: Deleting WAL directory at /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200577490656-27451-0/minicluster-data/ts-1/wal/wals/fd8606592e694f618c397dca27b9acac
I20260808 14:50:46.882928 4319 ts_tablet_manager.cc:1918] T fd8606592e694f618c397dca27b9acac P 59d0f9ffa2814130809f5d7dc33e2fd7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 14:50:46.883116 4319 log.cc:1196] T fd8606592e694f618c397dca27b9acac P 59d0f9ffa2814130809f5d7dc33e2fd7: Deleting WAL directory at /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200577490656-27451-0/minicluster-data/ts-0/wal/wals/fd8606592e694f618c397dca27b9acac
I20260808 14:50:46.883721 4319 ts_tablet_manager.cc:1939] T fd8606592e694f618c397dca27b9acac P 59d0f9ffa2814130809f5d7dc33e2fd7: Deleting consensus metadata
I20260808 14:50:46.885066 3642 catalog_manager.cc:4841] TS 59d0f9ffa2814130809f5d7dc33e2fd7 (127.26.206.193:41307): tablet fd8606592e694f618c397dca27b9acac (table test-table [id=1902965f35b24af9807ab095404816b2]) successfully deleted
I20260808 14:50:46.887220 4317 ts_tablet_manager.cc:1939] T fd8606592e694f618c397dca27b9acac P 659ff9080dce466990cb873522f6634f: Deleting consensus metadata
I20260808 14:50:46.889016 3639 catalog_manager.cc:4841] TS 659ff9080dce466990cb873522f6634f (127.26.206.194:36935): tablet fd8606592e694f618c397dca27b9acac (table test-table [id=1902965f35b24af9807ab095404816b2]) successfully deleted
Aug 08 14:50:46 dist-test-slave-6k22 krb5kdc[3604](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200646, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.26.206.193@KRBTEST.COM
I20260808 14:50:46.911703 4240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:46.867882 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41690 (local address 127.26.206.193:41307)
0808 14:50:46.868087 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:46.868095 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:46.888008 (+ 19913us) server_negotiation.cc:407] Connection header received
0808 14:50:46.888353 (+ 345us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:46.888360 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:46.888466 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:46.888565 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:46.890915 (+ 2350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:46.892377 (+ 1462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:46.894416 (+ 2039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:46.895319 (+ 903us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:46.895479 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:46.902250 (+ 6771us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:50:46.902274 (+ 24us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:50:46.902300 (+ 26us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:50:46.902354 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:50:46.907431 (+ 5077us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:46.908497 (+ 1066us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:46.908510 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:46.908518 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:46.908732 (+ 214us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:46.909329 (+ 597us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:46.909336 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:46.909340 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:46.909849 (+ 509us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:50:46.910265 (+ 416us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:46.910673 (+ 408us) server_negotiation.cc:299] Negotiation successful
0808 14:50:46.910979 (+ 306us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260808 14:50:46.912633 3884 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:50:47.135314 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 3735
I20260808 14:50:47.173403 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 3894
Aug 08 14:50:47 dist-test-slave-6k22 krb5kdc[3604](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200646, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.26.206.194@KRBTEST.COM
I20260808 14:50:47.188908 4347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:47.174219 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45338 (local address 127.26.206.194:36935)
0808 14:50:47.174438 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:47.174442 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:47.174460 (+ 18us) server_negotiation.cc:407] Connection header received
0808 14:50:47.174676 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:47.174680 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:47.174753 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:47.174857 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:47.176327 (+ 1470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:47.177040 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:47.178440 (+ 1400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:47.178864 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:47.178958 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:47.183204 (+ 4246us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:50:47.183216 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:50:47.183232 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:50:47.183276 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:50:47.186319 (+ 3043us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:47.186977 (+ 658us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:47.186984 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:47.186986 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:47.187103 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:47.187474 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:47.187477 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:47.187479 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:47.187912 (+ 433us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:50:47.188151 (+ 239us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:47.188404 (+ 253us) server_negotiation.cc:299] Negotiation successful
0808 14:50:47.188557 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260808 14:50:47.189564 4053 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:50:47.320600 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 3894
I20260808 14:50:47.346992 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 4062
Aug 08 14:50:47 dist-test-slave-6k22 krb5kdc[3604](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200646, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.26.206.195@KRBTEST.COM
I20260808 14:50:47.361956 4371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:47.347809 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53888 (local address 127.26.206.195:39641)
0808 14:50:47.348210 (+ 401us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:47.348214 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:47.348230 (+ 16us) server_negotiation.cc:407] Connection header received
0808 14:50:47.348291 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:47.348295 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:47.348351 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:47.348438 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:47.349690 (+ 1252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:47.350408 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:47.351741 (+ 1333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:47.352127 (+ 386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:47.352266 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:47.356905 (+ 4639us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:50:47.356926 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:50:47.356942 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:50:47.356972 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:50:47.359672 (+ 2700us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:47.360281 (+ 609us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:47.360288 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:47.360290 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:47.360420 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:47.360732 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:47.360735 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:47.360737 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:47.361079 (+ 342us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:50:47.361315 (+ 236us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:47.361521 (+ 206us) server_negotiation.cc:299] Negotiation successful
0808 14:50:47.361689 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":305,"thread_start_us":209,"threads_started":1}
I20260808 14:50:47.362608 4208 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:50:47.487762 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 4062
I20260808 14:50:47.514905 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 3621
I20260808 14:50:47.516180 3700 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:50:47.634305 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 3621
2026-08-08T14:50:47Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (6181 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786200577490656-27451-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:50:47 dist-test-slave-6k22 krb5kdc[4379](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:50:47 dist-test-slave-6k22 krb5kdc[4379](info): set up 2 sockets
Aug 08 14:50:47 dist-test-slave-6k22 krb5kdc[4379](info): commencing operation
krb5kdc: starting...
W20260808 14:50:48.802938 27451 mini_kdc.cc:121] Time spent starting KDC: real 1.118s user 0.001s sys 0.031s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786200577490656-27451-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786200577490656-27451-0/krb5kdc/test-user.keytab.
Aug 08 14:50:48 dist-test-slave-6k22 krb5kdc[4379](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200648, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:50:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:50:48Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.206.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.206.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.206.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.254.keytab.
Entry for principal kudu/127.26.206.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.254.keytab.
I20260808 14:50:49.058960 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786200577490656-27451-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786200577490656-27451-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786200577490656-27451-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.206.254:38281
--webserver_interface=127.26.206.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.254.keytab
--principal=kudu/127.26.206.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.206.212:46257
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.206.254:38281
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:50:49.384359 4393 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:50:49.384661 4393 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:50:49.384856 4393 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:50:49.391876 4393 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:50:49.391970 4393 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:50:49.392071 4393 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:50:49.392170 4393 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:50:49.392261 4393 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:50:49.401754 4393 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:46257
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786200577490656-27451-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786200577490656-27451-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.206.254:38281
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.254.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.206.254:38281
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.206.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786200577490656-27451-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:50:49.402998 4393 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:50:49.404361 4393 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:50:49.417047 4402 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:50:49.417013 4405 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:50:49.417075 4403 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:50:49.418175 4393 server_base.cc:1034] running on GCE node
I20260808 14:50:49.418916 4393 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:50:49.420336 4393 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:50:49.421533 4393 hybrid_clock.cc:648] HybridClock initialized: now 1786200649421489 us; error 40 us; skew 500 ppm
I20260808 14:50:49.421903 4393 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-08T14:50:49Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1847 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:50:49 dist-test-slave-6k22 krb5kdc[4412](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:50:49 dist-test-slave-6k22 krb5kdc[4412](info): set up 2 sockets
Aug 08 14:50:49 dist-test-slave-6k22 krb5kdc[4412](info): commencing operation
krb5kdc: starting...
W20260808 14:50:50.646624 27451 mini_kdc.cc:121] Time spent starting KDC: real 1.114s user 0.000s sys 0.032s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/krb5kdc/test-user.keytab.
Aug 08 14:50:50 dist-test-slave-6k22 krb5kdc[4412](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200650, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:50:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:50:50Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.206.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.206.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.206.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.254.keytab.
Entry for principal kudu/127.26.206.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.254.keytab.
I20260808 14:50:50.893323 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.206.254:45657
--webserver_interface=127.26.206.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.254.keytab
--principal=kudu/127.26.206.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.206.212:41445
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.206.254:45657
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:50:51.216459 4426 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:50:51.216713 4426 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:50:51.216914 4426 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:50:51.223908 4426 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:50:51.224058 4426 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:50:51.224156 4426 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:50:51.224267 4426 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:50:51.224339 4426 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:50:51.233825 4426 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:41445
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.206.254:45657
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.254.keytab
--principal=kudu/127.26.206.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.206.254:45657
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.206.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:50:51.235049 4426 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:50:51.236312 4426 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:50:51.248265 4432 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:50:51.248364 4434 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:50:51.248226 4431 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:50:51.248952 4426 server_base.cc:1034] running on GCE node
I20260808 14:50:51.249614 4426 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:50:51.250814 4426 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:50:51.252017 4426 hybrid_clock.cc:648] HybridClock initialized: now 1786200651251968 us; error 35 us; skew 500 ppm
I20260808 14:50:51.252349 4426 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:50:51 dist-test-slave-6k22 krb5kdc[4412](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200651, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:50:51.260661 4426 init.cc:377] Logged in from keytab as kudu/127.26.206.254@KRBTEST.COM (short username kudu)
I20260808 14:50:51.262171 4426 webserver.cc:460] Webserver started at http://127.26.206.254:35749/ using document root <none> and password file <none>
I20260808 14:50:51.262868 4426 fs_manager.cc:359] Metadata directory not provided
I20260808 14:50:51.263013 4426 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:50:51.263324 4426 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:50:51.266201 4426 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/minicluster-data/master-0/data/instance:
uuid: "001d82ebe4b046b082a9b60276d9412a"
format_stamp: "Formatted at 2026-08-08 14:50:51 on dist-test-slave-6k22"
server_key: "5e1f324aacfa2163c5e7ff7d806912a6"
server_key_iv: "1302f8ccd27d2533bdf40e17d5493343"
server_key_version: "encryptionkey@0"
I20260808 14:50:51.266943 4426 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/minicluster-data/master-0/wal/instance:
uuid: "001d82ebe4b046b082a9b60276d9412a"
format_stamp: "Formatted at 2026-08-08 14:50:51 on dist-test-slave-6k22"
server_key: "5e1f324aacfa2163c5e7ff7d806912a6"
server_key_iv: "1302f8ccd27d2533bdf40e17d5493343"
server_key_version: "encryptionkey@0"
I20260808 14:50:51.271850 4426 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260808 14:50:51.275190 4442 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:50:51.276522 4426 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 14:50:51.276718 4426 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/minicluster-data/master-0/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/minicluster-data/master-0/wal
uuid: "001d82ebe4b046b082a9b60276d9412a"
format_stamp: "Formatted at 2026-08-08 14:50:51 on dist-test-slave-6k22"
server_key: "5e1f324aacfa2163c5e7ff7d806912a6"
server_key_iv: "1302f8ccd27d2533bdf40e17d5493343"
server_key_version: "encryptionkey@0"
I20260808 14:50:51.276916 4426 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:50:51.304137 4426 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:50:51.308079 4426 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:50:51.308368 4426 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:50:51.326995 4426 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.254:45657
I20260808 14:50:51.327025 4499 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.254:45657 every 8 connection(s)
I20260808 14:50:51.328469 4426 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
I20260808 14:50:51.332054 4500 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:50:51.335994 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 4426
I20260808 14:50:51.336239 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/minicluster-data/master-0/wal/instance
I20260808 14:50:51.337061 27451 external_mini_cluster.cc:1428] Setting key 7435186086d00b49efcdd557aa43388c
I20260808 14:50:51.345981 4500 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 001d82ebe4b046b082a9b60276d9412a: Bootstrap starting.
I20260808 14:50:51.349371 4500 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 001d82ebe4b046b082a9b60276d9412a: Neither blocks nor log segments found. Creating new log.
I20260808 14:50:51.350366 4500 log.cc:824] T 00000000000000000000000000000000 P 001d82ebe4b046b082a9b60276d9412a: Log is configured to *not* fsync() on all Append() calls
Aug 08 14:50:51 dist-test-slave-6k22 krb5kdc[4412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200650, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.206.254@KRBTEST.COM
I20260808 14:50:51.353547 4500 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 001d82ebe4b046b082a9b60276d9412a: No bootstrap required, opened a new log
I20260808 14:50:51.360399 4503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:51.339190 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34462 (local address 127.26.206.254:45657)
0808 14:50:51.340031 (+ 841us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:51.340046 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:51.340096 (+ 50us) server_negotiation.cc:407] Connection header received
0808 14:50:51.341783 (+ 1687us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:51.341815 (+ 32us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:51.342335 (+ 520us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:51.342789 (+ 454us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:51.344272 (+ 1483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:51.346340 (+ 2068us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:51.347468 (+ 1128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:51.348528 (+ 1060us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:51.348734 (+ 206us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:51.353162 (+ 4428us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:50:51.353169 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:50:51.353181 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:50:51.353215 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:50:51.356429 (+ 3214us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:51.357213 (+ 784us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:51.357218 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:51.357224 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:51.357387 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:51.357789 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:51.357792 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:51.357794 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:51.358248 (+ 454us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:50:51.358505 (+ 257us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:51.358962 (+ 457us) server_negotiation.cc:299] Negotiation successful
0808 14:50:51.359348 (+ 386us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":625,"thread_start_us":424,"threads_started":1}
I20260808 14:50:51.362116 4500 raft_consensus.cc:348] T 00000000000000000000000000000000 P 001d82ebe4b046b082a9b60276d9412a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "001d82ebe4b046b082a9b60276d9412a" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 45657 } }
I20260808 14:50:51.362475 4500 raft_consensus.cc:374] T 00000000000000000000000000000000 P 001d82ebe4b046b082a9b60276d9412a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:50:51.362604 4500 raft_consensus.cc:729] T 00000000000000000000000000000000 P 001d82ebe4b046b082a9b60276d9412a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 001d82ebe4b046b082a9b60276d9412a, State: Initialized, Role: FOLLOWER
I20260808 14:50:51.363233 4500 consensus_queue.cc:260] T 00000000000000000000000000000000 P 001d82ebe4b046b082a9b60276d9412a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "001d82ebe4b046b082a9b60276d9412a" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 45657 } }
I20260808 14:50:51.363467 4500 raft_consensus.cc:388] T 00000000000000000000000000000000 P 001d82ebe4b046b082a9b60276d9412a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:50:51.363631 4500 raft_consensus.cc:482] T 00000000000000000000000000000000 P 001d82ebe4b046b082a9b60276d9412a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:50:51.363768 4500 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 001d82ebe4b046b082a9b60276d9412a [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:50:51.365741 4500 raft_consensus.cc:504] T 00000000000000000000000000000000 P 001d82ebe4b046b082a9b60276d9412a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "001d82ebe4b046b082a9b60276d9412a" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 45657 } }
I20260808 14:50:51.366163 4500 leader_election.cc:302] T 00000000000000000000000000000000 P 001d82ebe4b046b082a9b60276d9412a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 001d82ebe4b046b082a9b60276d9412a; no voters:
I20260808 14:50:51.366645 4500 leader_election.cc:288] T 00000000000000000000000000000000 P 001d82ebe4b046b082a9b60276d9412a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:50:51.366751 4505 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 001d82ebe4b046b082a9b60276d9412a [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:50:51.367512 4505 raft_consensus.cc:686] T 00000000000000000000000000000000 P 001d82ebe4b046b082a9b60276d9412a [term 1 LEADER]: Becoming Leader. State: Replica: 001d82ebe4b046b082a9b60276d9412a, State: Running, Role: LEADER
I20260808 14:50:51.368127 4505 consensus_queue.cc:237] T 00000000000000000000000000000000 P 001d82ebe4b046b082a9b60276d9412a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "001d82ebe4b046b082a9b60276d9412a" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 45657 } }
I20260808 14:50:51.368676 4500 sys_catalog.cc:564] T 00000000000000000000000000000000 P 001d82ebe4b046b082a9b60276d9412a [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:50:51.371186 4507 sys_catalog.cc:455] T 00000000000000000000000000000000 P 001d82ebe4b046b082a9b60276d9412a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 001d82ebe4b046b082a9b60276d9412a. Latest consensus state: current_term: 1 leader_uuid: "001d82ebe4b046b082a9b60276d9412a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "001d82ebe4b046b082a9b60276d9412a" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 45657 } } }
I20260808 14:50:51.371644 4507 sys_catalog.cc:458] T 00000000000000000000000000000000 P 001d82ebe4b046b082a9b60276d9412a [sys.catalog]: This master's current role is: LEADER
I20260808 14:50:51.371165 4506 sys_catalog.cc:455] T 00000000000000000000000000000000 P 001d82ebe4b046b082a9b60276d9412a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "001d82ebe4b046b082a9b60276d9412a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "001d82ebe4b046b082a9b60276d9412a" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 45657 } } }
I20260808 14:50:51.371800 4506 sys_catalog.cc:458] T 00000000000000000000000000000000 P 001d82ebe4b046b082a9b60276d9412a [sys.catalog]: This master's current role is: LEADER
I20260808 14:50:51.373858 4513 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:50:51.379619 4513 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:50:51.390815 4513 catalog_manager.cc:1347] Generated new cluster ID: 61a5eeea72764435861e9951d2ff4494
I20260808 14:50:51.390983 4513 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:50:51.419060 4513 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:50:51.420575 4513 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:50:51.428902 4513 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 001d82ebe4b046b082a9b60276d9412a: Generated new TSK 0
I20260808 14:50:51.429711 4513 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.206.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.206.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.206.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.193.keytab.
Entry for principal kudu/127.26.206.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.193.keytab.
I20260808 14:50:51.489463 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.206.193:0
--local_ip_for_outbound_sockets=127.26.206.193
--webserver_interface=127.26.206.193
--webserver_port=0
--tserver_master_addrs=127.26.206.254:45657
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.193.keytab
--principal=kudu/127.26.206.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.206.212:41445
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:50:51.825479 4534 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:50:51.825762 4534 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:50:51.825961 4534 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:50:51.833035 4534 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:50:51.833166 4534 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:50:51.833325 4534 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.206.193
I20260808 14:50:51.842684 4534 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:41445
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.193.keytab
--principal=kudu/127.26.206.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.206.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.206.193
--webserver_port=0
--tserver_master_addrs=127.26.206.254:45657
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.206.193
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:50:51.844080 4534 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:50:51.845351 4534 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:50:51.857939 4540 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:50:51.858112 4541 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:50:51.858534 4543 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:50:51.859030 4534 server_base.cc:1034] running on GCE node
I20260808 14:50:51.859687 4534 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:50:51.860633 4534 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:50:51.861940 4534 hybrid_clock.cc:648] HybridClock initialized: now 1786200651861918 us; error 53 us; skew 500 ppm
I20260808 14:50:51.862280 4534 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:50:51 dist-test-slave-6k22 krb5kdc[4412](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200651, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:50:51.865445 4534 init.cc:377] Logged in from keytab as kudu/127.26.206.193@KRBTEST.COM (short username kudu)
I20260808 14:50:51.866918 4534 webserver.cc:460] Webserver started at http://127.26.206.193:43749/ using document root <none> and password file <none>
I20260808 14:50:51.867640 4534 fs_manager.cc:359] Metadata directory not provided
I20260808 14:50:51.867789 4534 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:50:51.868108 4534 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:50:51.871068 4534 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/minicluster-data/ts-0/data/instance:
uuid: "ce877a0dc2d347f4be1ad758cf49f199"
format_stamp: "Formatted at 2026-08-08 14:50:51 on dist-test-slave-6k22"
server_key: "a3a71ddda2585be63891bee68df3aaf0"
server_key_iv: "92c0e0cc89e75b9673e18d168303d9d5"
server_key_version: "encryptionkey@0"
I20260808 14:50:51.871886 4534 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/minicluster-data/ts-0/wal/instance:
uuid: "ce877a0dc2d347f4be1ad758cf49f199"
format_stamp: "Formatted at 2026-08-08 14:50:51 on dist-test-slave-6k22"
server_key: "a3a71ddda2585be63891bee68df3aaf0"
server_key_iv: "92c0e0cc89e75b9673e18d168303d9d5"
server_key_version: "encryptionkey@0"
I20260808 14:50:51.876780 4534 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.003s
I20260808 14:50:51.880167 4550 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:50:51.881585 4534 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260808 14:50:51.881778 4534 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/minicluster-data/ts-0/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/minicluster-data/ts-0/wal
uuid: "ce877a0dc2d347f4be1ad758cf49f199"
format_stamp: "Formatted at 2026-08-08 14:50:51 on dist-test-slave-6k22"
server_key: "a3a71ddda2585be63891bee68df3aaf0"
server_key_iv: "92c0e0cc89e75b9673e18d168303d9d5"
server_key_version: "encryptionkey@0"
I20260808 14:50:51.881978 4534 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:50:51.915663 4534 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:50:51.919428 4534 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:50:51.919754 4534 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:50:51.920718 4534 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:50:51.922024 4534 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:50:51.922127 4534 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:50:51.922289 4534 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:50:51.922394 4534 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:50:51.956053 4534 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.193:44583
I20260808 14:50:51.956137 4678 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.193:44583 every 8 connection(s)
I20260808 14:50:51.957365 4534 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/minicluster-data/ts-0/data/info.pb
I20260808 14:50:51.965101 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 4534
I20260808 14:50:51.965348 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/minicluster-data/ts-0/wal/instance
I20260808 14:50:51.965973 27451 external_mini_cluster.cc:1428] Setting key 898d37f7887271cc12bb94cca7d980da
Aug 08 14:50:51 dist-test-slave-6k22 krb5kdc[4412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200651, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.193@KRBTEST.COM for kudu/127.26.206.254@KRBTEST.COM
I20260808 14:50:51.978754 4681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:51.960050 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.193:51841 (local address 127.26.206.254:45657)
0808 14:50:51.960526 (+ 476us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:51.960531 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:51.961318 (+ 787us) server_negotiation.cc:407] Connection header received
0808 14:50:51.963145 (+ 1827us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:51.963150 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:51.963241 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:51.963367 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:51.964910 (+ 1543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:51.965787 (+ 877us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:51.967709 (+ 1922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:51.968296 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:51.968436 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:51.972019 (+ 3583us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:50:51.972027 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:50:51.972034 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:50:51.972078 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:50:51.975522 (+ 3444us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:51.976250 (+ 728us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:51.976258 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:51.976262 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:51.976413 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:51.976822 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:51.976829 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:51.976835 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:51.977211 (+ 376us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:50:51.977367 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:51.978016 (+ 649us) server_negotiation.cc:299] Negotiation successful
0808 14:50:51.978272 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":380,"thread_start_us":263,"threads_started":1}
I20260808 14:50:51.979394 4682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:51.960473 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:45657 (local address 127.26.206.193:51841)
0808 14:50:51.961158 (+ 685us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:51.961197 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 14:50:51.962872 (+ 1675us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:50:51.963655 (+ 783us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:50:51.963664 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:50:51.964189 (+ 525us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:50:51.964729 (+ 540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:51.964746 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:51.965942 (+ 1196us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:51.965946 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:51.967528 (+ 1582us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:51.967542 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:51.968553 (+ 1011us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:51.968559 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:51.968745 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:51.969533 (+ 788us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:50:51.969562 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:50:51.971798 (+ 2236us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:50:51.975676 (+ 3878us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:50:51.975682 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:50:51.975695 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:50:51.976100 (+ 405us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:50:51.976520 (+ 420us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:50:51.976523 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:50:51.976525 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:50:51.976697 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:50:51.977332 (+ 635us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:50:51.977338 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:50:51.977631 (+ 293us) client_negotiation.cc:769] Sending connection context
0808 14:50:51.977849 (+ 218us) client_negotiation.cc:240] Negotiation successful
0808 14:50:51.978217 (+ 368us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":465,"thread_start_us":274,"threads_started":1}
I20260808 14:50:51.981149 4679 heartbeater.cc:347] Connected to a master server at 127.26.206.254:45657
I20260808 14:50:51.981501 4679 heartbeater.cc:464] Registering TS with master...
I20260808 14:50:51.982491 4679 heartbeater.cc:511] Master 127.26.206.254:45657 requested a full tablet report, sending...
I20260808 14:50:51.985314 4461 ts_manager.cc:194] Registered new tserver with Master: ce877a0dc2d347f4be1ad758cf49f199 (127.26.206.193:44583)
I20260808 14:50:51.987366 4461 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.206.193@KRBTEST.COM'} at 127.26.206.193:51841
WARNING: no policy specified for kudu/127.26.206.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.206.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.206.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.194.keytab.
Entry for principal kudu/127.26.206.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.194.keytab.
I20260808 14:50:52.043825 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.206.194:0
--local_ip_for_outbound_sockets=127.26.206.194
--webserver_interface=127.26.206.194
--webserver_port=0
--tserver_master_addrs=127.26.206.254:45657
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.194.keytab
--principal=kudu/127.26.206.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.206.212:41445
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:50:52.381278 4685 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:50:52.381580 4685 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:50:52.381672 4685 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:50:52.389115 4685 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:50:52.389219 4685 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:50:52.389334 4685 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.206.194
I20260808 14:50:52.398838 4685 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:41445
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.194.keytab
--principal=kudu/127.26.206.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.206.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.206.194
--webserver_port=0
--tserver_master_addrs=127.26.206.254:45657
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.206.194
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:50:52.400058 4685 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:50:52.401309 4685 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:50:52.414198 4691 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:50:52.414126 4692 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:50:52.414232 4694 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:50:52.415073 4685 server_base.cc:1034] running on GCE node
I20260808 14:50:52.415728 4685 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:50:52.416615 4685 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:50:52.417838 4685 hybrid_clock.cc:648] HybridClock initialized: now 1786200652417803 us; error 47 us; skew 500 ppm
I20260808 14:50:52.418138 4685 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:50:52 dist-test-slave-6k22 krb5kdc[4412](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200652, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:50:52.422092 4685 init.cc:377] Logged in from keytab as kudu/127.26.206.194@KRBTEST.COM (short username kudu)
I20260808 14:50:52.423712 4685 webserver.cc:460] Webserver started at http://127.26.206.194:33141/ using document root <none> and password file <none>
I20260808 14:50:52.424403 4685 fs_manager.cc:359] Metadata directory not provided
I20260808 14:50:52.424551 4685 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:50:52.424870 4685 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:50:52.427768 4685 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/minicluster-data/ts-1/data/instance:
uuid: "b45b627d03a949f18c0da345dea883fa"
format_stamp: "Formatted at 2026-08-08 14:50:52 on dist-test-slave-6k22"
server_key: "f25cbc6d7ddc61a64abaefb98da75822"
server_key_iv: "28e1409920f52ab25ae5c034b1a484c0"
server_key_version: "encryptionkey@0"
I20260808 14:50:52.428550 4685 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/minicluster-data/ts-1/wal/instance:
uuid: "b45b627d03a949f18c0da345dea883fa"
format_stamp: "Formatted at 2026-08-08 14:50:52 on dist-test-slave-6k22"
server_key: "f25cbc6d7ddc61a64abaefb98da75822"
server_key_iv: "28e1409920f52ab25ae5c034b1a484c0"
server_key_version: "encryptionkey@0"
I20260808 14:50:52.433403 4685 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.004s
I20260808 14:50:52.436672 4701 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:50:52.437964 4685 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260808 14:50:52.438127 4685 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/minicluster-data/ts-1/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/minicluster-data/ts-1/wal
uuid: "b45b627d03a949f18c0da345dea883fa"
format_stamp: "Formatted at 2026-08-08 14:50:52 on dist-test-slave-6k22"
server_key: "f25cbc6d7ddc61a64abaefb98da75822"
server_key_iv: "28e1409920f52ab25ae5c034b1a484c0"
server_key_version: "encryptionkey@0"
I20260808 14:50:52.438318 4685 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:50:52.449992 4685 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:50:52.453718 4685 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:50:52.453996 4685 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:50:52.454877 4685 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:50:52.456173 4685 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:50:52.456282 4685 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:50:52.456420 4685 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:50:52.456496 4685 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:50:52.490018 4685 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.194:45175
I20260808 14:50:52.490060 4833 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.194:45175 every 8 connection(s)
I20260808 14:50:52.491303 4685 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/minicluster-data/ts-1/data/info.pb
I20260808 14:50:52.499001 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 4685
I20260808 14:50:52.499204 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/minicluster-data/ts-1/wal/instance
I20260808 14:50:52.499725 27451 external_mini_cluster.cc:1428] Setting key d876964757f64b8c6090c593a78d7208
Aug 08 14:50:52 dist-test-slave-6k22 krb5kdc[4412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200652, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.194@KRBTEST.COM for kudu/127.26.206.254@KRBTEST.COM
I20260808 14:50:52.511585 4837 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:52.493920 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.194:52555 (local address 127.26.206.254:45657)
0808 14:50:52.494389 (+ 469us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:52.494395 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:52.495358 (+ 963us) server_negotiation.cc:407] Connection header received
0808 14:50:52.497174 (+ 1816us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:52.497178 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:52.497245 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:52.497346 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:52.498780 (+ 1434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:52.499925 (+ 1145us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:52.501710 (+ 1785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:52.502158 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:52.502300 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:52.505924 (+ 3624us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:50:52.505928 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:50:52.505932 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:50:52.505964 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:50:52.508570 (+ 2606us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:52.509279 (+ 709us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:52.509287 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:52.509293 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:52.509423 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:52.509853 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:52.509861 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:52.509864 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:52.510135 (+ 271us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:50:52.510295 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:52.510953 (+ 658us) server_negotiation.cc:299] Negotiation successful
0808 14:50:52.511178 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":343,"thread_start_us":223,"threads_started":1}
I20260808 14:50:52.512588 4838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:52.494514 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:45657 (local address 127.26.206.194:52555)
0808 14:50:52.495186 (+ 672us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:52.495229 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 14:50:52.496930 (+ 1701us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:50:52.497544 (+ 614us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:50:52.497552 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:50:52.498046 (+ 494us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:50:52.498606 (+ 560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:52.498624 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:52.500074 (+ 1450us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:52.500078 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:52.501562 (+ 1484us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:52.501579 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:52.502389 (+ 810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:52.502397 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:52.502625 (+ 228us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:52.503331 (+ 706us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:50:52.503352 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:50:52.505696 (+ 2344us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:50:52.508721 (+ 3025us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:50:52.508729 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:50:52.508745 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:50:52.509154 (+ 409us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:50:52.509539 (+ 385us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:50:52.509544 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:50:52.509547 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:50:52.509736 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:50:52.510275 (+ 539us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:50:52.510283 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:50:52.510596 (+ 313us) client_negotiation.cc:769] Sending connection context
0808 14:50:52.510862 (+ 266us) client_negotiation.cc:240] Negotiation successful
0808 14:50:52.511385 (+ 523us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":460,"thread_start_us":267,"threads_started":1}
I20260808 14:50:52.514139 4835 heartbeater.cc:347] Connected to a master server at 127.26.206.254:45657
I20260808 14:50:52.514477 4835 heartbeater.cc:464] Registering TS with master...
I20260808 14:50:52.515316 4835 heartbeater.cc:511] Master 127.26.206.254:45657 requested a full tablet report, sending...
I20260808 14:50:52.516994 4461 ts_manager.cc:194] Registered new tserver with Master: b45b627d03a949f18c0da345dea883fa (127.26.206.194:45175)
I20260808 14:50:52.518285 4461 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.206.194@KRBTEST.COM'} at 127.26.206.194:52555
WARNING: no policy specified for kudu/127.26.206.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.206.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.206.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.195.keytab.
Entry for principal kudu/127.26.206.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.195.keytab.
I20260808 14:50:52.558449 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.206.195:0
--local_ip_for_outbound_sockets=127.26.206.195
--webserver_interface=127.26.206.195
--webserver_port=0
--tserver_master_addrs=127.26.206.254:45657
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.195.keytab
--principal=kudu/127.26.206.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.206.212:41445
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:50:52.889302 4841 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:50:52.889551 4841 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:50:52.889644 4841 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:50:52.896446 4841 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:50:52.896539 4841 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:50:52.896662 4841 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.206.195
I20260808 14:50:52.905951 4841 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:41445
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.195.keytab
--principal=kudu/127.26.206.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.206.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.206.195
--webserver_port=0
--tserver_master_addrs=127.26.206.254:45657
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.206.195
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:50:52.907066 4841 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:50:52.908273 4841 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:50:52.921236 4851 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:50:52.921308 4848 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:50:52.921285 4849 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:50:52.922513 4841 server_base.cc:1034] running on GCE node
I20260808 14:50:52.923154 4841 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:50:52.924084 4841 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:50:52.925287 4841 hybrid_clock.cc:648] HybridClock initialized: now 1786200652925235 us; error 56 us; skew 500 ppm
I20260808 14:50:52.925592 4841 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:50:52 dist-test-slave-6k22 krb5kdc[4412](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200652, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:50:52.928850 4841 init.cc:377] Logged in from keytab as kudu/127.26.206.195@KRBTEST.COM (short username kudu)
I20260808 14:50:52.930239 4841 webserver.cc:460] Webserver started at http://127.26.206.195:34097/ using document root <none> and password file <none>
I20260808 14:50:52.930927 4841 fs_manager.cc:359] Metadata directory not provided
I20260808 14:50:52.931082 4841 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:50:52.931392 4841 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:50:52.934468 4841 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/minicluster-data/ts-2/data/instance:
uuid: "ff143c5a62f541bfa46f282706a9ec14"
format_stamp: "Formatted at 2026-08-08 14:50:52 on dist-test-slave-6k22"
server_key: "e768aba523a26e188500d79b0dff3269"
server_key_iv: "cfbbee996ee1b29dd82592fcfbfcb9c7"
server_key_version: "encryptionkey@0"
I20260808 14:50:52.935283 4841 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/minicluster-data/ts-2/wal/instance:
uuid: "ff143c5a62f541bfa46f282706a9ec14"
format_stamp: "Formatted at 2026-08-08 14:50:52 on dist-test-slave-6k22"
server_key: "e768aba523a26e188500d79b0dff3269"
server_key_iv: "cfbbee996ee1b29dd82592fcfbfcb9c7"
server_key_version: "encryptionkey@0"
I20260808 14:50:52.940446 4841 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.001s
I20260808 14:50:52.944231 4863 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:50:52.945570 4841 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 14:50:52.945767 4841 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/minicluster-data/ts-2/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/minicluster-data/ts-2/wal
uuid: "ff143c5a62f541bfa46f282706a9ec14"
format_stamp: "Formatted at 2026-08-08 14:50:52 on dist-test-slave-6k22"
server_key: "e768aba523a26e188500d79b0dff3269"
server_key_iv: "cfbbee996ee1b29dd82592fcfbfcb9c7"
server_key_version: "encryptionkey@0"
I20260808 14:50:52.946008 4841 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:50:52.960808 4841 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:50:52.964666 4841 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:50:52.964972 4841 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:50:52.965965 4841 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:50:52.967304 4841 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:50:52.967375 4841 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:50:52.967615 4841 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:50:52.967694 4841 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.001s
I20260808 14:50:52.990650 4679 heartbeater.cc:503] Master 127.26.206.254:45657 was elected leader, sending a full tablet report...
I20260808 14:50:53.003223 4841 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.195:44177
I20260808 14:50:53.003268 4990 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.195:44177 every 8 connection(s)
I20260808 14:50:53.004611 4841 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/minicluster-data/ts-2/data/info.pb
I20260808 14:50:53.013454 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 4841
I20260808 14:50:53.013666 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/minicluster-data/ts-2/wal/instance
I20260808 14:50:53.014189 27451 external_mini_cluster.cc:1428] Setting key cd42818f09884432af2afdb127d51843
Aug 08 14:50:53 dist-test-slave-6k22 krb5kdc[4412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200652, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.195@KRBTEST.COM for kudu/127.26.206.254@KRBTEST.COM
I20260808 14:50:53.024745 4837 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:53.007193 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.195:39277 (local address 127.26.206.254:45657)
0808 14:50:53.007389 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:53.007395 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:53.008568 (+ 1173us) server_negotiation.cc:407] Connection header received
0808 14:50:53.010394 (+ 1826us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:53.010400 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:53.010493 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:53.010604 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:53.012153 (+ 1549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:53.012898 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:53.015179 (+ 2281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:53.015731 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:53.015880 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:53.019372 (+ 3492us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:50:53.019377 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:50:53.019380 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:50:53.019413 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:50:53.021959 (+ 2546us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:53.022617 (+ 658us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:53.022621 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:53.022623 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:53.022740 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:53.023145 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:53.023148 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:53.023150 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:53.023408 (+ 258us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:50:53.023523 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:53.024319 (+ 796us) server_negotiation.cc:299] Negotiation successful
0808 14:50:53.024510 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260808 14:50:53.025739 4994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:53.007686 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:45657 (local address 127.26.206.195:39277)
0808 14:50:53.008407 (+ 721us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:53.008451 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 14:50:53.010128 (+ 1677us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:50:53.010867 (+ 739us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:50:53.010875 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:50:53.011366 (+ 491us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:50:53.011985 (+ 619us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:53.012003 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:53.013165 (+ 1162us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:53.013171 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:53.015021 (+ 1850us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:53.015034 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:53.015944 (+ 910us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:53.015949 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:53.016228 (+ 279us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:53.016944 (+ 716us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:50:53.016967 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:50:53.019191 (+ 2224us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:50:53.022085 (+ 2894us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:50:53.022091 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:50:53.022103 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:50:53.022519 (+ 416us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:50:53.022843 (+ 324us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:50:53.022847 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:50:53.022849 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:50:53.023036 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:50:53.023511 (+ 475us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:50:53.023516 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:50:53.023991 (+ 475us) client_negotiation.cc:769] Sending connection context
0808 14:50:53.024225 (+ 234us) client_negotiation.cc:240] Negotiation successful
0808 14:50:53.024665 (+ 440us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":488,"thread_start_us":273,"threads_started":1}
I20260808 14:50:53.027163 4991 heartbeater.cc:347] Connected to a master server at 127.26.206.254:45657
I20260808 14:50:53.027460 4991 heartbeater.cc:464] Registering TS with master...
I20260808 14:50:53.028261 4991 heartbeater.cc:511] Master 127.26.206.254:45657 requested a full tablet report, sending...
I20260808 14:50:53.029924 4461 ts_manager.cc:194] Registered new tserver with Master: ff143c5a62f541bfa46f282706a9ec14 (127.26.206.195:44177)
I20260808 14:50:53.030674 4461 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.206.195@KRBTEST.COM'} at 127.26.206.195:39277
I20260808 14:50:53.041963 27451 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.26.206.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.206.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.206.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/krb5kdc/oryx_127.26.206.193.keytab.
Entry for principal oryx/127.26.206.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/krb5kdc/oryx_127.26.206.193.keytab.
WARNING: no policy specified for oryx/127.26.206.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.206.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.206.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/krb5kdc/oryx_127.26.206.194.keytab.
Entry for principal oryx/127.26.206.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/krb5kdc/oryx_127.26.206.194.keytab.
WARNING: no policy specified for oryx/127.26.206.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.206.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.206.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/krb5kdc/oryx_127.26.206.195.keytab.
Entry for principal oryx/127.26.206.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/krb5kdc/oryx_127.26.206.195.keytab.
I20260808 14:50:53.190109 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 4534
Aug 08 14:50:53 dist-test-slave-6k22 krb5kdc[4412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200650, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.206.193@KRBTEST.COM
I20260808 14:50:53.206068 5005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:53.191313 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37522 (local address 127.26.206.193:44583)
0808 14:50:53.192092 (+ 779us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:53.192099 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:53.192124 (+ 25us) server_negotiation.cc:407] Connection header received
0808 14:50:53.192184 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:53.192191 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:53.192411 (+ 220us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:53.192582 (+ 171us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:53.193950 (+ 1368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:53.194962 (+ 1012us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:53.196318 (+ 1356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:53.196902 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:53.197045 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:53.201147 (+ 4102us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:50:53.201157 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:50:53.201170 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:50:53.201204 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:50:53.203839 (+ 2635us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:53.204473 (+ 634us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:53.204479 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:53.204481 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:53.204598 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:53.204894 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:53.204896 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:53.204898 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:53.205197 (+ 299us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:50:53.205444 (+ 247us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:53.205613 (+ 169us) server_negotiation.cc:299] Negotiation successful
0808 14:50:53.205800 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":595,"thread_start_us":397,"threads_started":1}
I20260808 14:50:53.207551 4671 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:50:53.291222 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 4534
I20260808 14:50:53.310729 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 4685
Aug 08 14:50:53 dist-test-slave-6k22 krb5kdc[4412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200650, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.206.194@KRBTEST.COM
I20260808 14:50:53.326534 5007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:53.311723 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57862 (local address 127.26.206.194:45175)
0808 14:50:53.312341 (+ 618us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:53.312348 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:53.312372 (+ 24us) server_negotiation.cc:407] Connection header received
0808 14:50:53.312433 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:53.312439 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:53.312654 (+ 215us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:53.312779 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:53.314069 (+ 1290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:53.315098 (+ 1029us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:53.316507 (+ 1409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:53.317040 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:53.317140 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:53.321231 (+ 4091us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:50:53.321241 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:50:53.321255 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:50:53.321298 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:50:53.324114 (+ 2816us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:53.324705 (+ 591us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:53.324712 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:53.324714 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:53.324825 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:53.325112 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:53.325115 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:53.325117 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:53.325420 (+ 303us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:50:53.325637 (+ 217us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:53.325877 (+ 240us) server_negotiation.cc:299] Negotiation successful
0808 14:50:53.326083 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":477,"thread_start_us":289,"threads_started":1}
I20260808 14:50:53.327952 4829 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:50:53.410548 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 4685
I20260808 14:50:53.430866 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 4841
Aug 08 14:50:53 dist-test-slave-6k22 krb5kdc[4412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200650, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.206.195@KRBTEST.COM
I20260808 14:50:53.447726 5009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:53.432062 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54126 (local address 127.26.206.195:44177)
0808 14:50:53.432714 (+ 652us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:53.432721 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:53.432749 (+ 28us) server_negotiation.cc:407] Connection header received
0808 14:50:53.432826 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:53.432832 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:53.433048 (+ 216us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:53.433220 (+ 172us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:53.434612 (+ 1392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:53.435682 (+ 1070us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:53.436891 (+ 1209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:53.437446 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:53.437592 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:53.442195 (+ 4603us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:50:53.442207 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:50:53.442222 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:50:53.442267 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:50:53.445132 (+ 2865us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:53.445785 (+ 653us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:53.445791 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:53.445793 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:53.445915 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:53.446223 (+ 308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:53.446226 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:53.446228 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:53.446605 (+ 377us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:50:53.446827 (+ 222us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:53.447112 (+ 285us) server_negotiation.cc:299] Negotiation successful
0808 14:50:53.447319 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":517,"thread_start_us":353,"threads_started":1}
I20260808 14:50:53.449048 4985 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:50:53.531963 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 4841
I20260808 14:50:53.551668 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 4426
I20260808 14:50:53.552958 4495 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:50:53.657928 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 4426
I20260808 14:50:53.682365 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.206.254:45657
--webserver_interface=127.26.206.254
--webserver_port=35749
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.254.keytab
--principal=kudu/127.26.206.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.206.212:41445
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.206.254:45657
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:50:54.014213 5012 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:50:54.014503 5012 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:50:54.014668 5012 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:50:54.021703 5012 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:50:54.021798 5012 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:50:54.021904 5012 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:50:54.022022 5012 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:50:54.022104 5012 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:50:54.031638 5012 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:41445
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.206.254:45657
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.254.keytab
--principal=kudu/127.26.206.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.206.254:45657
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.206.254
--webserver_port=35749
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:50:54.032897 5012 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:50:54.034168 5012 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:50:54.045877 5017 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:50:54.045835 5018 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:50:54.045809 5021 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:50:54.046932 5012 server_base.cc:1034] running on GCE node
I20260808 14:50:54.047780 5012 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:50:54.049052 5012 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:50:54.050262 5012 hybrid_clock.cc:648] HybridClock initialized: now 1786200654050204 us; error 38 us; skew 500 ppm
I20260808 14:50:54.050608 5012 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:50:54 dist-test-slave-6k22 krb5kdc[4412](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200654, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:50:54.053676 5012 init.cc:377] Logged in from keytab as kudu/127.26.206.254@KRBTEST.COM (short username kudu)
I20260808 14:50:54.055127 5012 webserver.cc:460] Webserver started at http://127.26.206.254:35749/ using document root <none> and password file <none>
I20260808 14:50:54.055825 5012 fs_manager.cc:359] Metadata directory not provided
I20260808 14:50:54.055941 5012 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:50:54.061388 5012 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.001s sys 0.004s
I20260808 14:50:54.064060 5029 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:50:54.065310 5012 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.001s
I20260808 14:50:54.065486 5012 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/minicluster-data/master-0/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/minicluster-data/master-0/wal
uuid: "001d82ebe4b046b082a9b60276d9412a"
format_stamp: "Formatted at 2026-08-08 14:50:51 on dist-test-slave-6k22"
server_key: "5e1f324aacfa2163c5e7ff7d806912a6"
server_key_iv: "1302f8ccd27d2533bdf40e17d5493343"
server_key_version: "encryptionkey@0"
I20260808 14:50:54.066454 5012 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:50:54.080893 5012 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:50:54.084676 5012 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:50:54.084949 5012 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:50:54.103613 5012 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.254:45657
I20260808 14:50:54.103638 5087 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.254:45657 every 8 connection(s)
I20260808 14:50:54.105041 5012 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
I20260808 14:50:54.107741 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 5012
I20260808 14:50:54.108507 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.206.193:44583
--local_ip_for_outbound_sockets=127.26.206.193
--tserver_master_addrs=127.26.206.254:45657
--webserver_port=43749
--webserver_interface=127.26.206.193
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.193.keytab
--principal=kudu/127.26.206.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.206.212:41445
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.26.206.193
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/krb5kdc/oryx_127.26.206.193.keytab with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 14:50:54.111748 5089 sys_catalog.cc:263] Verifying existing consensus state
I20260808 14:50:54.114830 5089 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 001d82ebe4b046b082a9b60276d9412a: Bootstrap starting.
I20260808 14:50:54.133289 5089 log.cc:824] T 00000000000000000000000000000000 P 001d82ebe4b046b082a9b60276d9412a: Log is configured to *not* fsync() on all Append() calls
I20260808 14:50:54.141677 5089 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 001d82ebe4b046b082a9b60276d9412a: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 14:50:54.142226 5089 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 001d82ebe4b046b082a9b60276d9412a: Bootstrap complete.
I20260808 14:50:54.151340 5089 raft_consensus.cc:348] T 00000000000000000000000000000000 P 001d82ebe4b046b082a9b60276d9412a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "001d82ebe4b046b082a9b60276d9412a" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 45657 } }
I20260808 14:50:54.152222 5089 raft_consensus.cc:729] T 00000000000000000000000000000000 P 001d82ebe4b046b082a9b60276d9412a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 001d82ebe4b046b082a9b60276d9412a, State: Initialized, Role: FOLLOWER
I20260808 14:50:54.152801 5089 consensus_queue.cc:260] T 00000000000000000000000000000000 P 001d82ebe4b046b082a9b60276d9412a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "001d82ebe4b046b082a9b60276d9412a" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 45657 } }
I20260808 14:50:54.153038 5089 raft_consensus.cc:388] T 00000000000000000000000000000000 P 001d82ebe4b046b082a9b60276d9412a [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:50:54.153173 5089 raft_consensus.cc:482] T 00000000000000000000000000000000 P 001d82ebe4b046b082a9b60276d9412a [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:50:54.153371 5089 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 001d82ebe4b046b082a9b60276d9412a [term 1 FOLLOWER]: Advancing to term 2
I20260808 14:50:54.156994 5089 raft_consensus.cc:504] T 00000000000000000000000000000000 P 001d82ebe4b046b082a9b60276d9412a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "001d82ebe4b046b082a9b60276d9412a" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 45657 } }
I20260808 14:50:54.157471 5089 leader_election.cc:302] T 00000000000000000000000000000000 P 001d82ebe4b046b082a9b60276d9412a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 001d82ebe4b046b082a9b60276d9412a; no voters:
I20260808 14:50:54.158159 5089 leader_election.cc:288] T 00000000000000000000000000000000 P 001d82ebe4b046b082a9b60276d9412a [CANDIDATE]: Term 2 election: Requested vote from peers
I20260808 14:50:54.158298 5096 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 001d82ebe4b046b082a9b60276d9412a [term 2 FOLLOWER]: Leader election won for term 2
I20260808 14:50:54.159548 5096 raft_consensus.cc:686] T 00000000000000000000000000000000 P 001d82ebe4b046b082a9b60276d9412a [term 2 LEADER]: Becoming Leader. State: Replica: 001d82ebe4b046b082a9b60276d9412a, State: Running, Role: LEADER
I20260808 14:50:54.160229 5096 consensus_queue.cc:237] T 00000000000000000000000000000000 P 001d82ebe4b046b082a9b60276d9412a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "001d82ebe4b046b082a9b60276d9412a" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 45657 } }
I20260808 14:50:54.160463 5089 sys_catalog.cc:564] T 00000000000000000000000000000000 P 001d82ebe4b046b082a9b60276d9412a [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:50:54.162835 5099 sys_catalog.cc:455] T 00000000000000000000000000000000 P 001d82ebe4b046b082a9b60276d9412a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 001d82ebe4b046b082a9b60276d9412a. Latest consensus state: current_term: 2 leader_uuid: "001d82ebe4b046b082a9b60276d9412a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "001d82ebe4b046b082a9b60276d9412a" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 45657 } } }
I20260808 14:50:54.163285 5099 sys_catalog.cc:458] T 00000000000000000000000000000000 P 001d82ebe4b046b082a9b60276d9412a [sys.catalog]: This master's current role is: LEADER
I20260808 14:50:54.163867 5098 sys_catalog.cc:455] T 00000000000000000000000000000000 P 001d82ebe4b046b082a9b60276d9412a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "001d82ebe4b046b082a9b60276d9412a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "001d82ebe4b046b082a9b60276d9412a" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 45657 } } }
I20260808 14:50:54.164248 5098 sys_catalog.cc:458] T 00000000000000000000000000000000 P 001d82ebe4b046b082a9b60276d9412a [sys.catalog]: This master's current role is: LEADER
I20260808 14:50:54.179518 5103 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:50:54.188434 5103 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:50:54.190259 5103 catalog_manager.cc:1259] Loaded cluster ID: 61a5eeea72764435861e9951d2ff4494
I20260808 14:50:54.190464 5103 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:50:54.195487 5103 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:50:54.197328 5103 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 001d82ebe4b046b082a9b60276d9412a: Loaded TSK: 0
I20260808 14:50:54.199203 5103 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 14:50:54.477031 5093 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:50:54.477415 5093 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:50:54.477589 5093 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:50:54.485050 5093 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:50:54.485201 5093 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:50:54.485388 5093 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.206.193
I20260808 14:50:54.495138 5093 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:41445
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/krb5kdc/oryx_127.26.206.193.keytab
--principal=oryx/127.26.206.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.206.193:44583
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.206.193
--webserver_port=43749
--tserver_master_addrs=127.26.206.254:45657
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.206.193
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:50:54.496544 5093 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:50:54.497892 5093 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:50:54.511170 5124 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:50:54.511831 5122 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:50:54.511855 5126 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:50:54.512370 5093 server_base.cc:1034] running on GCE node
I20260808 14:50:54.512960 5093 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:50:54.513973 5093 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:50:54.515187 5093 hybrid_clock.cc:648] HybridClock initialized: now 1786200654515146 us; error 36 us; skew 500 ppm
I20260808 14:50:54.515499 5093 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:50:54 dist-test-slave-6k22 krb5kdc[4412](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200654, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.206.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:50:54.518716 5093 init.cc:377] Logged in from keytab as oryx/127.26.206.193@KRBTEST.COM (short username oryx)
I20260808 14:50:54.520298 5093 webserver.cc:460] Webserver started at http://127.26.206.193:43749/ using document root <none> and password file <none>
I20260808 14:50:54.520998 5093 fs_manager.cc:359] Metadata directory not provided
I20260808 14:50:54.521176 5093 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:50:54.526739 5093 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 14:50:54.529719 5133 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:50:54.531258 5093 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 14:50:54.531435 5093 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/minicluster-data/ts-0/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/minicluster-data/ts-0/wal
uuid: "ce877a0dc2d347f4be1ad758cf49f199"
format_stamp: "Formatted at 2026-08-08 14:50:51 on dist-test-slave-6k22"
server_key: "a3a71ddda2585be63891bee68df3aaf0"
server_key_iv: "92c0e0cc89e75b9673e18d168303d9d5"
server_key_version: "encryptionkey@0"
I20260808 14:50:54.532528 5093 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:50:54.571594 5093 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:50:54.575663 5093 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:50:54.575951 5093 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:50:54.576967 5093 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:50:54.578485 5093 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:50:54.578625 5093 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:50:54.578749 5093 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:50:54.578850 5093 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:50:54.612665 5093 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.193:44583
I20260808 14:50:54.612754 5262 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.193:44583 every 8 connection(s)
I20260808 14:50:54.614114 5093 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/minicluster-data/ts-0/data/info.pb
I20260808 14:50:54.621063 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 5093
I20260808 14:50:54.621831 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.206.194:45175
--local_ip_for_outbound_sockets=127.26.206.194
--tserver_master_addrs=127.26.206.254:45657
--webserver_port=33141
--webserver_interface=127.26.206.194
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.194.keytab
--principal=kudu/127.26.206.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.206.212:41445
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.26.206.194
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/krb5kdc/oryx_127.26.206.194.keytab with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 14:50:54 dist-test-slave-6k22 krb5kdc[4412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.206.193@KRBTEST.COM for oryx/127.26.206.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:50:54 dist-test-slave-6k22 krb5kdc[4412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.206.193@KRBTEST.COM for oryx/127.26.206.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:50:54.634117 5267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:54.617196 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:45657 (local address 127.26.206.193:40891)
0808 14:50:54.618016 (+ 820us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:54.618061 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 14:50:54.619809 (+ 1748us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:50:54.621158 (+ 1349us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:50:54.621170 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:50:54.621950 (+ 780us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:50:54.622716 (+ 766us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:54.622741 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:54.624405 (+ 1664us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:54.624413 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:54.626437 (+ 2024us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:54.626454 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:54.627514 (+ 1060us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:54.627523 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:54.627861 (+ 338us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:54.628564 (+ 703us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:50:54.628596 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:50:54.632753 (+ 4157us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.206.254:45657: Server oryx/127.26.206.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":539,"thread_start_us":344,"threads_started":1}
W20260808 14:50:54.634846 5264 heartbeater.cc:644] Failed to heartbeat to 127.26.206.254:45657 (0 consecutive failures): Not authorized: Failed to ping master at 127.26.206.254:45657: Client connection negotiation failed: client connection to 127.26.206.254:45657: Server oryx/127.26.206.254@KRBTEST.COM not found in Kerberos database
W20260808 14:50:54.636340 5266 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:50:54.617131 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.193:40891 (local address 127.26.206.254:45657)
0808 14:50:54.617850 (+ 719us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:54.617861 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:54.618192 (+ 331us) server_negotiation.cc:407] Connection header received
0808 14:50:54.620296 (+ 2104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:54.620308 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:54.620634 (+ 326us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:54.620926 (+ 292us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:54.622950 (+ 2024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:54.624238 (+ 1288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:54.626659 (+ 2421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:54.627288 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:54.627418 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:54.634969 (+ 7551us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.206.193:40891: BlockingRecv error: recv got EOF from 127.26.206.193:40891 (error 108)
Metrics: {"server-negotiator.queue_time_us":495,"thread_start_us":277,"threads_started":1}
Aug 08 14:50:54 dist-test-slave-6k22 krb5kdc[4412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.206.193@KRBTEST.COM for oryx/127.26.206.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:50:54 dist-test-slave-6k22 krb5kdc[4412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.206.193@KRBTEST.COM for oryx/127.26.206.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:50:54.644475 5267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:54.635497 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:45657 (local address 127.26.206.193:49593)
0808 14:50:54.635797 (+ 300us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:54.635816 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 14:50:54.635913 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:50:54.636749 (+ 836us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:50:54.636753 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:50:54.637138 (+ 385us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:50:54.637272 (+ 134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:54.637281 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:54.638367 (+ 1086us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:54.638374 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:54.639272 (+ 898us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:54.639284 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:54.640049 (+ 765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:54.640054 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:54.640240 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:54.640905 (+ 665us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:50:54.640930 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:50:54.644171 (+ 3241us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.206.254:45657: Server oryx/127.26.206.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":159}
W20260808 14:50:54.644882 5269 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:50:54.635669 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.193:49593 (local address 127.26.206.254:45657)
0808 14:50:54.636390 (+ 721us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:54.636396 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:54.636419 (+ 23us) server_negotiation.cc:407] Connection header received
0808 14:50:54.636471 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:54.636475 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:54.636545 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:54.636800 (+ 255us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:54.637447 (+ 647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:54.638209 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:54.639423 (+ 1214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:54.639899 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:54.640024 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:54.644432 (+ 4408us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.206.193:49593: BlockingRecv error: recv got EOF from 127.26.206.193:49593 (error 108)
Metrics: {"server-negotiator.queue_time_us":542,"thread_start_us":421,"threads_started":1}
Aug 08 14:50:54 dist-test-slave-6k22 krb5kdc[4412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.206.193@KRBTEST.COM for oryx/127.26.206.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:50:54 dist-test-slave-6k22 krb5kdc[4412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.206.193@KRBTEST.COM for oryx/127.26.206.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:50:54.653716 5267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:54.645307 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:45657 (local address 127.26.206.193:39373)
0808 14:50:54.645484 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:54.645504 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 14:50:54.645602 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:50:54.646030 (+ 428us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:50:54.646033 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:50:54.646313 (+ 280us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:50:54.646453 (+ 140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:54.646461 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:54.648035 (+ 1574us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:54.648038 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:54.648936 (+ 898us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:54.648946 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:54.650037 (+ 1091us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:54.650041 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:54.650178 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:54.650778 (+ 600us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:50:54.650796 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:50:54.653518 (+ 2722us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.206.254:45657: Server oryx/127.26.206.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":59}
W20260808 14:50:54.653975 5269 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:50:54.645508 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.193:39373 (local address 127.26.206.254:45657)
0808 14:50:54.645702 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:54.645709 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:54.645730 (+ 21us) server_negotiation.cc:407] Connection header received
0808 14:50:54.645786 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:54.645793 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:54.645877 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:54.645990 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:54.646596 (+ 606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:54.647897 (+ 1301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:54.649075 (+ 1178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:54.649880 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:54.650027 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:54.653746 (+ 3719us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.206.193:39373: BlockingRecv error: recv got EOF from 127.26.206.193:39373 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
W20260808 14:50:54.654115 5264 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 14:50:54.955929 5268 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:50:54.956243 5268 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:50:54.956409 5268 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:50:54.963596 5268 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:50:54.963724 5268 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:50:54.963927 5268 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.206.194
I20260808 14:50:54.973548 5268 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:41445
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/krb5kdc/oryx_127.26.206.194.keytab
--principal=oryx/127.26.206.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.206.194:45175
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.206.194
--webserver_port=33141
--tserver_master_addrs=127.26.206.254:45657
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.206.194
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:50:54.974813 5268 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:50:54.976094 5268 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:50:54.988988 5275 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:50:54.989122 5274 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:50:54.989269 5278 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:50:54.990273 5268 server_base.cc:1034] running on GCE node
I20260808 14:50:54.990799 5268 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:50:54.991681 5268 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:50:54.992877 5268 hybrid_clock.cc:648] HybridClock initialized: now 1786200654992835 us; error 40 us; skew 500 ppm
I20260808 14:50:54.993136 5268 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:50:54 dist-test-slave-6k22 krb5kdc[4412](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200654, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.206.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:50:54.996289 5268 init.cc:377] Logged in from keytab as oryx/127.26.206.194@KRBTEST.COM (short username oryx)
I20260808 14:50:54.997673 5268 webserver.cc:460] Webserver started at http://127.26.206.194:33141/ using document root <none> and password file <none>
I20260808 14:50:54.998335 5268 fs_manager.cc:359] Metadata directory not provided
I20260808 14:50:54.998467 5268 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:50:55.003504 5268 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260808 14:50:55.006142 5285 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:50:55.007421 5268 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 14:50:55.007596 5268 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/minicluster-data/ts-1/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/minicluster-data/ts-1/wal
uuid: "b45b627d03a949f18c0da345dea883fa"
format_stamp: "Formatted at 2026-08-08 14:50:52 on dist-test-slave-6k22"
server_key: "f25cbc6d7ddc61a64abaefb98da75822"
server_key_iv: "28e1409920f52ab25ae5c034b1a484c0"
server_key_version: "encryptionkey@0"
I20260808 14:50:55.008513 5268 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:50:55.026976 5268 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:50:55.031036 5268 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:50:55.031260 5268 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:50:55.032101 5268 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:50:55.033262 5268 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:50:55.033352 5268 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:50:55.033432 5268 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:50:55.033485 5268 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:50:55.068158 5268 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.194:45175
I20260808 14:50:55.068260 5417 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.194:45175 every 8 connection(s)
I20260808 14:50:55.069626 5268 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/minicluster-data/ts-1/data/info.pb
I20260808 14:50:55.071846 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 5268
I20260808 14:50:55.072516 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.206.195:44177
--local_ip_for_outbound_sockets=127.26.206.195
--tserver_master_addrs=127.26.206.254:45657
--webserver_port=34097
--webserver_interface=127.26.206.195
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.195.keytab
--principal=kudu/127.26.206.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.206.212:41445
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.26.206.195
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/krb5kdc/oryx_127.26.206.195.keytab with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 14:50:55 dist-test-slave-6k22 krb5kdc[4412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.206.194@KRBTEST.COM for oryx/127.26.206.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:50:55 dist-test-slave-6k22 krb5kdc[4412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.206.194@KRBTEST.COM for oryx/127.26.206.254@KRBTEST.COM, Server not found in Kerberos database
W20260808 14:50:55.086752 5269 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:50:55.072515 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.194:53147 (local address 127.26.206.254:45657)
0808 14:50:55.072763 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:55.072771 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:55.074126 (+ 1355us) server_negotiation.cc:407] Connection header received
0808 14:50:55.076103 (+ 1977us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:55.076111 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:55.076202 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:55.076320 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:55.077847 (+ 1527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:55.079028 (+ 1181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:55.080612 (+ 1584us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:55.081353 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:55.081489 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:55.086477 (+ 4988us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.206.194:53147: BlockingRecv error: recv got EOF from 127.26.206.194:53147 (error 108)
Metrics: {"server-negotiator.queue_time_us":75}
I20260808 14:50:55.087419 5421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:55.073065 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:45657 (local address 127.26.206.194:53147)
0808 14:50:55.073935 (+ 870us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:55.073987 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0808 14:50:55.075841 (+ 1854us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:50:55.076521 (+ 680us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:50:55.076530 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:50:55.077071 (+ 541us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:50:55.077617 (+ 546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:55.077634 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:55.079182 (+ 1548us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:55.079186 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:55.080467 (+ 1281us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:55.080479 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:55.081566 (+ 1087us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:55.081571 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:55.081764 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:55.082436 (+ 672us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:50:55.082462 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:50:55.086302 (+ 3840us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.206.254:45657: Server oryx/127.26.206.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":594,"thread_start_us":409,"threads_started":1}
W20260808 14:50:55.088088 5418 heartbeater.cc:644] Failed to heartbeat to 127.26.206.254:45657 (0 consecutive failures): Not authorized: Failed to ping master at 127.26.206.254:45657: Client connection negotiation failed: client connection to 127.26.206.254:45657: Server oryx/127.26.206.254@KRBTEST.COM not found in Kerberos database
Aug 08 14:50:55 dist-test-slave-6k22 krb5kdc[4412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.206.194@KRBTEST.COM for oryx/127.26.206.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:50:55 dist-test-slave-6k22 krb5kdc[4412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.206.194@KRBTEST.COM for oryx/127.26.206.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:50:55.096328 5421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:55.088681 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:45657 (local address 127.26.206.194:36115)
0808 14:50:55.088982 (+ 301us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:55.088997 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 14:50:55.089122 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:50:55.089435 (+ 313us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:50:55.089441 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:50:55.089758 (+ 317us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:50:55.089892 (+ 134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:55.089900 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:55.090855 (+ 955us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:55.090861 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:55.091810 (+ 949us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:55.091821 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:55.092513 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:55.092519 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:55.092680 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:55.093262 (+ 582us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:50:55.093279 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:50:55.096054 (+ 2775us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.206.254:45657: Server oryx/127.26.206.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":58}
W20260808 14:50:55.096499 5269 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:50:55.088776 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.194:36115 (local address 127.26.206.254:45657)
0808 14:50:55.088908 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:55.088912 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:55.089066 (+ 154us) server_negotiation.cc:407] Connection header received
0808 14:50:55.089233 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:55.089238 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:55.089312 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:55.089417 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:55.090039 (+ 622us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:55.090717 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:55.091951 (+ 1234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:55.092365 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:55.092492 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:55.096249 (+ 3757us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.206.194:36115: BlockingRecv error: recv got EOF from 127.26.206.194:36115 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
Aug 08 14:50:55 dist-test-slave-6k22 krb5kdc[4412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.206.194@KRBTEST.COM for oryx/127.26.206.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:50:55 dist-test-slave-6k22 krb5kdc[4412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.206.194@KRBTEST.COM for oryx/127.26.206.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:50:55.104599 5421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:55.097233 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:45657 (local address 127.26.206.194:39821)
0808 14:50:55.097391 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:55.097411 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 14:50:55.097506 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:50:55.097831 (+ 325us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:50:55.097836 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:50:55.098113 (+ 277us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:50:55.098246 (+ 133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:55.098254 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:55.099198 (+ 944us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:55.099205 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:55.100155 (+ 950us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:55.100166 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:55.100853 (+ 687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:55.100859 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:55.101041 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:55.101591 (+ 550us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:50:55.101607 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:50:55.104314 (+ 2707us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.206.254:45657: Server oryx/127.26.206.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":41}
W20260808 14:50:55.104773 5269 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:50:55.097314 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.194:39821 (local address 127.26.206.254:45657)
0808 14:50:55.097469 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:55.097474 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:55.097491 (+ 17us) server_negotiation.cc:407] Connection header received
0808 14:50:55.097627 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:55.097632 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:55.097700 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:55.097799 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:55.098385 (+ 586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:55.099065 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:55.100298 (+ 1233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:55.100705 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:55.100842 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:55.104510 (+ 3668us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.206.194:39821: BlockingRecv error: recv got EOF from 127.26.206.194:39821 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
W20260808 14:50:55.107798 5418 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 14:50:55.405258 5422 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:50:55.405514 5422 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:50:55.405673 5422 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:50:55.412654 5422 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:50:55.412779 5422 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:50:55.412971 5422 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.206.195
I20260808 14:50:55.422086 5422 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:41445
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/krb5kdc/oryx_127.26.206.195.keytab
--principal=oryx/127.26.206.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.206.195:44177
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.206.195
--webserver_port=34097
--tserver_master_addrs=127.26.206.254:45657
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.206.195
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:50:55.423300 5422 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:50:55.424588 5422 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:50:55.439448 5430 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:50:55.439524 5429 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:50:55.439502 5432 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:50:55.445230 5422 server_base.cc:1034] running on GCE node
I20260808 14:50:55.445835 5422 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:50:55.446732 5422 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:50:55.447989 5422 hybrid_clock.cc:648] HybridClock initialized: now 1786200655447934 us; error 56 us; skew 500 ppm
I20260808 14:50:55.448413 5422 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:50:55 dist-test-slave-6k22 krb5kdc[4412](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200655, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.206.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:50:55.452030 5422 init.cc:377] Logged in from keytab as oryx/127.26.206.195@KRBTEST.COM (short username oryx)
I20260808 14:50:55.453501 5422 webserver.cc:460] Webserver started at http://127.26.206.195:34097/ using document root <none> and password file <none>
I20260808 14:50:55.454248 5422 fs_manager.cc:359] Metadata directory not provided
I20260808 14:50:55.454372 5422 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:50:55.460132 5422 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.001s
I20260808 14:50:55.463032 5441 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:50:55.464484 5422 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 14:50:55.464676 5422 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/minicluster-data/ts-2/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/minicluster-data/ts-2/wal
uuid: "ff143c5a62f541bfa46f282706a9ec14"
format_stamp: "Formatted at 2026-08-08 14:50:52 on dist-test-slave-6k22"
server_key: "e768aba523a26e188500d79b0dff3269"
server_key_iv: "cfbbee996ee1b29dd82592fcfbfcb9c7"
server_key_version: "encryptionkey@0"
I20260808 14:50:55.465726 5422 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:50:55.489492 5422 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:50:55.493848 5422 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:50:55.494138 5422 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:50:55.495910 5422 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:50:55.497339 5422 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:50:55.497457 5422 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:50:55.497597 5422 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:50:55.497704 5422 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:50:55.533075 5422 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.195:44177
I20260808 14:50:55.533165 5574 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.195:44177 every 8 connection(s)
I20260808 14:50:55.534590 5422 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200577490656-27451-0/minicluster-data/ts-2/data/info.pb
I20260808 14:50:55.540972 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 5422
Aug 08 14:50:55 dist-test-slave-6k22 krb5kdc[4412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.206.195@KRBTEST.COM for oryx/127.26.206.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:50:55 dist-test-slave-6k22 krb5kdc[4412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.206.195@KRBTEST.COM for oryx/127.26.206.254@KRBTEST.COM, Server not found in Kerberos database
W20260808 14:50:55.552479 5269 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:50:55.537248 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.195:43477 (local address 127.26.206.254:45657)
0808 14:50:55.537468 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:55.537474 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:55.538652 (+ 1178us) server_negotiation.cc:407] Connection header received
0808 14:50:55.540776 (+ 2124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:55.540782 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:55.540884 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:55.541024 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:55.543193 (+ 2169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:55.544121 (+ 928us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:55.545804 (+ 1683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:55.546280 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:55.546434 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:55.552204 (+ 5770us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.206.195:43477: BlockingRecv error: recv got EOF from 127.26.206.195:43477 (error 108)
Metrics: {"server-negotiator.queue_time_us":78}
I20260808 14:50:55.553061 5577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:55.537716 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:45657 (local address 127.26.206.195:43477)
0808 14:50:55.538469 (+ 753us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:55.538522 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0808 14:50:55.540486 (+ 1964us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:50:55.541288 (+ 802us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:50:55.541296 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:50:55.542220 (+ 924us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:50:55.543007 (+ 787us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:55.543026 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:55.544288 (+ 1262us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:55.544298 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:55.545630 (+ 1332us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:55.545643 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:55.546554 (+ 911us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:55.546562 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:55.546792 (+ 230us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:55.547595 (+ 803us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:50:55.547637 (+ 42us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:50:55.551936 (+ 4299us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.206.254:45657: Server oryx/127.26.206.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":494,"thread_start_us":282,"threads_started":1}
W20260808 14:50:55.553754 5575 heartbeater.cc:644] Failed to heartbeat to 127.26.206.254:45657 (0 consecutive failures): Not authorized: Failed to ping master at 127.26.206.254:45657: Client connection negotiation failed: client connection to 127.26.206.254:45657: Server oryx/127.26.206.254@KRBTEST.COM not found in Kerberos database
I20260808 14:50:55.557593 5579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:55.542021 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34474 (local address 127.26.206.254:45657)
0808 14:50:55.542503 (+ 482us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:55.542510 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:55.542862 (+ 352us) server_negotiation.cc:407] Connection header received
0808 14:50:55.543062 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:55.543066 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:55.543121 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:55.543234 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:55.544846 (+ 1612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:55.545533 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:55.546775 (+ 1242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:55.547283 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:55.547418 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:55.550699 (+ 3281us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:50:55.550707 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:50:55.550723 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:50:55.550767 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:50:55.554143 (+ 3376us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:55.555014 (+ 871us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:55.555022 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:55.555030 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:55.555211 (+ 181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:50:55.555647 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:50:55.555651 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:50:55.555655 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:50:55.556277 (+ 622us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:50:55.556573 (+ 296us) server_negotiation.cc:1035] Waiting for connection context
0808 14:50:55.556981 (+ 408us) server_negotiation.cc:299] Negotiation successful
0808 14:50:55.557315 (+ 334us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":358,"thread_start_us":258,"threads_started":1}
Aug 08 14:50:55 dist-test-slave-6k22 krb5kdc[4412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.206.195@KRBTEST.COM for oryx/127.26.206.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:50:55 dist-test-slave-6k22 krb5kdc[4412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.206.195@KRBTEST.COM for oryx/127.26.206.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:50:55.562734 5577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:55.554354 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:45657 (local address 127.26.206.195:33791)
0808 14:50:55.554554 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:55.554574 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 14:50:55.554684 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:50:55.554990 (+ 306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:50:55.554997 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:50:55.555319 (+ 322us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:50:55.555506 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:55.555516 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:55.556941 (+ 1425us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:55.557035 (+ 94us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:55.558154 (+ 1119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:55.558165 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:55.559005 (+ 840us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:55.559011 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:55.559176 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:55.559721 (+ 545us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:50:55.559751 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:50:55.562549 (+ 2798us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.206.254:45657: Server oryx/127.26.206.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":65}
W20260808 14:50:55.563124 5269 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:50:55.554404 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.195:33791 (local address 127.26.206.254:45657)
0808 14:50:55.554555 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:55.554568 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:55.554623 (+ 55us) server_negotiation.cc:407] Connection header received
0808 14:50:55.554800 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:55.554803 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:55.554854 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:55.554928 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:55.555706 (+ 778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:55.556790 (+ 1084us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:55.558294 (+ 1504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:55.558855 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:55.558949 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:55.562711 (+ 3762us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.206.195:33791: BlockingRecv error: recv got EOF from 127.26.206.195:33791 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
Aug 08 14:50:55 dist-test-slave-6k22 krb5kdc[4412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.206.195@KRBTEST.COM for oryx/127.26.206.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:50:55 dist-test-slave-6k22 krb5kdc[4412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.206.195@KRBTEST.COM for oryx/127.26.206.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:50:55.570151 5577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:55.563351 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:45657 (local address 127.26.206.195:40325)
0808 14:50:55.563501 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:55.563521 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 14:50:55.563649 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:50:55.564114 (+ 465us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:50:55.564117 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:50:55.564361 (+ 244us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:50:55.564490 (+ 129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:55.564497 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:55.565351 (+ 854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:55.565354 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:55.566209 (+ 855us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:55.566218 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:55.566832 (+ 614us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:55.566835 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:55.566948 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:55.567405 (+ 457us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:50:55.567420 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:50:55.569963 (+ 2543us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.206.254:45657: Server oryx/127.26.206.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":46}
W20260808 14:50:55.570413 5269 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:50:55.563677 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.195:40325 (local address 127.26.206.254:45657)
0808 14:50:55.563902 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:55.563906 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:55.563920 (+ 14us) server_negotiation.cc:407] Connection header received
0808 14:50:55.563955 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:55.563958 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:55.564005 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:55.564081 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:55.564603 (+ 522us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:55.565234 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:55.566321 (+ 1087us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:55.566716 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:55.566803 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:55.570127 (+ 3324us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.206.195:40325: BlockingRecv error: recv got EOF from 127.26.206.195:40325 (error 108)
Metrics: {"server-negotiator.queue_time_us":115}
W20260808 14:50:55.570470 5575 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 08 14:50:55 dist-test-slave-6k22 krb5kdc[4412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.206.193@KRBTEST.COM for oryx/127.26.206.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:50:55 dist-test-slave-6k22 krb5kdc[4412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.206.193@KRBTEST.COM for oryx/127.26.206.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:50:55.663861 5581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:55.654678 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:45657 (local address 127.26.206.193:32863)
0808 14:50:55.655240 (+ 562us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:55.655269 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0808 14:50:55.655390 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:50:55.655757 (+ 367us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:50:55.655760 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:50:55.656304 (+ 544us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:50:55.656604 (+ 300us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:55.656616 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:55.658126 (+ 1510us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:55.658129 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:55.659112 (+ 983us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:55.659122 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:55.659856 (+ 734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:55.659860 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:55.659980 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:55.660601 (+ 621us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:50:55.660618 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:50:55.663497 (+ 2879us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.206.254:45657: Server oryx/127.26.206.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":442,"thread_start_us":323,"threads_started":1}
W20260808 14:50:55.663998 5269 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:50:55.654928 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.193:32863 (local address 127.26.206.254:45657)
0808 14:50:55.655140 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:55.655148 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:55.655336 (+ 188us) server_negotiation.cc:407] Connection header received
0808 14:50:55.655504 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:55.655510 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:55.655617 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:55.655722 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:55.656792 (+ 1070us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:55.657976 (+ 1184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:55.659233 (+ 1257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:55.659707 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:55.659811 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:55.663726 (+ 3915us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.206.193:32863: BlockingRecv error: recv got EOF from 127.26.206.193:32863 (error 108)
Metrics: {"server-negotiator.queue_time_us":83}
Aug 08 14:50:56 dist-test-slave-6k22 krb5kdc[4412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.206.194@KRBTEST.COM for oryx/127.26.206.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:50:56 dist-test-slave-6k22 krb5kdc[4412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.206.194@KRBTEST.COM for oryx/127.26.206.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:50:56.116829 5582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:56.108491 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:45657 (local address 127.26.206.194:54741)
0808 14:50:56.108991 (+ 500us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:56.109011 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 14:50:56.109164 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:50:56.109496 (+ 332us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:50:56.109500 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:50:56.109945 (+ 445us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:50:56.110139 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:56.110148 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:56.111105 (+ 957us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:56.111108 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:56.112287 (+ 1179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:56.112300 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:56.112933 (+ 633us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:56.112938 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:56.113051 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:56.113647 (+ 596us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:50:56.113664 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:50:56.116591 (+ 2927us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.206.254:45657: Server oryx/127.26.206.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":376,"thread_start_us":251,"threads_started":1}
W20260808 14:50:56.117038 5269 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:50:56.108532 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.194:54741 (local address 127.26.206.254:45657)
0808 14:50:56.108759 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:56.108765 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:56.109121 (+ 356us) server_negotiation.cc:407] Connection header received
0808 14:50:56.109275 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:56.109281 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:56.109343 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:56.109422 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:56.110281 (+ 859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:56.110983 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:56.112419 (+ 1436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:56.112786 (+ 367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:56.112877 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:56.116802 (+ 3925us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.206.194:54741: BlockingRecv error: recv got EOF from 127.26.206.194:54741 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
Aug 08 14:50:56 dist-test-slave-6k22 krb5kdc[4412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.206.195@KRBTEST.COM for oryx/127.26.206.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:50:56 dist-test-slave-6k22 krb5kdc[4412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.206.195@KRBTEST.COM for oryx/127.26.206.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:50:56.585592 5583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:56.571069 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:45657 (local address 127.26.206.195:45581)
0808 14:50:56.571538 (+ 469us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:56.571573 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0808 14:50:56.571686 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:50:56.572044 (+ 358us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:50:56.572048 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:50:56.572496 (+ 448us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:50:56.572691 (+ 195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:56.572699 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:56.573855 (+ 1156us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:56.573863 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:56.574980 (+ 1117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:56.574994 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:56.575853 (+ 859us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:56.575858 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:56.575987 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:56.582298 (+ 6311us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:50:56.582319 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:50:56.585236 (+ 2917us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.206.254:45657: Server oryx/127.26.206.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":362,"thread_start_us":253,"threads_started":1}
W20260808 14:50:56.585776 5269 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:50:56.571120 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.195:45581 (local address 127.26.206.254:45657)
0808 14:50:56.571343 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:56.571349 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:56.571634 (+ 285us) server_negotiation.cc:407] Connection header received
0808 14:50:56.571797 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:56.571801 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:56.571863 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:56.571995 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:56.572821 (+ 826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:56.573591 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:56.575115 (+ 1524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:56.575683 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:56.575782 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:56.585521 (+ 9739us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.206.195:45581: BlockingRecv error: recv got EOF from 127.26.206.195:45581 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
Aug 08 14:50:56 dist-test-slave-6k22 krb5kdc[4412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.206.193@KRBTEST.COM for oryx/127.26.206.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:50:56 dist-test-slave-6k22 krb5kdc[4412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.206.193@KRBTEST.COM for oryx/127.26.206.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:50:56.673810 5584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:56.664850 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:45657 (local address 127.26.206.193:45827)
0808 14:50:56.665369 (+ 519us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:56.665384 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 14:50:56.665539 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:50:56.665867 (+ 328us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:50:56.665872 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:50:56.666290 (+ 418us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:50:56.666452 (+ 162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:56.666477 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:56.667477 (+ 1000us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:56.667489 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:56.668588 (+ 1099us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:56.668600 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:56.669498 (+ 898us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:56.669504 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:56.669666 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:56.670366 (+ 700us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:50:56.670383 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:50:56.673551 (+ 3168us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.206.254:45657: Server oryx/127.26.206.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":410,"thread_start_us":286,"threads_started":1}
W20260808 14:50:56.674100 5269 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:50:56.664894 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.193:45827 (local address 127.26.206.254:45657)
0808 14:50:56.665102 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:56.665108 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:56.665471 (+ 363us) server_negotiation.cc:407] Connection header received
0808 14:50:56.665673 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:56.665677 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:56.665737 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:56.665838 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:56.666616 (+ 778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:56.667346 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:56.668718 (+ 1372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:56.669327 (+ 609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:56.669481 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:56.673748 (+ 4267us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.206.193:45827: BlockingRecv error: recv got EOF from 127.26.206.193:45827 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
Aug 08 14:50:57 dist-test-slave-6k22 krb5kdc[4412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.206.194@KRBTEST.COM for oryx/127.26.206.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:50:57 dist-test-slave-6k22 krb5kdc[4412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.206.194@KRBTEST.COM for oryx/127.26.206.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:50:57.126103 5586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:57.117726 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:45657 (local address 127.26.206.194:46159)
0808 14:50:57.118236 (+ 510us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:57.118253 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 14:50:57.118424 (+ 171us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:50:57.118766 (+ 342us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:50:57.118772 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:50:57.119185 (+ 413us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:50:57.119365 (+ 180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:57.119374 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:57.120429 (+ 1055us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:57.120437 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:57.121349 (+ 912us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:57.121360 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:57.122129 (+ 769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:57.122136 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:57.122329 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:57.122900 (+ 571us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:50:57.122916 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:50:57.125862 (+ 2946us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.206.254:45657: Server oryx/127.26.206.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":413,"thread_start_us":274,"threads_started":1}
W20260808 14:50:57.126291 5269 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:50:57.117807 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.194:46159 (local address 127.26.206.254:45657)
0808 14:50:57.118047 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:57.118055 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:57.118342 (+ 287us) server_negotiation.cc:407] Connection header received
0808 14:50:57.118546 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:57.118552 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:57.118628 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:57.118730 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:57.119512 (+ 782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:57.120297 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:57.121522 (+ 1225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:57.121970 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:57.122115 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:57.126050 (+ 3935us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.206.194:46159: BlockingRecv error: recv got EOF from 127.26.206.194:46159 (error 108)
Metrics: {"server-negotiator.queue_time_us":76}
Aug 08 14:50:57 dist-test-slave-6k22 krb5kdc[4412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.206.195@KRBTEST.COM for oryx/127.26.206.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:50:57 dist-test-slave-6k22 krb5kdc[4412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.206.195@KRBTEST.COM for oryx/127.26.206.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:50:57.594599 5588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:57.586597 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:45657 (local address 127.26.206.195:38815)
0808 14:50:57.587130 (+ 533us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:57.587146 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 14:50:57.587294 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:50:57.587680 (+ 386us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:50:57.587684 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:50:57.588124 (+ 440us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:50:57.588289 (+ 165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:57.588297 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:57.589232 (+ 935us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:57.589237 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:57.590116 (+ 879us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:57.590127 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:57.590878 (+ 751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:57.590884 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:57.591059 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:57.591631 (+ 572us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:50:57.591647 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:50:57.594356 (+ 2709us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.206.254:45657: Server oryx/127.26.206.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":437,"thread_start_us":288,"threads_started":1}
W20260808 14:50:57.594787 5269 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:50:57.586775 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.195:38815 (local address 127.26.206.254:45657)
0808 14:50:57.586981 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:57.586987 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:57.587225 (+ 238us) server_negotiation.cc:407] Connection header received
0808 14:50:57.587416 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:57.587421 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:57.587508 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:57.587648 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:57.588426 (+ 778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:57.589101 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:57.590257 (+ 1156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:57.590702 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:57.590866 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:57.594560 (+ 3694us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.206.195:38815: BlockingRecv error: recv got EOF from 127.26.206.195:38815 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
Aug 08 14:50:57 dist-test-slave-6k22 krb5kdc[4412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.206.193@KRBTEST.COM for oryx/127.26.206.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:50:57 dist-test-slave-6k22 krb5kdc[4412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.206.193@KRBTEST.COM for oryx/127.26.206.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:50:57.683032 5589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:57.674668 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:45657 (local address 127.26.206.193:47865)
0808 14:50:57.675177 (+ 509us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:57.675194 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 14:50:57.675309 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:50:57.675659 (+ 350us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:50:57.675663 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:50:57.676005 (+ 342us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:50:57.676175 (+ 170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:57.676183 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:57.677203 (+ 1020us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:57.677208 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:57.678613 (+ 1405us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:57.678628 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:57.679285 (+ 657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:57.679289 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:57.679405 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:57.680049 (+ 644us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:50:57.680065 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:50:57.682739 (+ 2674us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.206.254:45657: Server oryx/127.26.206.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":417,"thread_start_us":289,"threads_started":1}
W20260808 14:50:57.683177 5269 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:50:57.674744 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.193:47865 (local address 127.26.206.254:45657)
0808 14:50:57.675001 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:57.675009 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:57.675278 (+ 269us) server_negotiation.cc:407] Connection header received
0808 14:50:57.675405 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:57.675409 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:57.675484 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:57.675633 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:57.676294 (+ 661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:57.677049 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:57.678742 (+ 1693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:57.679163 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:57.679259 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:57.682930 (+ 3671us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.206.193:47865: BlockingRecv error: recv got EOF from 127.26.206.193:47865 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
Aug 08 14:50:58 dist-test-slave-6k22 krb5kdc[4412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.206.194@KRBTEST.COM for oryx/127.26.206.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:50:58 dist-test-slave-6k22 krb5kdc[4412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.206.194@KRBTEST.COM for oryx/127.26.206.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:50:58.134997 5590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:58.126968 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:45657 (local address 127.26.206.194:32907)
0808 14:50:58.127476 (+ 508us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:58.127492 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 14:50:58.127664 (+ 172us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:50:58.127992 (+ 328us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:50:58.127997 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:50:58.128367 (+ 370us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:50:58.128540 (+ 173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:58.128548 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:58.129566 (+ 1018us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:58.129575 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:58.130471 (+ 896us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:58.130482 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:58.131171 (+ 689us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:58.131176 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:58.131366 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:58.131953 (+ 587us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:50:58.131970 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:50:58.134617 (+ 2647us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.206.254:45657: Server oryx/127.26.206.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":419,"thread_start_us":257,"threads_started":1}
W20260808 14:50:58.135023 5269 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:50:58.127033 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.194:32907 (local address 127.26.206.254:45657)
0808 14:50:58.127255 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:58.127264 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:58.127581 (+ 317us) server_negotiation.cc:407] Connection header received
0808 14:50:58.127787 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:58.127795 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:58.127859 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:58.127960 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:58.128689 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:58.129425 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:58.130625 (+ 1200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:58.131029 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:58.131162 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:58.134799 (+ 3637us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.206.194:32907: BlockingRecv error: recv got EOF from 127.26.206.194:32907 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
Aug 08 14:50:58 dist-test-slave-6k22 krb5kdc[4412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.206.195@KRBTEST.COM for oryx/127.26.206.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:50:58 dist-test-slave-6k22 krb5kdc[4412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.206.195@KRBTEST.COM for oryx/127.26.206.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:50:58.603825 5591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:58.595842 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:45657 (local address 127.26.206.195:58927)
0808 14:50:58.596407 (+ 565us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:58.596422 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 14:50:58.596569 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:50:58.596968 (+ 399us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:50:58.596974 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:50:58.597378 (+ 404us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:50:58.597619 (+ 241us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:58.597630 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:58.598649 (+ 1019us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:58.598652 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:58.599513 (+ 861us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:58.599523 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:58.600154 (+ 631us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:58.600157 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:58.600274 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:58.600836 (+ 562us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:50:58.600852 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:50:58.603505 (+ 2653us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.206.254:45657: Server oryx/127.26.206.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":463,"thread_start_us":306,"threads_started":1}
W20260808 14:50:58.603989 5269 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:50:58.595892 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.195:58927 (local address 127.26.206.254:45657)
0808 14:50:58.596096 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:58.596102 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:58.596483 (+ 381us) server_negotiation.cc:407] Connection header received
0808 14:50:58.596706 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:58.596711 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:58.596811 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:58.596919 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:58.597753 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:58.598533 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:58.599641 (+ 1108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:58.600033 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:58.600129 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:58.603743 (+ 3614us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.206.195:58927: BlockingRecv error: recv got EOF from 127.26.206.195:58927 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
Aug 08 14:50:58 dist-test-slave-6k22 krb5kdc[4412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.206.193@KRBTEST.COM for oryx/127.26.206.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:50:58 dist-test-slave-6k22 krb5kdc[4412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.206.193@KRBTEST.COM for oryx/127.26.206.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:50:58.692242 5592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:58.683964 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:45657 (local address 127.26.206.193:38887)
0808 14:50:58.684471 (+ 507us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:58.684489 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 14:50:58.684608 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:50:58.684919 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:50:58.684922 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:50:58.685294 (+ 372us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:50:58.685436 (+ 142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:58.685443 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:58.686454 (+ 1011us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:58.686458 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:58.687392 (+ 934us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:58.687402 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:58.688219 (+ 817us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:58.688223 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:58.688344 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:58.688895 (+ 551us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:50:58.688911 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:50:58.691897 (+ 2986us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.206.254:45657: Server oryx/127.26.206.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":393,"thread_start_us":301,"threads_started":1}
W20260808 14:50:58.692430 5269 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:50:58.684076 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.193:38887 (local address 127.26.206.254:45657)
0808 14:50:58.684263 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:58.684268 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:58.684575 (+ 307us) server_negotiation.cc:407] Connection header received
0808 14:50:58.684701 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:58.684705 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:58.684788 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:58.684877 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:58.685573 (+ 696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:58.686338 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:58.687667 (+ 1329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:58.688051 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:58.688144 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:58.692154 (+ 4010us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.206.193:38887: BlockingRecv error: recv got EOF from 127.26.206.193:38887 (error 108)
Metrics: {"server-negotiator.queue_time_us":75}
Aug 08 14:50:59 dist-test-slave-6k22 krb5kdc[4412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.206.194@KRBTEST.COM for oryx/127.26.206.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:50:59 dist-test-slave-6k22 krb5kdc[4412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.206.194@KRBTEST.COM for oryx/127.26.206.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:50:59.145383 5593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:59.136149 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:45657 (local address 127.26.206.194:51203)
0808 14:50:59.136705 (+ 556us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:59.136721 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 14:50:59.136834 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:50:59.137238 (+ 404us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:50:59.137242 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:50:59.137614 (+ 372us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:50:59.137763 (+ 149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:59.137771 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:59.139455 (+ 1684us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:59.139463 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:59.140713 (+ 1250us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:59.140724 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:59.141499 (+ 775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:59.141503 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:59.141617 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:59.142187 (+ 570us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:50:59.142203 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:50:59.145043 (+ 2840us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.206.254:45657: Server oryx/127.26.206.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":436,"thread_start_us":321,"threads_started":1}
W20260808 14:50:59.145510 5269 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:50:59.136215 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.194:51203 (local address 127.26.206.254:45657)
0808 14:50:59.136384 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:59.136388 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:59.136803 (+ 415us) server_negotiation.cc:407] Connection header received
0808 14:50:59.137040 (+ 237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:59.137044 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:59.137108 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:59.137195 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:59.137938 (+ 743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:59.139292 (+ 1354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:59.140874 (+ 1582us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:59.141369 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:59.141490 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:59.145239 (+ 3749us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.206.194:51203: BlockingRecv error: recv got EOF from 127.26.206.194:51203 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
Aug 08 14:50:59 dist-test-slave-6k22 krb5kdc[4412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.206.195@KRBTEST.COM for oryx/127.26.206.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:50:59 dist-test-slave-6k22 krb5kdc[4412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.206.195@KRBTEST.COM for oryx/127.26.206.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:50:59.613487 5595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:59.604708 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:45657 (local address 127.26.206.195:33437)
0808 14:50:59.605228 (+ 520us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:59.605244 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 14:50:59.605419 (+ 175us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:50:59.605773 (+ 354us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:50:59.605778 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:50:59.606206 (+ 428us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:50:59.606363 (+ 157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:59.606373 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:59.607367 (+ 994us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:59.607374 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:59.608373 (+ 999us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:59.608384 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:59.609111 (+ 727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:59.609117 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:59.609299 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:59.609882 (+ 583us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:50:59.609899 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:50:59.613178 (+ 3279us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.206.254:45657: Server oryx/127.26.206.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":418,"thread_start_us":280,"threads_started":1}
W20260808 14:50:59.613600 5269 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:50:59.604789 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.195:33437 (local address 127.26.206.254:45657)
0808 14:50:59.605024 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:59.605032 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:59.605350 (+ 318us) server_negotiation.cc:407] Connection header received
0808 14:50:59.605554 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:59.605566 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:59.605628 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:59.605732 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:59.606513 (+ 781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:59.607236 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:59.608517 (+ 1281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:59.608959 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:59.609089 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:59.613381 (+ 4292us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.206.195:33437: BlockingRecv error: recv got EOF from 127.26.206.195:33437 (error 108)
Metrics: {"server-negotiator.queue_time_us":79}
Aug 08 14:50:59 dist-test-slave-6k22 krb5kdc[4412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.206.193@KRBTEST.COM for oryx/127.26.206.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:50:59 dist-test-slave-6k22 krb5kdc[4412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.206.193@KRBTEST.COM for oryx/127.26.206.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:50:59.701721 5596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:50:59.693347 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:45657 (local address 127.26.206.193:45301)
0808 14:50:59.693852 (+ 505us) negotiation.cc:107] Waiting for socket to connect
0808 14:50:59.693867 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 14:50:59.694023 (+ 156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:50:59.694378 (+ 355us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:50:59.694383 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:50:59.694840 (+ 457us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:50:59.695074 (+ 234us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:59.695085 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:59.696344 (+ 1259us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:59.696349 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:59.697265 (+ 916us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:50:59.697283 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:50:59.697965 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:50:59.697970 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:50:59.698148 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:59.698711 (+ 563us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:50:59.698728 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:50:59.701476 (+ 2748us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.206.254:45657: Server oryx/127.26.206.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":407,"thread_start_us":260,"threads_started":1}
W20260808 14:50:59.701907 5269 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:50:59.693424 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.193:45301 (local address 127.26.206.254:45657)
0808 14:50:59.693657 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0808 14:50:59.693665 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:50:59.693962 (+ 297us) server_negotiation.cc:407] Connection header received
0808 14:50:59.694153 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:50:59.694164 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:50:59.694237 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:50:59.694344 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:50:59.695222 (+ 878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:59.696198 (+ 976us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:59.697419 (+ 1221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:50:59.697819 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:50:59.697954 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:50:59.701655 (+ 3701us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.206.193:45301: BlockingRecv error: recv got EOF from 127.26.206.193:45301 (error 108)
Metrics: {"server-negotiator.queue_time_us":83}
Aug 08 14:51:00 dist-test-slave-6k22 krb5kdc[4412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.206.194@KRBTEST.COM for oryx/127.26.206.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:51:00 dist-test-slave-6k22 krb5kdc[4412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.206.194@KRBTEST.COM for oryx/127.26.206.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:51:00.154469 5597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:51:00.146294 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:45657 (local address 127.26.206.194:37691)
0808 14:51:00.146894 (+ 600us) negotiation.cc:107] Waiting for socket to connect
0808 14:51:00.146914 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 14:51:00.147053 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:51:00.147440 (+ 387us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:51:00.147444 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:51:00.148058 (+ 614us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:51:00.148282 (+ 224us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:51:00.148297 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:51:00.149360 (+ 1063us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:51:00.149364 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:51:00.150269 (+ 905us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:51:00.150282 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:51:00.150909 (+ 627us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:51:00.150913 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:51:00.151025 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:51:00.151617 (+ 592us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:51:00.151634 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:51:00.154236 (+ 2602us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.206.254:45657: Server oryx/127.26.206.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":445,"thread_start_us":283,"threads_started":1}
W20260808 14:51:00.154608 5269 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:51:00.146528 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.194:37691 (local address 127.26.206.254:45657)
0808 14:51:00.146748 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0808 14:51:00.146754 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:51:00.147024 (+ 270us) server_negotiation.cc:407] Connection header received
0808 14:51:00.147179 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:51:00.147185 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:51:00.147284 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:51:00.147366 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:51:00.148440 (+ 1074us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:51:00.149224 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:51:00.150393 (+ 1169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:51:00.150781 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:51:00.150873 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:51:00.154427 (+ 3554us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.206.194:37691: BlockingRecv error: recv got EOF from 127.26.206.194:37691 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
Aug 08 14:51:00 dist-test-slave-6k22 krb5kdc[4412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.206.195@KRBTEST.COM for oryx/127.26.206.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:51:00 dist-test-slave-6k22 krb5kdc[4412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.206.195@KRBTEST.COM for oryx/127.26.206.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:51:00.622702 5598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:51:00.614535 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:45657 (local address 127.26.206.195:35845)
0808 14:51:00.615150 (+ 615us) negotiation.cc:107] Waiting for socket to connect
0808 14:51:00.615165 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 14:51:00.615273 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:51:00.615575 (+ 302us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:51:00.615578 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:51:00.615970 (+ 392us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:51:00.616129 (+ 159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:51:00.616137 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:51:00.617035 (+ 898us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:51:00.617039 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:51:00.617938 (+ 899us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:51:00.617949 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:51:00.618632 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:51:00.618636 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:51:00.618749 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:51:00.619307 (+ 558us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:51:00.619323 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:51:00.622457 (+ 3134us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.206.254:45657: Server oryx/127.26.206.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":503,"thread_start_us":326,"threads_started":1}
W20260808 14:51:00.622867 5269 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:51:00.614636 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.195:35845 (local address 127.26.206.254:45657)
0808 14:51:00.614843 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0808 14:51:00.614850 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:51:00.615243 (+ 393us) server_negotiation.cc:407] Connection header received
0808 14:51:00.615367 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:51:00.615371 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:51:00.615430 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:51:00.615510 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:51:00.616245 (+ 735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:51:00.616924 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:51:00.618053 (+ 1129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:51:00.618511 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:51:00.618604 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:51:00.622649 (+ 4045us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.206.195:35845: BlockingRecv error: recv got EOF from 127.26.206.195:35845 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
Aug 08 14:51:00 dist-test-slave-6k22 krb5kdc[4412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.206.193@KRBTEST.COM for oryx/127.26.206.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:51:00 dist-test-slave-6k22 krb5kdc[4412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.206.193@KRBTEST.COM for oryx/127.26.206.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:51:00.711021 5599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:51:00.702896 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:45657 (local address 127.26.206.193:51579)
0808 14:51:00.703444 (+ 548us) negotiation.cc:107] Waiting for socket to connect
0808 14:51:00.703460 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 14:51:00.703633 (+ 173us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:51:00.704000 (+ 367us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:51:00.704005 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:51:00.704558 (+ 553us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:51:00.704764 (+ 206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:51:00.704780 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:51:00.705678 (+ 898us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:51:00.705682 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:51:00.706530 (+ 848us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:51:00.706540 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:51:00.707160 (+ 620us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:51:00.707165 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:51:00.707279 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:51:00.707910 (+ 631us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:51:00.707926 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:51:00.710687 (+ 2761us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.206.254:45657: Server oryx/127.26.206.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":421,"thread_start_us":285,"threads_started":1}
W20260808 14:51:00.711119 5269 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:51:00.703017 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.193:51579 (local address 127.26.206.254:45657)
0808 14:51:00.703239 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0808 14:51:00.703246 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:51:00.703550 (+ 304us) server_negotiation.cc:407] Connection header received
0808 14:51:00.703759 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:51:00.703765 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:51:00.703850 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:51:00.703928 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:51:00.704896 (+ 968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:51:00.705557 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:51:00.706646 (+ 1089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:51:00.707038 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:51:00.707124 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:51:00.710884 (+ 3760us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.206.193:51579: BlockingRecv error: recv got EOF from 127.26.206.193:51579 (error 108)
Metrics: {"server-negotiator.queue_time_us":72}
Aug 08 14:51:01 dist-test-slave-6k22 krb5kdc[4412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.206.194@KRBTEST.COM for oryx/127.26.206.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:51:01 dist-test-slave-6k22 krb5kdc[4412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.206.194@KRBTEST.COM for oryx/127.26.206.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:51:01.163748 5600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:51:01.155429 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:45657 (local address 127.26.206.194:58187)
0808 14:51:01.156025 (+ 596us) negotiation.cc:107] Waiting for socket to connect
0808 14:51:01.156046 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 14:51:01.156155 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:51:01.156444 (+ 289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:51:01.156448 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:51:01.156849 (+ 401us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:51:01.156997 (+ 148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:51:01.157006 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:51:01.158008 (+ 1002us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:51:01.158012 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:51:01.158917 (+ 905us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:51:01.158927 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:51:01.159703 (+ 776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:51:01.159707 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:51:01.159836 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:51:01.160380 (+ 544us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:51:01.160412 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:51:01.163473 (+ 3061us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.206.254:45657: Server oryx/127.26.206.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":476,"thread_start_us":350,"threads_started":1}
W20260808 14:51:01.163991 5269 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:51:01.155533 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.194:58187 (local address 127.26.206.254:45657)
0808 14:51:01.155724 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0808 14:51:01.155728 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:51:01.156122 (+ 394us) server_negotiation.cc:407] Connection header received
0808 14:51:01.156246 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:51:01.156249 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:51:01.156317 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:51:01.156397 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:51:01.157115 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:51:01.157889 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:51:01.159039 (+ 1150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:51:01.159539 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:51:01.159648 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:51:01.163707 (+ 4059us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.206.194:58187: BlockingRecv error: recv got EOF from 127.26.206.194:58187 (error 108)
Metrics: {"server-negotiator.queue_time_us":74}
Aug 08 14:51:01 dist-test-slave-6k22 krb5kdc[4412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.206.195@KRBTEST.COM for oryx/127.26.206.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:51:01 dist-test-slave-6k22 krb5kdc[4412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.206.195@KRBTEST.COM for oryx/127.26.206.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:51:01.636376 5601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:51:01.623647 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:45657 (local address 127.26.206.195:41219)
0808 14:51:01.624140 (+ 493us) negotiation.cc:107] Waiting for socket to connect
0808 14:51:01.624157 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 14:51:01.624273 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:51:01.624567 (+ 294us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:51:01.624570 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:51:01.624979 (+ 409us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:51:01.625134 (+ 155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:51:01.625142 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:51:01.626239 (+ 1097us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:51:01.626245 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:51:01.627165 (+ 920us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:51:01.627176 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:51:01.627975 (+ 799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:51:01.627981 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:51:01.628153 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:51:01.633171 (+ 5018us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:51:01.633190 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:51:01.636113 (+ 2923us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.206.254:45657: Server oryx/127.26.206.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":395,"thread_start_us":275,"threads_started":1}
W20260808 14:51:01.636684 5269 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:51:01.623691 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.195:41219 (local address 127.26.206.254:45657)
0808 14:51:01.623929 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0808 14:51:01.623939 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 14:51:01.624238 (+ 299us) server_negotiation.cc:407] Connection header received
0808 14:51:01.624372 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:51:01.624376 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:51:01.624438 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:51:01.624519 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:51:01.625310 (+ 791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:51:01.626090 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:51:01.627326 (+ 1236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:51:01.627820 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:51:01.627952 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:51:01.636404 (+ 8452us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.206.195:41219: BlockingRecv error: recv got EOF from 127.26.206.195:41219 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
Aug 08 14:51:01 dist-test-slave-6k22 krb5kdc[4412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.206.193@KRBTEST.COM for oryx/127.26.206.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:51:01 dist-test-slave-6k22 krb5kdc[4412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.206.193@KRBTEST.COM for oryx/127.26.206.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:51:01.720198 5602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:51:01.712047 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:45657 (local address 127.26.206.193:56885)
0808 14:51:01.712654 (+ 607us) negotiation.cc:107] Waiting for socket to connect
0808 14:51:01.712669 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 14:51:01.712786 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:51:01.713072 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:51:01.713075 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:51:01.713458 (+ 383us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:51:01.713622 (+ 164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:51:01.713630 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:51:01.714582 (+ 952us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:51:01.714585 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:51:01.715468 (+ 883us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:51:01.715477 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:51:01.716184 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:51:01.716188 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:51:01.716311 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:51:01.716888 (+ 577us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:51:01.716904 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:51:01.719898 (+ 2994us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.206.254:45657: Server oryx/127.26.206.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":499,"thread_start_us":314,"threads_started":1}
W20260808 14:51:01.720477 5269 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:51:01.712126 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.193:56885 (local address 127.26.206.254:45657)
0808 14:51:01.712301 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0808 14:51:01.712305 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:51:01.712751 (+ 446us) server_negotiation.cc:407] Connection header received
0808 14:51:01.712876 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:51:01.712880 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:51:01.712950 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:51:01.713031 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:51:01.713740 (+ 709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:51:01.714457 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:51:01.715629 (+ 1172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:51:01.716029 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:51:01.716151 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:51:01.720162 (+ 4011us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.206.193:56885: BlockingRecv error: recv got EOF from 127.26.206.193:56885 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
Aug 08 14:51:02 dist-test-slave-6k22 krb5kdc[4412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.206.194@KRBTEST.COM for oryx/127.26.206.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:51:02 dist-test-slave-6k22 krb5kdc[4412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.206.194@KRBTEST.COM for oryx/127.26.206.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:51:02.172884 5603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:51:02.164608 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:45657 (local address 127.26.206.194:49939)
0808 14:51:02.165184 (+ 576us) negotiation.cc:107] Waiting for socket to connect
0808 14:51:02.165201 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 14:51:02.165345 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:51:02.165626 (+ 281us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:51:02.165630 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:51:02.166080 (+ 450us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:51:02.166244 (+ 164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:51:02.166253 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:51:02.167186 (+ 933us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:51:02.167189 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:51:02.168111 (+ 922us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:51:02.168121 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:51:02.168705 (+ 584us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:51:02.168709 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:51:02.168821 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:51:02.169413 (+ 592us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:51:02.169430 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:51:02.172524 (+ 3094us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.206.254:45657: Server oryx/127.26.206.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":461,"thread_start_us":278,"threads_started":1}
W20260808 14:51:02.172972 5269 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:51:02.164700 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.194:49939 (local address 127.26.206.254:45657)
0808 14:51:02.164883 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0808 14:51:02.164888 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:51:02.165301 (+ 413us) server_negotiation.cc:407] Connection header received
0808 14:51:02.165427 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:51:02.165430 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:51:02.165489 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:51:02.165579 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:51:02.166366 (+ 787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:51:02.167049 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:51:02.168238 (+ 1189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:51:02.168592 (+ 354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:51:02.168673 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:51:02.172711 (+ 4038us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.206.194:49939: BlockingRecv error: recv got EOF from 127.26.206.194:49939 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
Aug 08 14:51:02 dist-test-slave-6k22 krb5kdc[4412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.206.195@KRBTEST.COM for oryx/127.26.206.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:51:02 dist-test-slave-6k22 krb5kdc[4412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.206.195@KRBTEST.COM for oryx/127.26.206.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:51:02.647044 5604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:51:02.637444 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:45657 (local address 127.26.206.195:57223)
0808 14:51:02.638114 (+ 670us) negotiation.cc:107] Waiting for socket to connect
0808 14:51:02.638131 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 14:51:02.638251 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:51:02.638689 (+ 438us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:51:02.638694 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:51:02.639272 (+ 578us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:51:02.639481 (+ 209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:51:02.639511 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:51:02.641228 (+ 1717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:51:02.641232 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:51:02.642139 (+ 907us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:51:02.642151 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:51:02.643257 (+ 1106us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:51:02.643261 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:51:02.643375 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:51:02.644065 (+ 690us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:51:02.644082 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:51:02.646799 (+ 2717us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.206.254:45657: Server oryx/127.26.206.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":553,"thread_start_us":312,"threads_started":1}
W20260808 14:51:02.647452 5269 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:51:02.637488 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.195:57223 (local address 127.26.206.254:45657)
0808 14:51:02.637741 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0808 14:51:02.637750 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:51:02.638218 (+ 468us) server_negotiation.cc:407] Connection header received
0808 14:51:02.638386 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:51:02.638401 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:51:02.638496 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:51:02.638610 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:51:02.639655 (+ 1045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:51:02.641078 (+ 1423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:51:02.642279 (+ 1201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:51:02.643104 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:51:02.643255 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:51:02.647123 (+ 3868us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.206.195:57223: BlockingRecv error: recv got EOF from 127.26.206.195:57223 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
Aug 08 14:51:02 dist-test-slave-6k22 krb5kdc[4412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.206.193@KRBTEST.COM for oryx/127.26.206.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:51:02 dist-test-slave-6k22 krb5kdc[4412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.206.193@KRBTEST.COM for oryx/127.26.206.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:51:02.729839 5606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:51:02.721232 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:45657 (local address 127.26.206.193:53967)
0808 14:51:02.721959 (+ 727us) negotiation.cc:107] Waiting for socket to connect
0808 14:51:02.721980 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 14:51:02.722148 (+ 168us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:51:02.722517 (+ 369us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:51:02.722521 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:51:02.722972 (+ 451us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:51:02.723134 (+ 162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:51:02.723150 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:51:02.724216 (+ 1066us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:51:02.724225 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:51:02.725177 (+ 952us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:51:02.725188 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:51:02.725985 (+ 797us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:51:02.725994 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:51:02.726178 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:51:02.726736 (+ 558us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:51:02.726753 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:51:02.729596 (+ 2843us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.206.254:45657: Server oryx/127.26.206.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":570,"thread_start_us":391,"threads_started":1}
W20260808 14:51:02.730041 5269 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:51:02.721466 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.193:53967 (local address 127.26.206.254:45657)
0808 14:51:02.721884 (+ 418us) server_negotiation.cc:206] Beginning negotiation
0808 14:51:02.721896 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 14:51:02.722081 (+ 185us) server_negotiation.cc:407] Connection header received
0808 14:51:02.722287 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:51:02.722292 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:51:02.722378 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:51:02.722481 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:51:02.723286 (+ 805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:51:02.724084 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:51:02.725338 (+ 1254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:51:02.725809 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:51:02.725948 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:51:02.729792 (+ 3844us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.206.193:53967: BlockingRecv error: recv got EOF from 127.26.206.193:53967 (error 108)
Metrics: {"server-negotiator.queue_time_us":281}
Aug 08 14:51:03 dist-test-slave-6k22 krb5kdc[4412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.206.194@KRBTEST.COM for oryx/127.26.206.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:51:03 dist-test-slave-6k22 krb5kdc[4412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.206.194@KRBTEST.COM for oryx/127.26.206.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:51:03.182161 5607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:51:03.173961 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:45657 (local address 127.26.206.194:33719)
0808 14:51:03.174553 (+ 592us) negotiation.cc:107] Waiting for socket to connect
0808 14:51:03.174569 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 14:51:03.174679 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:51:03.174971 (+ 292us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:51:03.174975 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:51:03.175377 (+ 402us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:51:03.175528 (+ 151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:51:03.175537 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:51:03.176634 (+ 1097us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:51:03.176637 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:51:03.177627 (+ 990us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:51:03.177639 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:51:03.178418 (+ 779us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:51:03.178423 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:51:03.178538 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:51:03.179190 (+ 652us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:51:03.179208 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:51:03.181933 (+ 2725us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.206.254:45657: Server oryx/127.26.206.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":451,"thread_start_us":311,"threads_started":1}
W20260808 14:51:03.182396 5269 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:51:03.174040 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.194:33719 (local address 127.26.206.254:45657)
0808 14:51:03.174199 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0808 14:51:03.174203 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:51:03.174639 (+ 436us) server_negotiation.cc:407] Connection header received
0808 14:51:03.174773 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:51:03.174783 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:51:03.174848 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:51:03.174926 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:51:03.175672 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:51:03.176511 (+ 839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:51:03.177743 (+ 1232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:51:03.178209 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:51:03.178358 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:51:03.182128 (+ 3770us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.206.194:33719: BlockingRecv error: recv got EOF from 127.26.206.194:33719 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
Aug 08 14:51:03 dist-test-slave-6k22 krb5kdc[4412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.206.195@KRBTEST.COM for oryx/127.26.206.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:51:03 dist-test-slave-6k22 krb5kdc[4412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.206.195@KRBTEST.COM for oryx/127.26.206.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:51:03.656176 5608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:51:03.648097 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:45657 (local address 127.26.206.195:57727)
0808 14:51:03.648600 (+ 503us) negotiation.cc:107] Waiting for socket to connect
0808 14:51:03.648616 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 14:51:03.648728 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:51:03.649023 (+ 295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:51:03.649026 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:51:03.649408 (+ 382us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:51:03.649556 (+ 148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:51:03.649563 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:51:03.650494 (+ 931us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:51:03.650498 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:51:03.651398 (+ 900us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:51:03.651408 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:51:03.652217 (+ 809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:51:03.652222 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:51:03.652331 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:51:03.652978 (+ 647us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:51:03.652996 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:51:03.655889 (+ 2893us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.206.254:45657: Server oryx/127.26.206.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":390,"thread_start_us":280,"threads_started":1}
W20260808 14:51:03.656395 5269 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:51:03.648177 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.195:57727 (local address 127.26.206.254:45657)
0808 14:51:03.648417 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0808 14:51:03.648424 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:51:03.648693 (+ 269us) server_negotiation.cc:407] Connection header received
0808 14:51:03.648840 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:51:03.648844 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:51:03.648903 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:51:03.648979 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:51:03.649669 (+ 690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:51:03.650368 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:51:03.651515 (+ 1147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:51:03.652060 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:51:03.652153 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:51:03.656123 (+ 3970us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.206.195:57727: BlockingRecv error: recv got EOF from 127.26.206.195:57727 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
Aug 08 14:51:03 dist-test-slave-6k22 krb5kdc[4412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.206.193@KRBTEST.COM for oryx/127.26.206.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:51:03 dist-test-slave-6k22 krb5kdc[4412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.206.193@KRBTEST.COM for oryx/127.26.206.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:51:03.739629 5609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:51:03.730984 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:45657 (local address 127.26.206.193:58611)
0808 14:51:03.731648 (+ 664us) negotiation.cc:107] Waiting for socket to connect
0808 14:51:03.731665 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 14:51:03.731777 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:51:03.732072 (+ 295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:51:03.732075 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:51:03.732495 (+ 420us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:51:03.732664 (+ 169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:51:03.732672 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:51:03.733665 (+ 993us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:51:03.733669 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:51:03.734615 (+ 946us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:51:03.734625 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:51:03.735264 (+ 639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:51:03.735268 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:51:03.735397 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:51:03.736113 (+ 716us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:51:03.736130 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:51:03.739245 (+ 3115us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.206.254:45657: Server oryx/127.26.206.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":510,"thread_start_us":348,"threads_started":1}
W20260808 14:51:03.739734 5269 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:51:03.731040 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.193:58611 (local address 127.26.206.254:45657)
0808 14:51:03.731202 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0808 14:51:03.731207 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:51:03.731743 (+ 536us) server_negotiation.cc:407] Connection header received
0808 14:51:03.731877 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:51:03.731881 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:51:03.731942 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:51:03.732027 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:51:03.732808 (+ 781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:51:03.733548 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:51:03.734733 (+ 1185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:51:03.735140 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:51:03.735230 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:51:03.739438 (+ 4208us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.206.193:58611: BlockingRecv error: recv got EOF from 127.26.206.193:58611 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
Aug 08 14:51:04 dist-test-slave-6k22 krb5kdc[4412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.206.194@KRBTEST.COM for oryx/127.26.206.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:51:04 dist-test-slave-6k22 krb5kdc[4412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.206.194@KRBTEST.COM for oryx/127.26.206.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:51:04.191505 5610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:51:04.183097 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:45657 (local address 127.26.206.194:52045)
0808 14:51:04.183699 (+ 602us) negotiation.cc:107] Waiting for socket to connect
0808 14:51:04.183717 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 14:51:04.183834 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:51:04.184096 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:51:04.184100 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:51:04.184501 (+ 401us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:51:04.184664 (+ 163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:51:04.184672 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:51:04.185602 (+ 930us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:51:04.185605 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:51:04.186500 (+ 895us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:51:04.186511 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:51:04.187174 (+ 663us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:51:04.187178 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:51:04.187312 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:51:04.188042 (+ 730us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:51:04.188067 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:51:04.191268 (+ 3201us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.206.254:45657: Server oryx/127.26.206.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":483,"thread_start_us":333,"threads_started":1}
W20260808 14:51:04.191705 5269 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:51:04.183185 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.194:52045 (local address 127.26.206.254:45657)
0808 14:51:04.183373 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0808 14:51:04.183378 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:51:04.183790 (+ 412us) server_negotiation.cc:407] Connection header received
0808 14:51:04.183913 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:51:04.183917 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:51:04.183977 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:51:04.184056 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:51:04.184782 (+ 726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:51:04.185493 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:51:04.186613 (+ 1120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:51:04.187019 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:51:04.187119 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:51:04.191456 (+ 4337us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.206.194:52045: BlockingRecv error: recv got EOF from 127.26.206.194:52045 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
Aug 08 14:51:04 dist-test-slave-6k22 krb5kdc[4412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.206.195@KRBTEST.COM for oryx/127.26.206.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:51:04 dist-test-slave-6k22 krb5kdc[4412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.206.195@KRBTEST.COM for oryx/127.26.206.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:51:04.667920 5611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:51:04.657234 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:45657 (local address 127.26.206.195:59169)
0808 14:51:04.657928 (+ 694us) negotiation.cc:107] Waiting for socket to connect
0808 14:51:04.657948 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 14:51:04.658082 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:51:04.658916 (+ 834us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:51:04.658920 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:51:04.659530 (+ 610us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:51:04.659810 (+ 280us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:51:04.659823 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:51:04.661245 (+ 1422us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:51:04.661254 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:51:04.662400 (+ 1146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:51:04.662414 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:51:04.663279 (+ 865us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:51:04.663286 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:51:04.663495 (+ 209us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:51:04.664129 (+ 634us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:51:04.664154 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:51:04.667440 (+ 3286us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.206.254:45657: Server oryx/127.26.206.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":568,"thread_start_us":419,"threads_started":1}
W20260808 14:51:04.668015 5269 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:51:04.657270 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.195:59169 (local address 127.26.206.254:45657)
0808 14:51:04.657458 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0808 14:51:04.657462 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:51:04.658028 (+ 566us) server_negotiation.cc:407] Connection header received
0808 14:51:04.658185 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:51:04.658189 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:51:04.658249 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:51:04.658339 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:51:04.659992 (+ 1653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:51:04.661082 (+ 1090us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:51:04.662576 (+ 1494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:51:04.663082 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:51:04.663264 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:51:04.667714 (+ 4450us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.206.195:59169: BlockingRecv error: recv got EOF from 127.26.206.195:59169 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
Aug 08 14:51:04 dist-test-slave-6k22 krb5kdc[4412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.206.193@KRBTEST.COM for oryx/127.26.206.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:51:04 dist-test-slave-6k22 krb5kdc[4412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.206.193@KRBTEST.COM for oryx/127.26.206.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:51:04.748996 5614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:51:04.740553 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:45657 (local address 127.26.206.193:37311)
0808 14:51:04.741094 (+ 541us) negotiation.cc:107] Waiting for socket to connect
0808 14:51:04.741108 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 14:51:04.741266 (+ 158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:51:04.741649 (+ 383us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:51:04.741654 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:51:04.742040 (+ 386us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:51:04.742189 (+ 149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:51:04.742199 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:51:04.743251 (+ 1052us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:51:04.743257 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:51:04.744318 (+ 1061us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:51:04.744330 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:51:04.745085 (+ 755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:51:04.745091 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:51:04.745272 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:51:04.745836 (+ 564us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:51:04.745852 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:51:04.748664 (+ 2812us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.206.254:45657: Server oryx/127.26.206.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":439,"thread_start_us":318,"threads_started":1}
W20260808 14:51:04.749118 5269 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:51:04.740647 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.193:37311 (local address 127.26.206.254:45657)
0808 14:51:04.740873 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0808 14:51:04.740881 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:51:04.741193 (+ 312us) server_negotiation.cc:407] Connection header received
0808 14:51:04.741430 (+ 237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:51:04.741434 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:51:04.741494 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:51:04.741609 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:51:04.742352 (+ 743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:51:04.743115 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:51:04.744464 (+ 1349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:51:04.744928 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:51:04.745065 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:51:04.748880 (+ 3815us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.206.193:37311: BlockingRecv error: recv got EOF from 127.26.206.193:37311 (error 108)
Metrics: {"server-negotiator.queue_time_us":74}
Aug 08 14:51:05 dist-test-slave-6k22 krb5kdc[4412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.206.194@KRBTEST.COM for oryx/127.26.206.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:51:05 dist-test-slave-6k22 krb5kdc[4412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.206.194@KRBTEST.COM for oryx/127.26.206.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:51:05.201100 5615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:51:05.192467 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:45657 (local address 127.26.206.194:38437)
0808 14:51:05.192978 (+ 511us) negotiation.cc:107] Waiting for socket to connect
0808 14:51:05.192994 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 14:51:05.193142 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:51:05.193509 (+ 367us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:51:05.193514 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:51:05.193923 (+ 409us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:51:05.194067 (+ 144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:51:05.194076 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:51:05.195127 (+ 1051us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:51:05.195135 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:51:05.196109 (+ 974us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:51:05.196120 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:51:05.196876 (+ 756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:51:05.196881 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:51:05.197047 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:51:05.197607 (+ 560us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:51:05.197625 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:51:05.200875 (+ 3250us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.206.254:45657: Server oryx/127.26.206.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":420,"thread_start_us":300,"threads_started":1}
W20260808 14:51:05.201337 5269 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:51:05.192561 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.194:38437 (local address 127.26.206.254:45657)
0808 14:51:05.192782 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0808 14:51:05.192791 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:51:05.193079 (+ 288us) server_negotiation.cc:407] Connection header received
0808 14:51:05.193273 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:51:05.193279 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:51:05.193367 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:51:05.193473 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:51:05.194218 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:51:05.194981 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:51:05.196252 (+ 1271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:51:05.196708 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:51:05.196860 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:51:05.201069 (+ 4209us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.206.194:38437: BlockingRecv error: recv got EOF from 127.26.206.194:38437 (error 108)
Metrics: {"server-negotiator.queue_time_us":74}
Aug 08 14:51:05 dist-test-slave-6k22 krb5kdc[4412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.206.195@KRBTEST.COM for oryx/127.26.206.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:51:05 dist-test-slave-6k22 krb5kdc[4412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.206.195@KRBTEST.COM for oryx/127.26.206.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:51:05.677870 5617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:51:05.669039 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:45657 (local address 127.26.206.195:35249)
0808 14:51:05.669659 (+ 620us) negotiation.cc:107] Waiting for socket to connect
0808 14:51:05.669676 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 14:51:05.669860 (+ 184us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:51:05.670209 (+ 349us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:51:05.670213 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:51:05.670671 (+ 458us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:51:05.670815 (+ 144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:51:05.670824 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:51:05.671918 (+ 1094us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:51:05.671923 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:51:05.672928 (+ 1005us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:51:05.672939 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:51:05.673614 (+ 675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:51:05.673620 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:51:05.673800 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:51:05.674403 (+ 603us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:51:05.674429 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:51:05.677559 (+ 3130us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.206.254:45657: Server oryx/127.26.206.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":530,"thread_start_us":379,"threads_started":1}
W20260808 14:51:05.678117 5269 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:51:05.669253 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.195:35249 (local address 127.26.206.254:45657)
0808 14:51:05.669487 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0808 14:51:05.669495 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:51:05.669786 (+ 291us) server_negotiation.cc:407] Connection header received
0808 14:51:05.669989 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:51:05.669998 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:51:05.670076 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:51:05.670174 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:51:05.670989 (+ 815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:51:05.671793 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:51:05.673063 (+ 1270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:51:05.673459 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:51:05.673583 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:51:05.677842 (+ 4259us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.206.195:35249: BlockingRecv error: recv got EOF from 127.26.206.195:35249 (error 108)
Metrics: {"server-negotiator.queue_time_us":77}
Aug 08 14:51:05 dist-test-slave-6k22 krb5kdc[4412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.206.193@KRBTEST.COM for oryx/127.26.206.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:51:05 dist-test-slave-6k22 krb5kdc[4412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.206.193@KRBTEST.COM for oryx/127.26.206.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:51:05.757822 5618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:51:05.749974 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:45657 (local address 127.26.206.193:41797)
0808 14:51:05.750523 (+ 549us) negotiation.cc:107] Waiting for socket to connect
0808 14:51:05.750539 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 14:51:05.750652 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:51:05.750949 (+ 297us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:51:05.750952 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:51:05.751357 (+ 405us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:51:05.751545 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:51:05.751575 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:51:05.752547 (+ 972us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:51:05.752550 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:51:05.753462 (+ 912us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:51:05.753471 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:51:05.754152 (+ 681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:51:05.754156 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:51:05.754285 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:51:05.754854 (+ 569us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:51:05.754870 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:51:05.757578 (+ 2708us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.206.254:45657: Server oryx/127.26.206.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":413,"thread_start_us":294,"threads_started":1}
W20260808 14:51:05.757982 5269 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:51:05.750078 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.193:41797 (local address 127.26.206.254:45657)
0808 14:51:05.750255 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0808 14:51:05.750259 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:51:05.750614 (+ 355us) server_negotiation.cc:407] Connection header received
0808 14:51:05.750746 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:51:05.750750 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:51:05.750821 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:51:05.750900 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:51:05.751702 (+ 802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:51:05.752429 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:51:05.753579 (+ 1150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:51:05.754004 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:51:05.754092 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:51:05.757764 (+ 3672us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.206.193:41797: BlockingRecv error: recv got EOF from 127.26.206.193:41797 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
Aug 08 14:51:06 dist-test-slave-6k22 krb5kdc[4412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.206.194@KRBTEST.COM for oryx/127.26.206.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:51:06 dist-test-slave-6k22 krb5kdc[4412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.206.194@KRBTEST.COM for oryx/127.26.206.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:51:06.210742 5619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:51:06.202116 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:45657 (local address 127.26.206.194:46389)
0808 14:51:06.202621 (+ 505us) negotiation.cc:107] Waiting for socket to connect
0808 14:51:06.202637 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 14:51:06.202794 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:51:06.203120 (+ 326us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:51:06.203126 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:51:06.203637 (+ 511us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:51:06.203816 (+ 179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:51:06.203825 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:51:06.204912 (+ 1087us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:51:06.204917 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:51:06.206246 (+ 1329us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:51:06.206270 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:51:06.207057 (+ 787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:51:06.207061 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:51:06.207182 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:51:06.207808 (+ 626us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:51:06.207825 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:51:06.210508 (+ 2683us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.206.254:45657: Server oryx/127.26.206.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":415,"thread_start_us":272,"threads_started":1}
W20260808 14:51:06.211068 5269 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:51:06.202208 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.194:46389 (local address 127.26.206.254:45657)
0808 14:51:06.202448 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0808 14:51:06.202455 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:51:06.202720 (+ 265us) server_negotiation.cc:407] Connection header received
0808 14:51:06.202913 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:51:06.202918 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:51:06.202985 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:51:06.203085 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:51:06.203997 (+ 912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:51:06.204761 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:51:06.206410 (+ 1649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:51:06.206892 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:51:06.207003 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:51:06.210692 (+ 3689us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.206.194:46389: BlockingRecv error: recv got EOF from 127.26.206.194:46389 (error 108)
Metrics: {"server-negotiator.queue_time_us":74}
Aug 08 14:51:06 dist-test-slave-6k22 krb5kdc[4412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.206.195@KRBTEST.COM for oryx/127.26.206.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:51:06 dist-test-slave-6k22 krb5kdc[4412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.206.195@KRBTEST.COM for oryx/127.26.206.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:51:06.693625 5620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:51:06.679062 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:45657 (local address 127.26.206.195:39297)
0808 14:51:06.679550 (+ 488us) negotiation.cc:107] Waiting for socket to connect
0808 14:51:06.679586 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0808 14:51:06.679709 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:51:06.679992 (+ 283us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:51:06.679995 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:51:06.680400 (+ 405us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:51:06.680589 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:51:06.680598 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:51:06.682035 (+ 1437us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:51:06.682039 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:51:06.682877 (+ 838us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:51:06.682887 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:51:06.683849 (+ 962us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:51:06.683854 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:51:06.683984 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:51:06.690518 (+ 6534us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:51:06.690555 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:51:06.693397 (+ 2842us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.206.254:45657: Server oryx/127.26.206.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":387,"thread_start_us":273,"threads_started":1}
W20260808 14:51:06.693814 5269 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:51:06.679125 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.195:39297 (local address 127.26.206.254:45657)
0808 14:51:06.679367 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0808 14:51:06.679373 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:51:06.679680 (+ 307us) server_negotiation.cc:407] Connection header received
0808 14:51:06.679811 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:51:06.679815 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:51:06.679874 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:51:06.679951 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:51:06.680710 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:51:06.681885 (+ 1175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:51:06.683020 (+ 1135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:51:06.683695 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:51:06.683824 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:51:06.693585 (+ 9761us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.206.195:39297: BlockingRecv error: recv got EOF from 127.26.206.195:39297 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
Aug 08 14:51:06 dist-test-slave-6k22 krb5kdc[4412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.206.193@KRBTEST.COM for oryx/127.26.206.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:51:06 dist-test-slave-6k22 krb5kdc[4412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.206.193@KRBTEST.COM for oryx/127.26.206.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:51:06.768302 5621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:51:06.758953 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:45657 (local address 127.26.206.193:37681)
0808 14:51:06.759861 (+ 908us) negotiation.cc:107] Waiting for socket to connect
0808 14:51:06.759886 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0808 14:51:06.760040 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:51:06.760517 (+ 477us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:51:06.760525 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:51:06.761112 (+ 587us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:51:06.761343 (+ 231us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:51:06.761354 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:51:06.762422 (+ 1068us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:51:06.762426 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:51:06.763853 (+ 1427us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:51:06.763868 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:51:06.764625 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:51:06.764629 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:51:06.764755 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:51:06.765305 (+ 550us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:51:06.765321 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:51:06.768074 (+ 2753us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.206.254:45657: Server oryx/127.26.206.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":745,"thread_start_us":945,"threads_started":1}
W20260808 14:51:06.768482 5269 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:51:06.760015 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.193:37681 (local address 127.26.206.254:45657)
0808 14:51:06.760229 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0808 14:51:06.760235 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:51:06.760252 (+ 17us) server_negotiation.cc:407] Connection header received
0808 14:51:06.760307 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:51:06.760311 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:51:06.760368 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:51:06.760477 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:51:06.761478 (+ 1001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:51:06.762299 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:51:06.764003 (+ 1704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:51:06.764450 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:51:06.764561 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:51:06.768252 (+ 3691us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.206.193:37681: BlockingRecv error: recv got EOF from 127.26.206.193:37681 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
Aug 08 14:51:07 dist-test-slave-6k22 krb5kdc[4412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.206.194@KRBTEST.COM for oryx/127.26.206.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:51:07 dist-test-slave-6k22 krb5kdc[4412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.206.194@KRBTEST.COM for oryx/127.26.206.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:51:07.219699 5623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:51:07.211618 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:45657 (local address 127.26.206.194:52947)
0808 14:51:07.212134 (+ 516us) negotiation.cc:107] Waiting for socket to connect
0808 14:51:07.212150 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 14:51:07.212310 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:51:07.212598 (+ 288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:51:07.212601 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:51:07.213072 (+ 471us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:51:07.213227 (+ 155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:51:07.213235 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:51:07.214214 (+ 979us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:51:07.214218 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:51:07.215126 (+ 908us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:51:07.215137 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:51:07.215895 (+ 758us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:51:07.215899 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:51:07.216038 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:51:07.216677 (+ 639us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:51:07.216694 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:51:07.219407 (+ 2713us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.206.254:45657: Server oryx/127.26.206.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":424,"thread_start_us":294,"threads_started":1}
W20260808 14:51:07.219856 5269 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:51:07.211707 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.194:52947 (local address 127.26.206.254:45657)
0808 14:51:07.211959 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0808 14:51:07.211967 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:51:07.212258 (+ 291us) server_negotiation.cc:407] Connection header received
0808 14:51:07.212411 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:51:07.212414 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:51:07.212473 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:51:07.212552 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:51:07.213354 (+ 802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:51:07.214071 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:51:07.215243 (+ 1172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:51:07.215767 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:51:07.215867 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:51:07.219642 (+ 3775us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.206.194:52947: BlockingRecv error: recv got EOF from 127.26.206.194:52947 (error 108)
Metrics: {"server-negotiator.queue_time_us":77}
Aug 08 14:51:07 dist-test-slave-6k22 krb5kdc[4412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.206.195@KRBTEST.COM for oryx/127.26.206.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:51:07 dist-test-slave-6k22 krb5kdc[4412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.206.195@KRBTEST.COM for oryx/127.26.206.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:51:07.702477 5624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:51:07.694712 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:45657 (local address 127.26.206.195:48867)
0808 14:51:07.695258 (+ 546us) negotiation.cc:107] Waiting for socket to connect
0808 14:51:07.695274 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 14:51:07.695385 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:51:07.695687 (+ 302us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:51:07.695691 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:51:07.696075 (+ 384us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:51:07.696226 (+ 151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:51:07.696234 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:51:07.697182 (+ 948us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:51:07.697185 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:51:07.698091 (+ 906us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:51:07.698101 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:51:07.698743 (+ 642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:51:07.698746 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:51:07.698879 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:51:07.699458 (+ 579us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:51:07.699474 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:51:07.702253 (+ 2779us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.206.254:45657: Server oryx/127.26.206.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":414,"thread_start_us":285,"threads_started":1}
W20260808 14:51:07.702698 5269 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:51:07.694798 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.195:48867 (local address 127.26.206.254:45657)
0808 14:51:07.695038 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0808 14:51:07.695046 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:51:07.695339 (+ 293us) server_negotiation.cc:407] Connection header received
0808 14:51:07.695468 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:51:07.695472 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:51:07.695532 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:51:07.695622 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:51:07.696352 (+ 730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:51:07.697061 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:51:07.698220 (+ 1159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:51:07.698624 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:51:07.698722 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:51:07.702439 (+ 3717us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.206.195:48867: BlockingRecv error: recv got EOF from 127.26.206.195:48867 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
Aug 08 14:51:07 dist-test-slave-6k22 krb5kdc[4412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.206.193@KRBTEST.COM for oryx/127.26.206.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:51:07 dist-test-slave-6k22 krb5kdc[4412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.206.193@KRBTEST.COM for oryx/127.26.206.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:51:07.778542 5625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:51:07.769490 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:45657 (local address 127.26.206.193:55151)
0808 14:51:07.770113 (+ 623us) negotiation.cc:107] Waiting for socket to connect
0808 14:51:07.770130 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 14:51:07.770245 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:51:07.770542 (+ 297us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:51:07.770545 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:51:07.771125 (+ 580us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:51:07.771320 (+ 195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:51:07.771329 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:51:07.772537 (+ 1208us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:51:07.772541 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:51:07.773433 (+ 892us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:51:07.773444 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:51:07.774142 (+ 698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:51:07.774146 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:51:07.774262 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:51:07.774845 (+ 583us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:51:07.774862 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:51:07.778190 (+ 3328us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.206.254:45657: Server oryx/127.26.206.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":503,"thread_start_us":347,"threads_started":1}
W20260808 14:51:07.778978 5269 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:51:07.769566 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.193:55151 (local address 127.26.206.254:45657)
0808 14:51:07.769872 (+ 306us) server_negotiation.cc:206] Beginning negotiation
0808 14:51:07.769879 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:51:07.770212 (+ 333us) server_negotiation.cc:407] Connection header received
0808 14:51:07.770357 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:51:07.770361 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:51:07.770423 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:51:07.770499 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:51:07.771496 (+ 997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:51:07.772386 (+ 890us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:51:07.773567 (+ 1181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:51:07.774014 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:51:07.774116 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:51:07.778648 (+ 4532us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.206.193:55151: BlockingRecv error: recv got EOF from 127.26.206.193:55151 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
Aug 08 14:51:08 dist-test-slave-6k22 krb5kdc[4412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.206.194@KRBTEST.COM for oryx/127.26.206.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:51:08 dist-test-slave-6k22 krb5kdc[4412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.206.194@KRBTEST.COM for oryx/127.26.206.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:51:08.230363 5626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:51:08.220803 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:45657 (local address 127.26.206.194:43751)
0808 14:51:08.221428 (+ 625us) negotiation.cc:107] Waiting for socket to connect
0808 14:51:08.221447 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 14:51:08.221619 (+ 172us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:51:08.222060 (+ 441us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:51:08.222066 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:51:08.222555 (+ 489us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:51:08.222745 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:51:08.222755 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:51:08.223935 (+ 1180us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:51:08.223942 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:51:08.225053 (+ 1111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:51:08.225068 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:51:08.225958 (+ 890us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:51:08.225966 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:51:08.226165 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:51:08.226862 (+ 697us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:51:08.226880 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:51:08.229973 (+ 3093us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.206.254:45657: Server oryx/127.26.206.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":488,"thread_start_us":322,"threads_started":1}
W20260808 14:51:08.230479 5269 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:51:08.221032 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.194:43751 (local address 127.26.206.254:45657)
0808 14:51:08.221313 (+ 281us) server_negotiation.cc:206] Beginning negotiation
0808 14:51:08.221320 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:51:08.221544 (+ 224us) server_negotiation.cc:407] Connection header received
0808 14:51:08.221807 (+ 263us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:51:08.221813 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:51:08.221895 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:51:08.222025 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:51:08.222909 (+ 884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:51:08.223789 (+ 880us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:51:08.225224 (+ 1435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:51:08.225751 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:51:08.225897 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:51:08.230196 (+ 4299us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.206.194:43751: BlockingRecv error: recv got EOF from 127.26.206.194:43751 (error 108)
Metrics: {"server-negotiator.queue_time_us":92}
Aug 08 14:51:08 dist-test-slave-6k22 krb5kdc[4412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.206.195@KRBTEST.COM for oryx/127.26.206.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:51:08 dist-test-slave-6k22 krb5kdc[4412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.206.195@KRBTEST.COM for oryx/127.26.206.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:51:08.712034 5627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:51:08.703402 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:45657 (local address 127.26.206.195:46005)
0808 14:51:08.703972 (+ 570us) negotiation.cc:107] Waiting for socket to connect
0808 14:51:08.703988 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 14:51:08.704098 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:51:08.704415 (+ 317us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:51:08.704419 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:51:08.704833 (+ 414us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:51:08.704991 (+ 158us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:51:08.704999 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:51:08.706105 (+ 1106us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:51:08.706108 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:51:08.707039 (+ 931us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:51:08.707050 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:51:08.707867 (+ 817us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:51:08.707871 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:51:08.707989 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:51:08.708553 (+ 564us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:51:08.708570 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:51:08.711675 (+ 3105us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.206.254:45657: Server oryx/127.26.206.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":474,"thread_start_us":329,"threads_started":1}
W20260808 14:51:08.712111 5269 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:51:08.703510 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.195:46005 (local address 127.26.206.254:45657)
0808 14:51:08.703801 (+ 291us) server_negotiation.cc:206] Beginning negotiation
0808 14:51:08.703808 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:51:08.704072 (+ 264us) server_negotiation.cc:407] Connection header received
0808 14:51:08.704221 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:51:08.704225 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:51:08.704291 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:51:08.704375 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:51:08.705120 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:51:08.705982 (+ 862us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:51:08.707270 (+ 1288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:51:08.707695 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:51:08.707794 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:51:08.711864 (+ 4070us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.206.195:46005: BlockingRecv error: recv got EOF from 127.26.206.195:46005 (error 108)
Metrics: {"server-negotiator.queue_time_us":126}
Aug 08 14:51:08 dist-test-slave-6k22 krb5kdc[4412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.206.193@KRBTEST.COM for oryx/127.26.206.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:51:08 dist-test-slave-6k22 krb5kdc[4412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.206.193@KRBTEST.COM for oryx/127.26.206.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:51:08.788048 5628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:51:08.779521 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:45657 (local address 127.26.206.193:34701)
0808 14:51:08.780131 (+ 610us) negotiation.cc:107] Waiting for socket to connect
0808 14:51:08.780147 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 14:51:08.780265 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:51:08.780575 (+ 310us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:51:08.780578 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:51:08.780949 (+ 371us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:51:08.781131 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:51:08.781140 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:51:08.782068 (+ 928us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:51:08.782071 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:51:08.783073 (+ 1002us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:51:08.783088 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:51:08.784028 (+ 940us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:51:08.784035 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:51:08.784232 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:51:08.784930 (+ 698us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:51:08.784947 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:51:08.787687 (+ 2740us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.206.254:45657: Server oryx/127.26.206.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":484,"thread_start_us":316,"threads_started":1}
W20260808 14:51:08.788116 5269 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:51:08.779634 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.193:34701 (local address 127.26.206.254:45657)
0808 14:51:08.779917 (+ 283us) server_negotiation.cc:206] Beginning negotiation
0808 14:51:08.779922 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:51:08.780223 (+ 301us) server_negotiation.cc:407] Connection header received
0808 14:51:08.780363 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:51:08.780366 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:51:08.780447 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:51:08.780532 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:51:08.781254 (+ 722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:51:08.781956 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:51:08.783224 (+ 1268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:51:08.783839 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:51:08.783975 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:51:08.787881 (+ 3906us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.206.193:34701: BlockingRecv error: recv got EOF from 127.26.206.193:34701 (error 108)
Metrics: {"server-negotiator.queue_time_us":171}
Aug 08 14:51:09 dist-test-slave-6k22 krb5kdc[4412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.206.194@KRBTEST.COM for oryx/127.26.206.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:51:09 dist-test-slave-6k22 krb5kdc[4412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.206.194@KRBTEST.COM for oryx/127.26.206.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:51:09.240028 5629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:51:09.231379 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:45657 (local address 127.26.206.194:48349)
0808 14:51:09.231906 (+ 527us) negotiation.cc:107] Waiting for socket to connect
0808 14:51:09.231922 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 14:51:09.232070 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:51:09.232345 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:51:09.232349 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:51:09.232808 (+ 459us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:51:09.233050 (+ 242us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:51:09.233061 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:51:09.234187 (+ 1126us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:51:09.234193 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:51:09.235117 (+ 924us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:51:09.235128 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:51:09.236003 (+ 875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:51:09.236009 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:51:09.236190 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:51:09.236851 (+ 661us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:51:09.236869 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:51:09.239661 (+ 2792us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.206.254:45657: Server oryx/127.26.206.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":423,"thread_start_us":311,"threads_started":1}
W20260808 14:51:09.240125 5269 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:51:09.231427 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.194:48349 (local address 127.26.206.254:45657)
0808 14:51:09.231708 (+ 281us) server_negotiation.cc:206] Beginning negotiation
0808 14:51:09.231716 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:51:09.232023 (+ 307us) server_negotiation.cc:407] Connection header received
0808 14:51:09.232164 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:51:09.232167 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:51:09.232228 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:51:09.232305 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:51:09.233161 (+ 856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:51:09.234034 (+ 873us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:51:09.235255 (+ 1221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:51:09.235853 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:51:09.235992 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:51:09.239878 (+ 3886us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.206.194:48349: BlockingRecv error: recv got EOF from 127.26.206.194:48349 (error 108)
Metrics: {"server-negotiator.queue_time_us":78}
Aug 08 14:51:09 dist-test-slave-6k22 krb5kdc[4412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.206.195@KRBTEST.COM for oryx/127.26.206.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:51:09 dist-test-slave-6k22 krb5kdc[4412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.206.195@KRBTEST.COM for oryx/127.26.206.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:51:09.721154 5630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:51:09.712999 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:45657 (local address 127.26.206.195:40695)
0808 14:51:09.713534 (+ 535us) negotiation.cc:107] Waiting for socket to connect
0808 14:51:09.713550 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 14:51:09.713659 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:51:09.713970 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:51:09.713973 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:51:09.714347 (+ 374us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:51:09.714529 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:51:09.714536 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:51:09.715502 (+ 966us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:51:09.715505 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:51:09.716410 (+ 905us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:51:09.716420 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:51:09.717069 (+ 649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:51:09.717073 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:51:09.717185 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:51:09.717757 (+ 572us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:51:09.717773 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:51:09.720907 (+ 3134us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.206.254:45657: Server oryx/127.26.206.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":423,"thread_start_us":292,"threads_started":1}
W20260808 14:51:09.721423 5269 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:51:09.713144 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.195:40695 (local address 127.26.206.254:45657)
0808 14:51:09.713334 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0808 14:51:09.713338 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:51:09.713625 (+ 287us) server_negotiation.cc:407] Connection header received
0808 14:51:09.713755 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:51:09.713770 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:51:09.713831 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:51:09.713914 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:51:09.714648 (+ 734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:51:09.715384 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:51:09.716526 (+ 1142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:51:09.716952 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:51:09.717044 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:51:09.721099 (+ 4055us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.206.195:40695: BlockingRecv error: recv got EOF from 127.26.206.195:40695 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
Aug 08 14:51:09 dist-test-slave-6k22 krb5kdc[4412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.206.193@KRBTEST.COM for oryx/127.26.206.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:51:09 dist-test-slave-6k22 krb5kdc[4412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.206.193@KRBTEST.COM for oryx/127.26.206.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:51:09.797674 5631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:51:09.789419 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:45657 (local address 127.26.206.193:42381)
0808 14:51:09.790073 (+ 654us) negotiation.cc:107] Waiting for socket to connect
0808 14:51:09.790093 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 14:51:09.790233 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:51:09.790638 (+ 405us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:51:09.790642 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:51:09.791168 (+ 526us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:51:09.791345 (+ 177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:51:09.791354 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:51:09.792325 (+ 971us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:51:09.792329 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:51:09.793253 (+ 924us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:51:09.793263 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:51:09.793922 (+ 659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:51:09.793927 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:51:09.794040 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:51:09.794580 (+ 540us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:51:09.794596 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:51:09.797420 (+ 2824us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.206.254:45657: Server oryx/127.26.206.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":516,"thread_start_us":338,"threads_started":1}
W20260808 14:51:09.797992 5269 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:51:09.789518 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.193:42381 (local address 127.26.206.254:45657)
0808 14:51:09.789725 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0808 14:51:09.789733 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:51:09.790181 (+ 448us) server_negotiation.cc:407] Connection header received
0808 14:51:09.790357 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:51:09.790362 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:51:09.790449 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:51:09.790549 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:51:09.791473 (+ 924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:51:09.792194 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:51:09.793370 (+ 1176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:51:09.793785 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:51:09.793876 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:51:09.797629 (+ 3753us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.206.193:42381: BlockingRecv error: recv got EOF from 127.26.206.193:42381 (error 108)
Metrics: {"server-negotiator.queue_time_us":72}
Aug 08 14:51:10 dist-test-slave-6k22 krb5kdc[4412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.206.194@KRBTEST.COM for oryx/127.26.206.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:51:10 dist-test-slave-6k22 krb5kdc[4412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.206.194@KRBTEST.COM for oryx/127.26.206.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:51:10.249048 5632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:51:10.241088 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:45657 (local address 127.26.206.194:44475)
0808 14:51:10.241555 (+ 467us) negotiation.cc:107] Waiting for socket to connect
0808 14:51:10.241573 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 14:51:10.241681 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:51:10.241963 (+ 282us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:51:10.241967 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:51:10.242364 (+ 397us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:51:10.242528 (+ 164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:51:10.242537 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:51:10.243483 (+ 946us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:51:10.243486 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:51:10.244442 (+ 956us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:51:10.244454 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:51:10.245082 (+ 628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:51:10.245086 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:51:10.245195 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:51:10.245737 (+ 542us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:51:10.245753 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:51:10.248694 (+ 2941us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.206.254:45657: Server oryx/127.26.206.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":364,"thread_start_us":267,"threads_started":1}
W20260808 14:51:10.249301 5269 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:51:10.241225 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.194:44475 (local address 127.26.206.254:45657)
0808 14:51:10.241482 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0808 14:51:10.241488 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:51:10.241653 (+ 165us) server_negotiation.cc:407] Connection header received
0808 14:51:10.241778 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:51:10.241781 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:51:10.241841 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:51:10.241920 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:51:10.242649 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:51:10.243362 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:51:10.244563 (+ 1201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:51:10.244968 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:51:10.245057 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:51:10.248939 (+ 3882us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.206.194:44475: BlockingRecv error: recv got EOF from 127.26.206.194:44475 (error 108)
Metrics: {"server-negotiator.queue_time_us":90}
I20260808 14:51:10.542150 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 5093
I20260808 14:51:10.554428 5634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:51:10.543173 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38030 (local address 127.26.206.193:44583)
0808 14:51:10.543825 (+ 652us) server_negotiation.cc:206] Beginning negotiation
0808 14:51:10.543832 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:51:10.543857 (+ 25us) server_negotiation.cc:407] Connection header received
0808 14:51:10.543923 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:51:10.543929 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:51:10.544149 (+ 220us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:51:10.544303 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:51:10.545673 (+ 1370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:51:10.546681 (+ 1008us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:51:10.547955 (+ 1274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:51:10.548517 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:51:10.548673 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:51:10.551260 (+ 2587us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:51:10.551268 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:51:10.551287 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:51:10.551315 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:51:10.553720 (+ 2405us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.26.206.193@KRBTEST.COM not found in keytab (ticket kvno 2)
0808 14:51:10.554053 (+ 333us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:38030: Request ticket server kudu/127.26.206.193@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":481,"thread_start_us":331,"threads_started":1}
W20260808 14:51:10.554562 5634 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:38030: Request ticket server kudu/127.26.206.193@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260808 14:51:10.554620 27451 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 5093: Not authorized: Client connection negotiation failed: client connection to 127.26.206.193:44583: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.26.206.193@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260808 14:51:10.554824 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 5093
I20260808 14:51:10.576213 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 5268
I20260808 14:51:10.588280 5635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:51:10.577246 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51942 (local address 127.26.206.194:45175)
0808 14:51:10.578020 (+ 774us) server_negotiation.cc:206] Beginning negotiation
0808 14:51:10.578027 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:51:10.578058 (+ 31us) server_negotiation.cc:407] Connection header received
0808 14:51:10.578118 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:51:10.578125 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:51:10.578356 (+ 231us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:51:10.578551 (+ 195us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:51:10.579957 (+ 1406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:51:10.580992 (+ 1035us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:51:10.582157 (+ 1165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:51:10.582692 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:51:10.582807 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:51:10.585179 (+ 2372us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:51:10.585187 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:51:10.585199 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:51:10.585231 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:51:10.587797 (+ 2566us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.26.206.194@KRBTEST.COM not found in keytab (ticket kvno 2)
0808 14:51:10.588025 (+ 228us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:51942: Request ticket server kudu/127.26.206.194@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":620,"thread_start_us":459,"threads_started":1}
W20260808 14:51:10.588383 5635 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:51942: Request ticket server kudu/127.26.206.194@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260808 14:51:10.588418 27451 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 5268: Not authorized: Client connection negotiation failed: client connection to 127.26.206.194:45175: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.26.206.194@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260808 14:51:10.588611 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 5268
I20260808 14:51:10.608006 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 5422
I20260808 14:51:10.619663 5636 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:51:10.608830 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45278 (local address 127.26.206.195:44177)
0808 14:51:10.609492 (+ 662us) server_negotiation.cc:206] Beginning negotiation
0808 14:51:10.609517 (+ 25us) server_negotiation.cc:399] Waiting for connection header
0808 14:51:10.609543 (+ 26us) server_negotiation.cc:407] Connection header received
0808 14:51:10.609603 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:51:10.609610 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:51:10.609829 (+ 219us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:51:10.609974 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:51:10.611243 (+ 1269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:51:10.612312 (+ 1069us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:51:10.613425 (+ 1113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:51:10.613928 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:51:10.614023 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:51:10.616475 (+ 2452us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:51:10.616483 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:51:10.616496 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:51:10.616534 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:51:10.619082 (+ 2548us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.26.206.195@KRBTEST.COM not found in keytab (ticket kvno 2)
0808 14:51:10.619343 (+ 261us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:45278: Request ticket server kudu/127.26.206.195@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":528,"thread_start_us":381,"threads_started":1}
W20260808 14:51:10.619717 27451 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 5422: Not authorized: Client connection negotiation failed: client connection to 127.26.206.195:44177: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.26.206.195@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260808 14:51:10.619772 5636 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:45278: Request ticket server kudu/127.26.206.195@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260808 14:51:10.619899 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 5422
I20260808 14:51:10.640048 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 5012
I20260808 14:51:10.641292 5083 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:51:10.761023 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 5012
2026-08-08T14:51:10Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (21279 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-08T14:51:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:51:10Z Disabled control of system clock
I20260808 14:51:10.852052 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200577490656-27451-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200577490656-27451-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200577490656-27451-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.206.254:38227
--webserver_interface=127.26.206.254
--webserver_port=0
--builtin_ntp_servers=127.26.206.212:42329
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.206.254:38227
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260808 14:51:11.190652 5641 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:51:11.190934 5641 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:51:11.191015 5641 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:51:11.198072 5641 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:51:11.198176 5641 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:51:11.198215 5641 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:51:11.198271 5641 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:51:11.198307 5641 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:51:11.207105 5641 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:42329
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200577490656-27451-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200577490656-27451-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.206.254:38227
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.206.254:38227
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.206.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200577490656-27451-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:51:11.208292 5641 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:51:11.210124 5641 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:51:11.221858 5651 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:51:11.221868 5649 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:51:11.221978 5647 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:51:11.222436 5641 server_base.cc:1034] running on GCE node
I20260808 14:51:11.223181 5641 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:51:11.224532 5641 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:51:11.225775 5641 hybrid_clock.cc:648] HybridClock initialized: now 1786200671225736 us; error 48 us; skew 500 ppm
I20260808 14:51:11.226135 5641 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 14:51:11.228333 5641 webserver.cc:460] Webserver started at http://127.26.206.254:42237/ using document root <none> and password file <none>
I20260808 14:51:11.229001 5641 fs_manager.cc:359] Metadata directory not provided
I20260808 14:51:11.229132 5641 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:51:11.229476 5641 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:51:11.232398 5641 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200577490656-27451-0/minicluster-data/master-0/data/instance:
uuid: "2d83e69590744a5984b1f245118c892a"
format_stamp: "Formatted at 2026-08-08 14:51:11 on dist-test-slave-6k22"
server_key: "511c861ecffde1215ebfc419b6df002f"
server_key_iv: "857a3e25edfd9ffccdbba275f2e67740"
server_key_version: "encryptionkey@0"
I20260808 14:51:11.233214 5641 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200577490656-27451-0/minicluster-data/master-0/wal/instance:
uuid: "2d83e69590744a5984b1f245118c892a"
format_stamp: "Formatted at 2026-08-08 14:51:11 on dist-test-slave-6k22"
server_key: "511c861ecffde1215ebfc419b6df002f"
server_key_iv: "857a3e25edfd9ffccdbba275f2e67740"
server_key_version: "encryptionkey@0"
I20260808 14:51:11.238272 5641 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260808 14:51:11.241808 5659 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:51:11.243058 5641 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.001s
I20260808 14:51:11.243232 5641 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200577490656-27451-0/minicluster-data/master-0/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200577490656-27451-0/minicluster-data/master-0/wal
uuid: "2d83e69590744a5984b1f245118c892a"
format_stamp: "Formatted at 2026-08-08 14:51:11 on dist-test-slave-6k22"
server_key: "511c861ecffde1215ebfc419b6df002f"
server_key_iv: "857a3e25edfd9ffccdbba275f2e67740"
server_key_version: "encryptionkey@0"
I20260808 14:51:11.243449 5641 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200577490656-27451-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200577490656-27451-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200577490656-27451-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:51:11.264039 5641 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:51:11.264827 5641 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:51:11.265095 5641 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:51:11.283232 5641 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.254:38227
I20260808 14:51:11.283278 5714 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.254:38227 every 8 connection(s)
I20260808 14:51:11.284577 5641 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
I20260808 14:51:11.286047 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 5641
I20260808 14:51:11.286273 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200577490656-27451-0/minicluster-data/master-0/wal/instance
I20260808 14:51:11.287142 27451 external_mini_cluster.cc:1428] Setting key 7b36ac34e5d7cb0b7495ee339cf52a05
I20260808 14:51:11.289343 5715 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:51:11.301388 5718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:51:11.289239 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51798 (local address 127.26.206.254:38227)
0808 14:51:11.290212 (+ 973us) server_negotiation.cc:206] Beginning negotiation
0808 14:51:11.290222 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 14:51:11.290262 (+ 40us) server_negotiation.cc:407] Connection header received
0808 14:51:11.291850 (+ 1588us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:51:11.291870 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:51:11.292318 (+ 448us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:51:11.292688 (+ 370us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:51:11.293259 (+ 571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:51:11.294876 (+ 1617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:51:11.296400 (+ 1524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:51:11.297082 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:51:11.297305 (+ 223us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:51:11.298622 (+ 1317us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:51:11.298630 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:51:11.298682 (+ 52us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:51:11.299291 (+ 609us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:51:11.299372 (+ 81us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:51:11.299395 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:51:11.299530 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0808 14:51:11.299807 (+ 277us) server_negotiation.cc:299] Negotiation successful
0808 14:51:11.300139 (+ 332us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":607,"thread_start_us":398,"threads_started":1}
I20260808 14:51:11.301446 5715 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2d83e69590744a5984b1f245118c892a: Bootstrap starting.
I20260808 14:51:11.304634 5715 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2d83e69590744a5984b1f245118c892a: Neither blocks nor log segments found. Creating new log.
I20260808 14:51:11.305510 5715 log.cc:824] T 00000000000000000000000000000000 P 2d83e69590744a5984b1f245118c892a: Log is configured to *not* fsync() on all Append() calls
I20260808 14:51:11.308188 5715 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2d83e69590744a5984b1f245118c892a: No bootstrap required, opened a new log
I20260808 14:51:11.315002 5715 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2d83e69590744a5984b1f245118c892a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d83e69590744a5984b1f245118c892a" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 38227 } }
I20260808 14:51:11.315359 5715 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2d83e69590744a5984b1f245118c892a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:51:11.315462 5715 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2d83e69590744a5984b1f245118c892a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d83e69590744a5984b1f245118c892a, State: Initialized, Role: FOLLOWER
I20260808 14:51:11.315973 5715 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2d83e69590744a5984b1f245118c892a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d83e69590744a5984b1f245118c892a" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 38227 } }
I20260808 14:51:11.316200 5715 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2d83e69590744a5984b1f245118c892a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:51:11.316336 5715 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2d83e69590744a5984b1f245118c892a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:51:11.316494 5715 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2d83e69590744a5984b1f245118c892a [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:51:11.318415 5715 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2d83e69590744a5984b1f245118c892a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d83e69590744a5984b1f245118c892a" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 38227 } }
I20260808 14:51:11.318913 5715 leader_election.cc:302] T 00000000000000000000000000000000 P 2d83e69590744a5984b1f245118c892a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2d83e69590744a5984b1f245118c892a; no voters:
I20260808 14:51:11.319437 5715 leader_election.cc:288] T 00000000000000000000000000000000 P 2d83e69590744a5984b1f245118c892a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:51:11.319593 5720 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2d83e69590744a5984b1f245118c892a [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:51:11.320333 5720 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2d83e69590744a5984b1f245118c892a [term 1 LEADER]: Becoming Leader. State: Replica: 2d83e69590744a5984b1f245118c892a, State: Running, Role: LEADER
I20260808 14:51:11.320899 5720 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2d83e69590744a5984b1f245118c892a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d83e69590744a5984b1f245118c892a" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 38227 } }
I20260808 14:51:11.321617 5715 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2d83e69590744a5984b1f245118c892a [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:51:11.323958 5721 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2d83e69590744a5984b1f245118c892a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2d83e69590744a5984b1f245118c892a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d83e69590744a5984b1f245118c892a" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 38227 } } }
I20260808 14:51:11.324414 5721 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2d83e69590744a5984b1f245118c892a [sys.catalog]: This master's current role is: LEADER
I20260808 14:51:11.324421 5722 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2d83e69590744a5984b1f245118c892a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2d83e69590744a5984b1f245118c892a. Latest consensus state: current_term: 1 leader_uuid: "2d83e69590744a5984b1f245118c892a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d83e69590744a5984b1f245118c892a" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 38227 } } }
I20260808 14:51:11.325234 5722 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2d83e69590744a5984b1f245118c892a [sys.catalog]: This master's current role is: LEADER
I20260808 14:51:11.328811 5729 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:51:11.333737 5729 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:51:11.342481 5729 catalog_manager.cc:1347] Generated new cluster ID: 74ad8ac8d4754fee8d7f1c77a40bba01
I20260808 14:51:11.342593 5729 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:51:11.372610 5729 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:51:11.373833 5729 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:51:11.386601 5729 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2d83e69590744a5984b1f245118c892a: Generated new TSK 0
I20260808 14:51:11.387421 5729 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:51:11.396397 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200577490656-27451-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200577490656-27451-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200577490656-27451-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200577490656-27451-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.206.193:0
--local_ip_for_outbound_sockets=127.26.206.193
--webserver_interface=127.26.206.193
--webserver_port=0
--tserver_master_addrs=127.26.206.254:38227
--builtin_ntp_servers=127.26.206.212:42329
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260808 14:51:11.731541 5742 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:51:11.731875 5742 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:51:11.732041 5742 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:51:11.738979 5742 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:51:11.739069 5742 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:51:11.739234 5742 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.206.193
I20260808 14:51:11.748276 5742 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:42329
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200577490656-27451-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200577490656-27451-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.206.193:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200577490656-27451-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.206.193
--webserver_port=0
--tserver_master_addrs=127.26.206.254:38227
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.206.193
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200577490656-27451-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:51:11.749513 5742 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:51:11.751312 5742 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:51:11.764061 5747 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:51:11.764153 5750 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:51:11.764590 5748 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:51:11.765349 5742 server_base.cc:1034] running on GCE node
I20260808 14:51:11.766034 5742 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:51:11.767340 5742 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:51:11.768576 5742 hybrid_clock.cc:648] HybridClock initialized: now 1786200671768511 us; error 54 us; skew 500 ppm
I20260808 14:51:11.769028 5742 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 14:51:11.777284 5742 webserver.cc:460] Webserver started at http://127.26.206.193:46661/ using document root <none> and password file <none>
I20260808 14:51:11.777926 5742 fs_manager.cc:359] Metadata directory not provided
I20260808 14:51:11.778012 5742 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:51:11.778304 5742 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:51:11.781261 5742 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200577490656-27451-0/minicluster-data/ts-0/data/instance:
uuid: "f2ce5ad0868940e7bb7762fcd349eb28"
format_stamp: "Formatted at 2026-08-08 14:51:11 on dist-test-slave-6k22"
server_key: "6da88fd4c4e8bf6bda033ef697413423"
server_key_iv: "a1bea1adbf9be892e4fa7a13b324f5b7"
server_key_version: "encryptionkey@0"
I20260808 14:51:11.781991 5742 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200577490656-27451-0/minicluster-data/ts-0/wal/instance:
uuid: "f2ce5ad0868940e7bb7762fcd349eb28"
format_stamp: "Formatted at 2026-08-08 14:51:11 on dist-test-slave-6k22"
server_key: "6da88fd4c4e8bf6bda033ef697413423"
server_key_iv: "a1bea1adbf9be892e4fa7a13b324f5b7"
server_key_version: "encryptionkey@0"
I20260808 14:51:11.787065 5742 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260808 14:51:11.790385 5756 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:51:11.791687 5742 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 14:51:11.791852 5742 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200577490656-27451-0/minicluster-data/ts-0/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200577490656-27451-0/minicluster-data/ts-0/wal
uuid: "f2ce5ad0868940e7bb7762fcd349eb28"
format_stamp: "Formatted at 2026-08-08 14:51:11 on dist-test-slave-6k22"
server_key: "6da88fd4c4e8bf6bda033ef697413423"
server_key_iv: "a1bea1adbf9be892e4fa7a13b324f5b7"
server_key_version: "encryptionkey@0"
I20260808 14:51:11.792054 5742 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200577490656-27451-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200577490656-27451-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200577490656-27451-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:51:11.814271 5742 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:51:11.815088 5742 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:51:11.815414 5742 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:51:11.816340 5742 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:51:11.817706 5742 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:51:11.817823 5742 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:51:11.817932 5742 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:51:11.818012 5742 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:51:11.850852 5742 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.193:35199
I20260808 14:51:11.850939 5892 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.193:35199 every 8 connection(s)
I20260808 14:51:11.852181 5742 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200577490656-27451-0/minicluster-data/ts-0/data/info.pb
I20260808 14:51:11.854111 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 5742
I20260808 14:51:11.854337 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200577490656-27451-0/minicluster-data/ts-0/wal/instance
I20260808 14:51:11.855119 27451 external_mini_cluster.cc:1428] Setting key 4782a5feeec29541f02914dcbd6b1e09
I20260808 14:51:11.857796 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200577490656-27451-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200577490656-27451-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200577490656-27451-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200577490656-27451-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.206.194:0
--local_ip_for_outbound_sockets=127.26.206.194
--webserver_interface=127.26.206.194
--webserver_port=0
--tserver_master_addrs=127.26.206.254:38227
--builtin_ntp_servers=127.26.206.212:42329
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260808 14:51:11.864696 5895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:51:11.854732 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.193:53699 (local address 127.26.206.254:38227)
0808 14:51:11.855235 (+ 503us) server_negotiation.cc:206] Beginning negotiation
0808 14:51:11.855241 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:51:11.856611 (+ 1370us) server_negotiation.cc:407] Connection header received
0808 14:51:11.858427 (+ 1816us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:51:11.858432 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:51:11.858522 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:51:11.858643 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:51:11.859687 (+ 1044us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:51:11.860403 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:51:11.861929 (+ 1526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:51:11.862354 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:51:11.862484 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:51:11.863864 (+ 1380us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:51:11.863870 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:51:11.863875 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:51:11.863898 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:51:11.863937 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:51:11.863949 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:51:11.864043 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0808 14:51:11.864271 (+ 228us) server_negotiation.cc:299] Negotiation successful
0808 14:51:11.864364 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":360,"thread_start_us":232,"threads_started":1}
I20260808 14:51:11.865633 5896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:51:11.855391 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:38227 (local address 127.26.206.193:53699)
0808 14:51:11.856443 (+ 1052us) negotiation.cc:107] Waiting for socket to connect
0808 14:51:11.856496 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0808 14:51:11.858165 (+ 1669us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:51:11.858875 (+ 710us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:51:11.858883 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:51:11.858972 (+ 89us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:51:11.859498 (+ 526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:51:11.859515 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:51:11.860560 (+ 1045us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:51:11.860570 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:51:11.861780 (+ 1210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:51:11.861791 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:51:11.862569 (+ 778us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:51:11.862577 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:51:11.862802 (+ 225us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:51:11.863496 (+ 694us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 14:51:11.863499 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:51:11.863537 (+ 38us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 14:51:11.863659 (+ 122us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:51:11.864042 (+ 383us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:51:11.864054 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:51:11.864064 (+ 10us) client_negotiation.cc:769] Sending connection context
0808 14:51:11.864232 (+ 168us) client_negotiation.cc:240] Negotiation successful
0808 14:51:11.864605 (+ 373us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":545,"thread_start_us":371,"threads_started":1}
I20260808 14:51:11.867167 5893 heartbeater.cc:347] Connected to a master server at 127.26.206.254:38227
I20260808 14:51:11.867498 5893 heartbeater.cc:464] Registering TS with master...
I20260808 14:51:11.868206 5893 heartbeater.cc:511] Master 127.26.206.254:38227 requested a full tablet report, sending...
I20260808 14:51:11.870131 5678 ts_manager.cc:194] Registered new tserver with Master: f2ce5ad0868940e7bb7762fcd349eb28 (127.26.206.193:35199)
I20260808 14:51:11.871665 5678 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.26.206.193:53699
W20260808 14:51:12.209726 5897 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:51:12.210053 5897 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:51:12.210209 5897 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:51:12.217904 5897 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:51:12.218035 5897 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:51:12.218199 5897 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.206.194
I20260808 14:51:12.228940 5897 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:42329
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200577490656-27451-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200577490656-27451-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.206.194:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200577490656-27451-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.206.194
--webserver_port=0
--tserver_master_addrs=127.26.206.254:38227
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.206.194
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200577490656-27451-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:51:12.230376 5897 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:51:12.232324 5897 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:51:12.246104 5902 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:51:12.246169 5904 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:51:12.246135 5907 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:51:12.246996 5897 server_base.cc:1034] running on GCE node
I20260808 14:51:12.247718 5897 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:51:12.248699 5897 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:51:12.249897 5897 hybrid_clock.cc:648] HybridClock initialized: now 1786200672249847 us; error 44 us; skew 500 ppm
I20260808 14:51:12.250201 5897 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 14:51:12.252375 5897 webserver.cc:460] Webserver started at http://127.26.206.194:46445/ using document root <none> and password file <none>
I20260808 14:51:12.253166 5897 fs_manager.cc:359] Metadata directory not provided
I20260808 14:51:12.253293 5897 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:51:12.253618 5897 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:51:12.256567 5897 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200577490656-27451-0/minicluster-data/ts-1/data/instance:
uuid: "598f80ea2fd94d618529b905fa577b40"
format_stamp: "Formatted at 2026-08-08 14:51:12 on dist-test-slave-6k22"
server_key: "bb80ada355982a8edd27c5c237f12f27"
server_key_iv: "097152bc2089b4ee6b8f45f988fae0f2"
server_key_version: "encryptionkey@0"
I20260808 14:51:12.257355 5897 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200577490656-27451-0/minicluster-data/ts-1/wal/instance:
uuid: "598f80ea2fd94d618529b905fa577b40"
format_stamp: "Formatted at 2026-08-08 14:51:12 on dist-test-slave-6k22"
server_key: "bb80ada355982a8edd27c5c237f12f27"
server_key_iv: "097152bc2089b4ee6b8f45f988fae0f2"
server_key_version: "encryptionkey@0"
I20260808 14:51:12.262254 5897 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260808 14:51:12.265631 5915 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:51:12.266830 5897 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 14:51:12.266991 5897 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200577490656-27451-0/minicluster-data/ts-1/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200577490656-27451-0/minicluster-data/ts-1/wal
uuid: "598f80ea2fd94d618529b905fa577b40"
format_stamp: "Formatted at 2026-08-08 14:51:12 on dist-test-slave-6k22"
server_key: "bb80ada355982a8edd27c5c237f12f27"
server_key_iv: "097152bc2089b4ee6b8f45f988fae0f2"
server_key_version: "encryptionkey@0"
I20260808 14:51:12.267204 5897 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200577490656-27451-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200577490656-27451-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200577490656-27451-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:51:12.290927 5897 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:51:12.291895 5897 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:51:12.292280 5897 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:51:12.293313 5897 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:51:12.294992 5897 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:51:12.295104 5897 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:51:12.295228 5897 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:51:12.295307 5897 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:51:12.327997 5897 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.194:35563
I20260808 14:51:12.328083 6038 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.194:35563 every 8 connection(s)
I20260808 14:51:12.329293 5897 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200577490656-27451-0/minicluster-data/ts-1/data/info.pb
I20260808 14:51:12.335999 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 5897
I20260808 14:51:12.336198 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200577490656-27451-0/minicluster-data/ts-1/wal/instance
I20260808 14:51:12.336699 27451 external_mini_cluster.cc:1428] Setting key 91aa87897fb200a4f70defe81ddb050d
I20260808 14:51:12.339285 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200577490656-27451-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200577490656-27451-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200577490656-27451-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200577490656-27451-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.206.195:0
--local_ip_for_outbound_sockets=127.26.206.195
--webserver_interface=127.26.206.195
--webserver_port=0
--tserver_master_addrs=127.26.206.254:38227
--builtin_ntp_servers=127.26.206.212:42329
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260808 14:51:12.341828 5895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:51:12.331763 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.194:57089 (local address 127.26.206.254:38227)
0808 14:51:12.331936 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0808 14:51:12.331940 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:51:12.333295 (+ 1355us) server_negotiation.cc:407] Connection header received
0808 14:51:12.334956 (+ 1661us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:51:12.334960 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:51:12.335029 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:51:12.335117 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:51:12.336389 (+ 1272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:51:12.337164 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:51:12.338950 (+ 1786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:51:12.339329 (+ 379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:51:12.339484 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:51:12.341150 (+ 1666us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:51:12.341155 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:51:12.341158 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:51:12.341175 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:51:12.341205 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:51:12.341216 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:51:12.341296 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0808 14:51:12.341529 (+ 233us) server_negotiation.cc:299] Negotiation successful
0808 14:51:12.341603 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260808 14:51:12.343261 6041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:51:12.332255 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:38227 (local address 127.26.206.194:57089)
0808 14:51:12.333142 (+ 887us) negotiation.cc:107] Waiting for socket to connect
0808 14:51:12.333178 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0808 14:51:12.334703 (+ 1525us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:51:12.335300 (+ 597us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:51:12.335308 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:51:12.335394 (+ 86us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:51:12.336215 (+ 821us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:51:12.336241 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:51:12.337330 (+ 1089us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:51:12.337335 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:51:12.338803 (+ 1468us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:51:12.338815 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:51:12.339666 (+ 851us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:51:12.339676 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:51:12.340023 (+ 347us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:51:12.340795 (+ 772us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 14:51:12.340800 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:51:12.340857 (+ 57us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 14:51:12.340963 (+ 106us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:51:12.341311 (+ 348us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:51:12.341324 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:51:12.341336 (+ 12us) client_negotiation.cc:769] Sending connection context
0808 14:51:12.341504 (+ 168us) client_negotiation.cc:240] Negotiation successful
0808 14:51:12.341912 (+ 408us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":463,"thread_start_us":277,"threads_started":1}
I20260808 14:51:12.344676 6039 heartbeater.cc:347] Connected to a master server at 127.26.206.254:38227
I20260808 14:51:12.344983 6039 heartbeater.cc:464] Registering TS with master...
I20260808 14:51:12.345829 6039 heartbeater.cc:511] Master 127.26.206.254:38227 requested a full tablet report, sending...
I20260808 14:51:12.347302 5678 ts_manager.cc:194] Registered new tserver with Master: 598f80ea2fd94d618529b905fa577b40 (127.26.206.194:35563)
I20260808 14:51:12.348536 5678 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.26.206.194:57089
W20260808 14:51:12.671777 6042 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:51:12.672060 6042 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:51:12.672240 6042 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:51:12.679279 6042 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:51:12.679395 6042 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:51:12.679597 6042 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.206.195
I20260808 14:51:12.688419 6042 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:42329
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200577490656-27451-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200577490656-27451-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.206.195:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200577490656-27451-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.206.195
--webserver_port=0
--tserver_master_addrs=127.26.206.254:38227
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.206.195
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200577490656-27451-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:51:12.689630 6042 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:51:12.691355 6042 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:51:12.704454 6048 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:51:12.704512 6049 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:51:12.704402 6051 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:51:12.709021 6042 server_base.cc:1034] running on GCE node
I20260808 14:51:12.709566 6042 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:51:12.710484 6042 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:51:12.711702 6042 hybrid_clock.cc:648] HybridClock initialized: now 1786200672711665 us; error 43 us; skew 500 ppm
I20260808 14:51:12.711995 6042 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 14:51:12.714190 6042 webserver.cc:460] Webserver started at http://127.26.206.195:44169/ using document root <none> and password file <none>
I20260808 14:51:12.714859 6042 fs_manager.cc:359] Metadata directory not provided
I20260808 14:51:12.714987 6042 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:51:12.715312 6042 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:51:12.718158 6042 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200577490656-27451-0/minicluster-data/ts-2/data/instance:
uuid: "b6934ad98d9d44c5ae55e5b12c6dc1c5"
format_stamp: "Formatted at 2026-08-08 14:51:12 on dist-test-slave-6k22"
server_key: "3ceb91d7220461f5509666d0baf290ea"
server_key_iv: "360845cbac2bd60bb0d1c168c1c37fb2"
server_key_version: "encryptionkey@0"
I20260808 14:51:12.718984 6042 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200577490656-27451-0/minicluster-data/ts-2/wal/instance:
uuid: "b6934ad98d9d44c5ae55e5b12c6dc1c5"
format_stamp: "Formatted at 2026-08-08 14:51:12 on dist-test-slave-6k22"
server_key: "3ceb91d7220461f5509666d0baf290ea"
server_key_iv: "360845cbac2bd60bb0d1c168c1c37fb2"
server_key_version: "encryptionkey@0"
I20260808 14:51:12.724498 6042 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.005s
I20260808 14:51:12.727861 6057 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:51:12.729099 6042 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260808 14:51:12.729283 6042 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200577490656-27451-0/minicluster-data/ts-2/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200577490656-27451-0/minicluster-data/ts-2/wal
uuid: "b6934ad98d9d44c5ae55e5b12c6dc1c5"
format_stamp: "Formatted at 2026-08-08 14:51:12 on dist-test-slave-6k22"
server_key: "3ceb91d7220461f5509666d0baf290ea"
server_key_iv: "360845cbac2bd60bb0d1c168c1c37fb2"
server_key_version: "encryptionkey@0"
I20260808 14:51:12.729489 6042 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200577490656-27451-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200577490656-27451-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200577490656-27451-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:51:12.750684 6042 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:51:12.751477 6042 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:51:12.751812 6042 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:51:12.752700 6042 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:51:12.754053 6042 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:51:12.754171 6042 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:51:12.754312 6042 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:51:12.754410 6042 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:51:12.787703 6042 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.195:34693
I20260808 14:51:12.787835 6182 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.195:34693 every 8 connection(s)
I20260808 14:51:12.788928 6042 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200577490656-27451-0/minicluster-data/ts-2/data/info.pb
I20260808 14:51:12.798195 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 6042
I20260808 14:51:12.798388 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200577490656-27451-0/minicluster-data/ts-2/wal/instance
I20260808 14:51:12.798903 27451 external_mini_cluster.cc:1428] Setting key 16c1bbfd082e4bdf7abc4cfa90d8bac0
I20260808 14:51:12.801404 5895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:51:12.791318 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.195:37319 (local address 127.26.206.254:38227)
0808 14:51:12.791538 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0808 14:51:12.791544 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:51:12.792877 (+ 1333us) server_negotiation.cc:407] Connection header received
0808 14:51:12.794568 (+ 1691us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:51:12.794572 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:51:12.794635 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:51:12.794721 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:51:12.795956 (+ 1235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:51:12.796769 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:51:12.798459 (+ 1690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:51:12.798894 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:51:12.799033 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:51:12.800553 (+ 1520us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:51:12.800557 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:51:12.800560 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:51:12.800576 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:51:12.800605 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:51:12.800617 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:51:12.800707 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0808 14:51:12.800965 (+ 258us) server_negotiation.cc:299] Negotiation successful
0808 14:51:12.801055 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260808 14:51:12.802330 6186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:51:12.791878 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:38227 (local address 127.26.206.195:37319)
0808 14:51:12.792722 (+ 844us) negotiation.cc:107] Waiting for socket to connect
0808 14:51:12.792756 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0808 14:51:12.794307 (+ 1551us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:51:12.795006 (+ 699us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:51:12.795019 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:51:12.795133 (+ 114us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:51:12.795811 (+ 678us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:51:12.795829 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:51:12.796898 (+ 1069us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:51:12.796902 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:51:12.798299 (+ 1397us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:51:12.798315 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:51:12.799111 (+ 796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:51:12.799119 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:51:12.799441 (+ 322us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:51:12.800214 (+ 773us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 14:51:12.800220 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:51:12.800271 (+ 51us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 14:51:12.800368 (+ 97us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:51:12.800707 (+ 339us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:51:12.800719 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:51:12.800730 (+ 11us) client_negotiation.cc:769] Sending connection context
0808 14:51:12.800913 (+ 183us) client_negotiation.cc:240] Negotiation successful
0808 14:51:12.801287 (+ 374us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":448,"thread_start_us":266,"threads_started":1}
I20260808 14:51:12.803498 6183 heartbeater.cc:347] Connected to a master server at 127.26.206.254:38227
I20260808 14:51:12.803834 6183 heartbeater.cc:464] Registering TS with master...
I20260808 14:51:12.804540 6183 heartbeater.cc:511] Master 127.26.206.254:38227 requested a full tablet report, sending...
I20260808 14:51:12.805768 5678 ts_manager.cc:194] Registered new tserver with Master: b6934ad98d9d44c5ae55e5b12c6dc1c5 (127.26.206.195:34693)
I20260808 14:51:12.806528 5678 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.26.206.195:37319
I20260808 14:51:12.813743 27451 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260808 14:51:12.819716 5895 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:51:12.818020 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51814 (local address 127.26.206.254:38227)
0808 14:51:12.818158 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0808 14:51:12.818162 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:51:12.818690 (+ 528us) server_negotiation.cc:407] Connection header received
0808 14:51:12.818881 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:51:12.818885 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:51:12.818956 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:51:12.819033 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:51:12.819480 (+ 447us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51814: BlockingRecv error: recv got EOF from 127.0.0.1:51814 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
I20260808 14:51:12.820374 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 5742
I20260808 14:51:12.828125 6193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:51:12.821443 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35208 (local address 127.26.206.193:35199)
0808 14:51:12.821993 (+ 550us) server_negotiation.cc:206] Beginning negotiation
0808 14:51:12.821999 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:51:12.822024 (+ 25us) server_negotiation.cc:407] Connection header received
0808 14:51:12.822075 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:51:12.822081 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:51:12.822254 (+ 173us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:51:12.822428 (+ 174us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:51:12.822810 (+ 382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:51:12.823825 (+ 1015us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:51:12.825038 (+ 1213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:51:12.825596 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:51:12.825741 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:51:12.826716 (+ 975us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:51:12.826724 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:51:12.826735 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:51:12.827310 (+ 575us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:51:12.827354 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:51:12.827373 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:51:12.827491 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0808 14:51:12.827662 (+ 171us) server_negotiation.cc:299] Negotiation successful
0808 14:51:12.827785 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":405,"thread_start_us":297,"threads_started":1}
I20260808 14:51:12.829313 5888 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:51:12.909232 5893 heartbeater.cc:503] Master 127.26.206.254:38227 was elected leader, sending a full tablet report...
I20260808 14:51:12.910621 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 5742
W20260808 14:51:12.930944 5663 connection.cc:535] server connection from 127.26.206.193:53699 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260808 14:51:12.931294 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 5897
I20260808 14:51:12.939504 6195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:51:12.932300 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34474 (local address 127.26.206.194:35563)
0808 14:51:12.932939 (+ 639us) server_negotiation.cc:206] Beginning negotiation
0808 14:51:12.932946 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:51:12.932972 (+ 26us) server_negotiation.cc:407] Connection header received
0808 14:51:12.933062 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:51:12.933070 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:51:12.933327 (+ 257us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:51:12.933492 (+ 165us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:51:12.933961 (+ 469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:51:12.935073 (+ 1112us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:51:12.936381 (+ 1308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:51:12.936946 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:51:12.937079 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:51:12.938046 (+ 967us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:51:12.938055 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:51:12.938076 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:51:12.938680 (+ 604us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:51:12.938726 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:51:12.938744 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:51:12.938868 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0808 14:51:12.939031 (+ 163us) server_negotiation.cc:299] Negotiation successful
0808 14:51:12.939158 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":504,"thread_start_us":356,"threads_started":1}
I20260808 14:51:12.940764 6033 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:51:13.021787 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 5897
I20260808 14:51:13.041373 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 6042
I20260808 14:51:13.049396 6199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:51:13.042322 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33270 (local address 127.26.206.195:34693)
0808 14:51:13.042974 (+ 652us) server_negotiation.cc:206] Beginning negotiation
0808 14:51:13.042982 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:51:13.043011 (+ 29us) server_negotiation.cc:407] Connection header received
0808 14:51:13.043070 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:51:13.043076 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:51:13.043296 (+ 220us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:51:13.043420 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:51:13.043892 (+ 472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:51:13.044921 (+ 1029us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:51:13.046115 (+ 1194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:51:13.046713 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:51:13.046808 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:51:13.048016 (+ 1208us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:51:13.048024 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:51:13.048036 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:51:13.048614 (+ 578us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:51:13.048658 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:51:13.048677 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:51:13.048765 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0808 14:51:13.048887 (+ 122us) server_negotiation.cc:299] Negotiation successful
0808 14:51:13.049005 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":503,"thread_start_us":334,"threads_started":1}
I20260808 14:51:13.050594 6178 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:51:13.133679 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 6042
I20260808 14:51:13.152700 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 5641
I20260808 14:51:13.153926 5710 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:51:13.257211 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 5641
2026-08-08T14:51:13Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (2489 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-08T14:51:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:51:13Z Disabled control of system clock
I20260808 14:51:13.340065 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200577490656-27451-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200577490656-27451-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200577490656-27451-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.206.254:38341
--webserver_interface=127.26.206.254
--webserver_port=0
--builtin_ntp_servers=127.26.206.212:33517
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.206.254:38341
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260808 14:51:13.670385 6205 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:51:13.670637 6205 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:51:13.670799 6205 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:51:13.677678 6205 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:51:13.677770 6205 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:51:13.677809 6205 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:51:13.677865 6205 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:51:13.677907 6205 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:51:13.686657 6205 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:33517
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200577490656-27451-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200577490656-27451-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.206.254:38341
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.206.254:38341
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.206.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200577490656-27451-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:51:13.687932 6205 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:51:13.689630 6205 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:51:13.700987 6213 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:51:13.701036 6211 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:51:13.700934 6210 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:51:13.702325 6205 server_base.cc:1034] running on GCE node
I20260808 14:51:13.703042 6205 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:51:13.704389 6205 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:51:13.705610 6205 hybrid_clock.cc:648] HybridClock initialized: now 1786200673705575 us; error 45 us; skew 500 ppm
I20260808 14:51:13.705960 6205 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 14:51:13.708173 6205 webserver.cc:460] Webserver started at http://127.26.206.254:45471/ using document root <none> and password file <none>
I20260808 14:51:13.708834 6205 fs_manager.cc:359] Metadata directory not provided
I20260808 14:51:13.708962 6205 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:51:13.709292 6205 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:51:13.712239 6205 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200577490656-27451-0/minicluster-data/master-0/data/instance:
uuid: "fe83e9f582e043d98cea9d0f4897a7a8"
format_stamp: "Formatted at 2026-08-08 14:51:13 on dist-test-slave-6k22"
server_key: "035d212cade1f8903c9758d7eb18cd46"
server_key_iv: "b512f58c956c460dda2f61c52902f7b1"
server_key_version: "encryptionkey@0"
I20260808 14:51:13.713012 6205 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200577490656-27451-0/minicluster-data/master-0/wal/instance:
uuid: "fe83e9f582e043d98cea9d0f4897a7a8"
format_stamp: "Formatted at 2026-08-08 14:51:13 on dist-test-slave-6k22"
server_key: "035d212cade1f8903c9758d7eb18cd46"
server_key_iv: "b512f58c956c460dda2f61c52902f7b1"
server_key_version: "encryptionkey@0"
I20260808 14:51:13.717952 6205 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260808 14:51:13.721228 6221 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:51:13.722415 6205 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 14:51:13.722589 6205 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200577490656-27451-0/minicluster-data/master-0/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200577490656-27451-0/minicluster-data/master-0/wal
uuid: "fe83e9f582e043d98cea9d0f4897a7a8"
format_stamp: "Formatted at 2026-08-08 14:51:13 on dist-test-slave-6k22"
server_key: "035d212cade1f8903c9758d7eb18cd46"
server_key_iv: "b512f58c956c460dda2f61c52902f7b1"
server_key_version: "encryptionkey@0"
I20260808 14:51:13.722798 6205 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200577490656-27451-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200577490656-27451-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200577490656-27451-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:51:13.728502 6205 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:51:13.729230 6205 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:51:13.729530 6205 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:51:13.747536 6205 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.254:38341
I20260808 14:51:13.747639 6281 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.254:38341 every 8 connection(s)
I20260808 14:51:13.748857 6205 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
I20260808 14:51:13.752415 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 6205
I20260808 14:51:13.752622 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200577490656-27451-0/minicluster-data/master-0/wal/instance
I20260808 14:51:13.752637 6282 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:51:13.753518 27451 external_mini_cluster.cc:1428] Setting key 29770b0687cbd2ba16bd72fdc132e76c
I20260808 14:51:13.762125 6285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:51:13.755689 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35072 (local address 127.26.206.254:38341)
0808 14:51:13.756703 (+ 1014us) server_negotiation.cc:206] Beginning negotiation
0808 14:51:13.756713 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 14:51:13.756753 (+ 40us) server_negotiation.cc:407] Connection header received
0808 14:51:13.758819 (+ 2066us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:51:13.758840 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:51:13.759240 (+ 400us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:51:13.759614 (+ 374us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:51:13.760633 (+ 1019us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:51:13.760639 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:51:13.760651 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:51:13.760664 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:51:13.760724 (+ 60us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:51:13.760739 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:51:13.760911 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0808 14:51:13.761030 (+ 119us) server_negotiation.cc:299] Negotiation successful
0808 14:51:13.761284 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":608,"thread_start_us":403,"threads_started":1}
I20260808 14:51:13.765861 6282 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fe83e9f582e043d98cea9d0f4897a7a8: Bootstrap starting.
I20260808 14:51:13.768643 6282 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fe83e9f582e043d98cea9d0f4897a7a8: Neither blocks nor log segments found. Creating new log.
I20260808 14:51:13.769676 6282 log.cc:824] T 00000000000000000000000000000000 P fe83e9f582e043d98cea9d0f4897a7a8: Log is configured to *not* fsync() on all Append() calls
I20260808 14:51:13.772245 6282 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fe83e9f582e043d98cea9d0f4897a7a8: No bootstrap required, opened a new log
I20260808 14:51:13.779207 6282 raft_consensus.cc:348] T 00000000000000000000000000000000 P fe83e9f582e043d98cea9d0f4897a7a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe83e9f582e043d98cea9d0f4897a7a8" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 38341 } }
I20260808 14:51:13.779551 6282 raft_consensus.cc:374] T 00000000000000000000000000000000 P fe83e9f582e043d98cea9d0f4897a7a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:51:13.779697 6282 raft_consensus.cc:729] T 00000000000000000000000000000000 P fe83e9f582e043d98cea9d0f4897a7a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe83e9f582e043d98cea9d0f4897a7a8, State: Initialized, Role: FOLLOWER
I20260808 14:51:13.780274 6282 consensus_queue.cc:260] T 00000000000000000000000000000000 P fe83e9f582e043d98cea9d0f4897a7a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe83e9f582e043d98cea9d0f4897a7a8" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 38341 } }
I20260808 14:51:13.780508 6282 raft_consensus.cc:388] T 00000000000000000000000000000000 P fe83e9f582e043d98cea9d0f4897a7a8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:51:13.780652 6282 raft_consensus.cc:482] T 00000000000000000000000000000000 P fe83e9f582e043d98cea9d0f4897a7a8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:51:13.780823 6282 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fe83e9f582e043d98cea9d0f4897a7a8 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:51:13.782807 6282 raft_consensus.cc:504] T 00000000000000000000000000000000 P fe83e9f582e043d98cea9d0f4897a7a8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe83e9f582e043d98cea9d0f4897a7a8" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 38341 } }
I20260808 14:51:13.783253 6282 leader_election.cc:302] T 00000000000000000000000000000000 P fe83e9f582e043d98cea9d0f4897a7a8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fe83e9f582e043d98cea9d0f4897a7a8; no voters:
I20260808 14:51:13.783990 6282 leader_election.cc:288] T 00000000000000000000000000000000 P fe83e9f582e043d98cea9d0f4897a7a8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:51:13.784116 6287 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fe83e9f582e043d98cea9d0f4897a7a8 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:51:13.784937 6287 raft_consensus.cc:686] T 00000000000000000000000000000000 P fe83e9f582e043d98cea9d0f4897a7a8 [term 1 LEADER]: Becoming Leader. State: Replica: fe83e9f582e043d98cea9d0f4897a7a8, State: Running, Role: LEADER
I20260808 14:51:13.785508 6287 consensus_queue.cc:237] T 00000000000000000000000000000000 P fe83e9f582e043d98cea9d0f4897a7a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe83e9f582e043d98cea9d0f4897a7a8" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 38341 } }
I20260808 14:51:13.786083 6282 sys_catalog.cc:564] T 00000000000000000000000000000000 P fe83e9f582e043d98cea9d0f4897a7a8 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:51:13.788432 6288 sys_catalog.cc:455] T 00000000000000000000000000000000 P fe83e9f582e043d98cea9d0f4897a7a8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fe83e9f582e043d98cea9d0f4897a7a8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe83e9f582e043d98cea9d0f4897a7a8" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 38341 } } }
I20260808 14:51:13.788892 6288 sys_catalog.cc:458] T 00000000000000000000000000000000 P fe83e9f582e043d98cea9d0f4897a7a8 [sys.catalog]: This master's current role is: LEADER
I20260808 14:51:13.788699 6289 sys_catalog.cc:455] T 00000000000000000000000000000000 P fe83e9f582e043d98cea9d0f4897a7a8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fe83e9f582e043d98cea9d0f4897a7a8. Latest consensus state: current_term: 1 leader_uuid: "fe83e9f582e043d98cea9d0f4897a7a8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe83e9f582e043d98cea9d0f4897a7a8" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 38341 } } }
I20260808 14:51:13.789024 6289 sys_catalog.cc:458] T 00000000000000000000000000000000 P fe83e9f582e043d98cea9d0f4897a7a8 [sys.catalog]: This master's current role is: LEADER
I20260808 14:51:13.790568 6296 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:51:13.795984 6296 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:51:13.804028 6296 catalog_manager.cc:1347] Generated new cluster ID: 4b7a9b9271fa4177ad380766bb0176a8
I20260808 14:51:13.804128 6296 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:51:13.835139 6296 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:51:13.835664 6296 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:51:13.854031 6296 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fe83e9f582e043d98cea9d0f4897a7a8: Generated new TSK 0
I20260808 14:51:13.854866 6296 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:51:13.866225 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200577490656-27451-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200577490656-27451-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200577490656-27451-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200577490656-27451-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.206.193:0
--local_ip_for_outbound_sockets=127.26.206.193
--webserver_interface=127.26.206.193
--webserver_port=0
--tserver_master_addrs=127.26.206.254:38341
--builtin_ntp_servers=127.26.206.212:33517
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260808 14:51:14.206878 6309 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:51:14.207170 6309 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:51:14.207345 6309 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:51:14.214787 6309 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:51:14.214886 6309 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:51:14.215036 6309 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.206.193
I20260808 14:51:14.224164 6309 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:33517
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200577490656-27451-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200577490656-27451-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.206.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200577490656-27451-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.206.193
--webserver_port=0
--tserver_master_addrs=127.26.206.254:38341
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.206.193
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200577490656-27451-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:51:14.225427 6309 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:51:14.227380 6309 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:51:14.240370 6316 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:51:14.240511 6314 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:51:14.240471 6318 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:51:14.241372 6309 server_base.cc:1034] running on GCE node
I20260808 14:51:14.241966 6309 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:51:14.242877 6309 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:51:14.244092 6309 hybrid_clock.cc:648] HybridClock initialized: now 1786200674244045 us; error 59 us; skew 500 ppm
I20260808 14:51:14.244387 6309 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 14:51:14.246523 6309 webserver.cc:460] Webserver started at http://127.26.206.193:46097/ using document root <none> and password file <none>
I20260808 14:51:14.247192 6309 fs_manager.cc:359] Metadata directory not provided
I20260808 14:51:14.247320 6309 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:51:14.247682 6309 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:51:14.252727 6309 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200577490656-27451-0/minicluster-data/ts-0/data/instance:
uuid: "d3fe799150084d19a409ceb53fd45f43"
format_stamp: "Formatted at 2026-08-08 14:51:14 on dist-test-slave-6k22"
server_key: "d657ded34237c50df60ae6c5b7a8ecfa"
server_key_iv: "9536fe85e6e1cc7111ae51b8945bd92c"
server_key_version: "encryptionkey@0"
I20260808 14:51:14.253495 6309 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200577490656-27451-0/minicluster-data/ts-0/wal/instance:
uuid: "d3fe799150084d19a409ceb53fd45f43"
format_stamp: "Formatted at 2026-08-08 14:51:14 on dist-test-slave-6k22"
server_key: "d657ded34237c50df60ae6c5b7a8ecfa"
server_key_iv: "9536fe85e6e1cc7111ae51b8945bd92c"
server_key_version: "encryptionkey@0"
I20260808 14:51:14.258280 6309 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260808 14:51:14.261533 6324 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:51:14.262755 6309 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 14:51:14.262900 6309 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200577490656-27451-0/minicluster-data/ts-0/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200577490656-27451-0/minicluster-data/ts-0/wal
uuid: "d3fe799150084d19a409ceb53fd45f43"
format_stamp: "Formatted at 2026-08-08 14:51:14 on dist-test-slave-6k22"
server_key: "d657ded34237c50df60ae6c5b7a8ecfa"
server_key_iv: "9536fe85e6e1cc7111ae51b8945bd92c"
server_key_version: "encryptionkey@0"
I20260808 14:51:14.263070 6309 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200577490656-27451-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200577490656-27451-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200577490656-27451-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:51:14.268194 6309 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:51:14.268873 6309 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:51:14.269090 6309 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:51:14.269902 6309 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:51:14.271164 6309 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:51:14.271248 6309 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:51:14.271324 6309 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:51:14.271378 6309 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:51:14.303979 6309 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.193:38307
I20260808 14:51:14.304049 6457 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.193:38307 every 8 connection(s)
I20260808 14:51:14.305305 6309 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200577490656-27451-0/minicluster-data/ts-0/data/info.pb
I20260808 14:51:14.313175 6460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:51:14.307660 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.193:48327 (local address 127.26.206.254:38341)
0808 14:51:14.308109 (+ 449us) server_negotiation.cc:206] Beginning negotiation
0808 14:51:14.308113 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:51:14.309184 (+ 1071us) server_negotiation.cc:407] Connection header received
0808 14:51:14.310861 (+ 1677us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:51:14.310867 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:51:14.310941 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:51:14.311061 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:51:14.312375 (+ 1314us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:51:14.312381 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:51:14.312386 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:51:14.312405 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:51:14.312454 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:51:14.312466 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:51:14.312600 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0808 14:51:14.312794 (+ 194us) server_negotiation.cc:299] Negotiation successful
0808 14:51:14.312867 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":338,"thread_start_us":242,"threads_started":1}
I20260808 14:51:14.314014 6461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:51:14.308119 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:38341 (local address 127.26.206.193:48327)
0808 14:51:14.309037 (+ 918us) negotiation.cc:107] Waiting for socket to connect
0808 14:51:14.309071 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0808 14:51:14.310609 (+ 1538us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:51:14.311305 (+ 696us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:51:14.311313 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:51:14.311400 (+ 87us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:51:14.312078 (+ 678us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 14:51:14.312081 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:51:14.312118 (+ 37us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 14:51:14.312197 (+ 79us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:51:14.312562 (+ 365us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:51:14.312573 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:51:14.312583 (+ 10us) client_negotiation.cc:769] Sending connection context
0808 14:51:14.312866 (+ 283us) client_negotiation.cc:240] Negotiation successful
0808 14:51:14.313124 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":460,"thread_start_us":271,"threads_started":1}
I20260808 14:51:14.314806 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 6309
I20260808 14:51:14.315038 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200577490656-27451-0/minicluster-data/ts-0/wal/instance
I20260808 14:51:14.315478 6458 heartbeater.cc:347] Connected to a master server at 127.26.206.254:38341
I20260808 14:51:14.315743 27451 external_mini_cluster.cc:1428] Setting key fc7df4f9681def27dc20ccef9d82c6d0
I20260808 14:51:14.315821 6458 heartbeater.cc:464] Registering TS with master...
I20260808 14:51:14.316411 6458 heartbeater.cc:511] Master 127.26.206.254:38341 requested a full tablet report, sending...
I20260808 14:51:14.318404 6238 ts_manager.cc:194] Registered new tserver with Master: d3fe799150084d19a409ceb53fd45f43 (127.26.206.193:38307)
I20260808 14:51:14.318480 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200577490656-27451-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200577490656-27451-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200577490656-27451-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200577490656-27451-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.206.194:0
--local_ip_for_outbound_sockets=127.26.206.194
--webserver_interface=127.26.206.194
--webserver_port=0
--tserver_master_addrs=127.26.206.254:38341
--builtin_ntp_servers=127.26.206.212:33517
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260808 14:51:14.646034 6462 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:51:14.646317 6462 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:51:14.646498 6462 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:51:14.653671 6462 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:51:14.653796 6462 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:51:14.653973 6462 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.206.194
I20260808 14:51:14.662655 6462 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:33517
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200577490656-27451-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200577490656-27451-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.206.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200577490656-27451-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.206.194
--webserver_port=0
--tserver_master_addrs=127.26.206.254:38341
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.206.194
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200577490656-27451-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:51:14.663883 6462 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:51:14.665555 6462 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:51:14.678181 6467 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:51:14.678175 6468 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:51:14.678251 6471 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:51:14.679345 6462 server_base.cc:1034] running on GCE node
I20260808 14:51:14.679987 6462 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:51:14.680950 6462 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:51:14.682201 6462 hybrid_clock.cc:648] HybridClock initialized: now 1786200674682114 us; error 89 us; skew 500 ppm
I20260808 14:51:14.682503 6462 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 14:51:14.684717 6462 webserver.cc:460] Webserver started at http://127.26.206.194:37225/ using document root <none> and password file <none>
I20260808 14:51:14.685379 6462 fs_manager.cc:359] Metadata directory not provided
I20260808 14:51:14.685509 6462 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:51:14.685811 6462 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:51:14.688647 6462 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200577490656-27451-0/minicluster-data/ts-1/data/instance:
uuid: "2ed3eab247c84691bf92c84a5874f287"
format_stamp: "Formatted at 2026-08-08 14:51:14 on dist-test-slave-6k22"
server_key: "bf1f5fee819568e6369cbe9544803392"
server_key_iv: "b9ed6031d48bcac958cc28f35e62786a"
server_key_version: "encryptionkey@0"
I20260808 14:51:14.689493 6462 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200577490656-27451-0/minicluster-data/ts-1/wal/instance:
uuid: "2ed3eab247c84691bf92c84a5874f287"
format_stamp: "Formatted at 2026-08-08 14:51:14 on dist-test-slave-6k22"
server_key: "bf1f5fee819568e6369cbe9544803392"
server_key_iv: "b9ed6031d48bcac958cc28f35e62786a"
server_key_version: "encryptionkey@0"
I20260808 14:51:14.694480 6462 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260808 14:51:14.697751 6478 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:51:14.699024 6462 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260808 14:51:14.699198 6462 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200577490656-27451-0/minicluster-data/ts-1/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200577490656-27451-0/minicluster-data/ts-1/wal
uuid: "2ed3eab247c84691bf92c84a5874f287"
format_stamp: "Formatted at 2026-08-08 14:51:14 on dist-test-slave-6k22"
server_key: "bf1f5fee819568e6369cbe9544803392"
server_key_iv: "b9ed6031d48bcac958cc28f35e62786a"
server_key_version: "encryptionkey@0"
I20260808 14:51:14.699424 6462 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200577490656-27451-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200577490656-27451-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200577490656-27451-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:51:14.704957 6462 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:51:14.705703 6462 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:51:14.706012 6462 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:51:14.706862 6462 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:51:14.708252 6462 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:51:14.708379 6462 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:51:14.708494 6462 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:51:14.708580 6462 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:51:14.742367 6462 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.194:43617
I20260808 14:51:14.742415 6604 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.194:43617 every 8 connection(s)
I20260808 14:51:14.743769 6462 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200577490656-27451-0/minicluster-data/ts-1/data/info.pb
I20260808 14:51:14.745784 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 6462
I20260808 14:51:14.745944 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200577490656-27451-0/minicluster-data/ts-1/wal/instance
I20260808 14:51:14.746471 27451 external_mini_cluster.cc:1428] Setting key 953575c4abbf42cc1cb694bf6eaa19b8
I20260808 14:51:14.749734 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200577490656-27451-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200577490656-27451-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200577490656-27451-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200577490656-27451-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.206.195:0
--local_ip_for_outbound_sockets=127.26.206.195
--webserver_interface=127.26.206.195
--webserver_port=0
--tserver_master_addrs=127.26.206.254:38341
--builtin_ntp_servers=127.26.206.212:33517
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260808 14:51:14.753104 6460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:51:14.746276 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.194:52619 (local address 127.26.206.254:38341)
0808 14:51:14.746493 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0808 14:51:14.746500 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:51:14.748130 (+ 1630us) server_negotiation.cc:407] Connection header received
0808 14:51:14.750549 (+ 2419us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:51:14.750554 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:51:14.750636 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:51:14.750747 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:51:14.752336 (+ 1589us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:51:14.752343 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:51:14.752348 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:51:14.752366 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:51:14.752407 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:51:14.752422 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:51:14.752536 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0808 14:51:14.752768 (+ 232us) server_negotiation.cc:299] Negotiation successful
0808 14:51:14.752827 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260808 14:51:14.754211 6607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:51:14.746860 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:38341 (local address 127.26.206.194:52619)
0808 14:51:14.747984 (+ 1124us) negotiation.cc:107] Waiting for socket to connect
0808 14:51:14.748034 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0808 14:51:14.750250 (+ 2216us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:51:14.750991 (+ 741us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:51:14.751005 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:51:14.751150 (+ 145us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:51:14.751988 (+ 838us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 14:51:14.751993 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:51:14.752044 (+ 51us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 14:51:14.752151 (+ 107us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:51:14.752527 (+ 376us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:51:14.752540 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:51:14.752551 (+ 11us) client_negotiation.cc:769] Sending connection context
0808 14:51:14.752819 (+ 268us) client_negotiation.cc:240] Negotiation successful
0808 14:51:14.753055 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":601,"thread_start_us":409,"threads_started":1}
I20260808 14:51:14.755512 6605 heartbeater.cc:347] Connected to a master server at 127.26.206.254:38341
I20260808 14:51:14.755836 6605 heartbeater.cc:464] Registering TS with master...
I20260808 14:51:14.756488 6605 heartbeater.cc:511] Master 127.26.206.254:38341 requested a full tablet report, sending...
I20260808 14:51:14.758029 6238 ts_manager.cc:194] Registered new tserver with Master: 2ed3eab247c84691bf92c84a5874f287 (127.26.206.194:43617)
W20260808 14:51:15.086961 6608 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:51:15.087273 6608 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:51:15.087427 6608 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:51:15.094743 6608 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:51:15.094838 6608 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:51:15.094944 6608 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.206.195
I20260808 14:51:15.104368 6608 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:33517
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200577490656-27451-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200577490656-27451-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.206.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200577490656-27451-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.206.195
--webserver_port=0
--tserver_master_addrs=127.26.206.254:38341
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.206.195
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200577490656-27451-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:51:15.105569 6608 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:51:15.107259 6608 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:51:15.120314 6618 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:51:15.120388 6614 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:51:15.120352 6616 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:51:15.121161 6608 server_base.cc:1034] running on GCE node
I20260808 14:51:15.121771 6608 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:51:15.122671 6608 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:51:15.123862 6608 hybrid_clock.cc:648] HybridClock initialized: now 1786200675123826 us; error 32 us; skew 500 ppm
I20260808 14:51:15.124166 6608 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 14:51:15.126395 6608 webserver.cc:460] Webserver started at http://127.26.206.195:37489/ using document root <none> and password file <none>
I20260808 14:51:15.127106 6608 fs_manager.cc:359] Metadata directory not provided
I20260808 14:51:15.127218 6608 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:51:15.127527 6608 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:51:15.130569 6608 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200577490656-27451-0/minicluster-data/ts-2/data/instance:
uuid: "f5f31fa1872e43819aab0b1b7b311208"
format_stamp: "Formatted at 2026-08-08 14:51:15 on dist-test-slave-6k22"
server_key: "ae26a0cbe4f61a966af3f59df2490d6e"
server_key_iv: "85b89e51d5b6fa2dcfce46806139ac05"
server_key_version: "encryptionkey@0"
I20260808 14:51:15.131361 6608 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200577490656-27451-0/minicluster-data/ts-2/wal/instance:
uuid: "f5f31fa1872e43819aab0b1b7b311208"
format_stamp: "Formatted at 2026-08-08 14:51:15 on dist-test-slave-6k22"
server_key: "ae26a0cbe4f61a966af3f59df2490d6e"
server_key_iv: "85b89e51d5b6fa2dcfce46806139ac05"
server_key_version: "encryptionkey@0"
I20260808 14:51:15.136415 6608 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.003s
I20260808 14:51:15.140260 6626 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:51:15.141723 6608 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260808 14:51:15.141924 6608 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200577490656-27451-0/minicluster-data/ts-2/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200577490656-27451-0/minicluster-data/ts-2/wal
uuid: "f5f31fa1872e43819aab0b1b7b311208"
format_stamp: "Formatted at 2026-08-08 14:51:15 on dist-test-slave-6k22"
server_key: "ae26a0cbe4f61a966af3f59df2490d6e"
server_key_iv: "85b89e51d5b6fa2dcfce46806139ac05"
server_key_version: "encryptionkey@0"
I20260808 14:51:15.142143 6608 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200577490656-27451-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200577490656-27451-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200577490656-27451-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:51:15.148352 6608 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:51:15.149152 6608 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:51:15.149497 6608 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:51:15.150419 6608 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:51:15.151939 6608 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:51:15.152058 6608 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:51:15.152194 6608 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:51:15.152304 6608 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:51:15.186870 6608 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.195:32939
I20260808 14:51:15.186923 6750 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.195:32939 every 8 connection(s)
I20260808 14:51:15.188370 6608 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200577490656-27451-0/minicluster-data/ts-2/data/info.pb
I20260808 14:51:15.190384 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 6608
I20260808 14:51:15.190603 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200577490656-27451-0/minicluster-data/ts-2/wal/instance
I20260808 14:51:15.191303 27451 external_mini_cluster.cc:1428] Setting key 840c8ae1cedc30bc40d9dfb7d8632744
I20260808 14:51:15.197499 6460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:51:15.191117 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.195:59599 (local address 127.26.206.254:38341)
0808 14:51:15.191355 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0808 14:51:15.191363 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:51:15.193103 (+ 1740us) server_negotiation.cc:407] Connection header received
0808 14:51:15.195240 (+ 2137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:51:15.195244 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:51:15.195308 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:51:15.195406 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:51:15.196848 (+ 1442us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:51:15.196852 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:51:15.196856 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:51:15.196870 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:51:15.196900 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:51:15.196912 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:51:15.197022 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0808 14:51:15.197222 (+ 200us) server_negotiation.cc:299] Negotiation successful
0808 14:51:15.197287 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260808 14:51:15.198552 6753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:51:15.191740 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:38341 (local address 127.26.206.195:59599)
0808 14:51:15.192931 (+ 1191us) negotiation.cc:107] Waiting for socket to connect
0808 14:51:15.192986 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0808 14:51:15.195003 (+ 2017us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:51:15.195772 (+ 769us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:51:15.195781 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:51:15.195875 (+ 94us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:51:15.196504 (+ 629us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 14:51:15.196507 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:51:15.196544 (+ 37us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 14:51:15.196631 (+ 87us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:51:15.196995 (+ 364us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:51:15.197000 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:51:15.197005 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 14:51:15.197331 (+ 326us) client_negotiation.cc:240] Negotiation successful
0808 14:51:15.197573 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":593,"thread_start_us":345,"threads_started":1}
I20260808 14:51:15.199957 6751 heartbeater.cc:347] Connected to a master server at 127.26.206.254:38341
I20260808 14:51:15.200230 6751 heartbeater.cc:464] Registering TS with master...
I20260808 14:51:15.200781 6751 heartbeater.cc:511] Master 127.26.206.254:38341 requested a full tablet report, sending...
I20260808 14:51:15.202042 6238 ts_manager.cc:194] Registered new tserver with Master: f5f31fa1872e43819aab0b1b7b311208 (127.26.206.195:32939)
I20260808 14:51:15.206579 27451 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260808 14:51:15.212852 6460 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:51:15.211335 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35088 (local address 127.26.206.254:38341)
0808 14:51:15.211534 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0808 14:51:15.211541 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:51:15.212060 (+ 519us) server_negotiation.cc:407] Connection header received
0808 14:51:15.212191 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:51:15.212195 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:51:15.212241 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:51:15.212329 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:51:15.212609 (+ 280us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35088: BlockingRecv error: recv got EOF from 127.0.0.1:35088 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
I20260808 14:51:15.213864 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 6309
I20260808 14:51:15.217284 6762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:51:15.214761 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47622 (local address 127.26.206.193:38307)
0808 14:51:15.215274 (+ 513us) server_negotiation.cc:206] Beginning negotiation
0808 14:51:15.215281 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:51:15.215306 (+ 25us) server_negotiation.cc:407] Connection header received
0808 14:51:15.215364 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:51:15.215370 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:51:15.215631 (+ 261us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:51:15.215776 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:51:15.216630 (+ 854us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:51:15.216637 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:51:15.216647 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:51:15.216660 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:51:15.216761 (+ 101us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:51:15.216796 (+ 35us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:51:15.216903 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0808 14:51:15.216976 (+ 73us) server_negotiation.cc:299] Negotiation successful
0808 14:51:15.217058 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":360,"thread_start_us":241,"threads_started":1}
I20260808 14:51:15.218403 6451 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:51:15.299309 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 6309
I20260808 14:51:15.322201 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 6462
I20260808 14:51:15.325866 6765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:51:15.323090 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53300 (local address 127.26.206.194:43617)
0808 14:51:15.323649 (+ 559us) server_negotiation.cc:206] Beginning negotiation
0808 14:51:15.323655 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:51:15.323682 (+ 27us) server_negotiation.cc:407] Connection header received
0808 14:51:15.323746 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:51:15.323752 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:51:15.323977 (+ 225us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:51:15.324143 (+ 166us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:51:15.325132 (+ 989us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:51:15.325138 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:51:15.325149 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:51:15.325166 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:51:15.325203 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:51:15.325216 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:51:15.325360 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0808 14:51:15.325482 (+ 122us) server_negotiation.cc:299] Negotiation successful
0808 14:51:15.325585 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":378,"thread_start_us":254,"threads_started":1}
I20260808 14:51:15.327111 6599 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:51:15.408027 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 6462
I20260808 14:51:15.428382 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 6608
I20260808 14:51:15.432091 6767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:51:15.429378 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59572 (local address 127.26.206.195:32939)
0808 14:51:15.430000 (+ 622us) server_negotiation.cc:206] Beginning negotiation
0808 14:51:15.430006 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:51:15.430036 (+ 30us) server_negotiation.cc:407] Connection header received
0808 14:51:15.430105 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:51:15.430111 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:51:15.430339 (+ 228us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:51:15.430463 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:51:15.431374 (+ 911us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:51:15.431380 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:51:15.431391 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:51:15.431407 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:51:15.431447 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:51:15.431460 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:51:15.431680 (+ 220us) server_negotiation.cc:1035] Waiting for connection context
0808 14:51:15.431738 (+ 58us) server_negotiation.cc:299] Negotiation successful
0808 14:51:15.431820 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":482,"thread_start_us":318,"threads_started":1}
I20260808 14:51:15.433276 6745 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:51:15.517771 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 6608
I20260808 14:51:15.536948 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 6205
I20260808 14:51:15.538278 6274 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:51:15.640319 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 6205
2026-08-08T14:51:15Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (2382 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200577490656-27451-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:51:15 dist-test-slave-6k22 krb5kdc[6773](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:51:15 dist-test-slave-6k22 krb5kdc[6773](info): set up 2 sockets
Aug 08 14:51:15 dist-test-slave-6k22 krb5kdc[6773](info): commencing operation
krb5kdc: starting...
W20260808 14:51:16.882599 27451 mini_kdc.cc:121] Time spent starting KDC: real 1.197s user 0.000s sys 0.036s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200577490656-27451-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200577490656-27451-0/krb5kdc/test-user.keytab.
Aug 08 14:51:17 dist-test-slave-6k22 krb5kdc[6773](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200677, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:51:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:51:17Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.206.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.206.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.206.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.254.keytab.
Entry for principal kudu/127.26.206.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.254.keytab.
I20260808 14:51:17.163661 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200577490656-27451-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200577490656-27451-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200577490656-27451-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.206.254:39173
--webserver_interface=127.26.206.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.254.keytab
--principal=kudu/127.26.206.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.206.212:39689
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.206.254:39173
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:51:17.487227 6791 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:51:17.487555 6791 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:51:17.487725 6791 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:51:17.494837 6791 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:51:17.494971 6791 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:51:17.495074 6791 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:51:17.495172 6791 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:51:17.495247 6791 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:51:17.504611 6791 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:39689
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200577490656-27451-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200577490656-27451-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.206.254:39173
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.254.keytab
--principal=kudu/127.26.206.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.206.254:39173
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.206.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200577490656-27451-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:51:17.505960 6791 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:51:17.507216 6791 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:51:17.519484 6798 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:51:17.519759 6797 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:51:17.519786 6801 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:51:17.520596 6791 server_base.cc:1034] running on GCE node
I20260808 14:51:17.521409 6791 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:51:17.522713 6791 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:51:17.523965 6791 hybrid_clock.cc:648] HybridClock initialized: now 1786200677523914 us; error 48 us; skew 500 ppm
I20260808 14:51:17.524313 6791 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:51:17 dist-test-slave-6k22 krb5kdc[6773](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200677, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:51:17.532537 6791 init.cc:377] Logged in from keytab as kudu/127.26.206.254@KRBTEST.COM (short username kudu)
I20260808 14:51:17.533977 6791 webserver.cc:460] Webserver started at http://127.26.206.254:34017/ using document root <none> and password file <none>
I20260808 14:51:17.534605 6791 fs_manager.cc:359] Metadata directory not provided
I20260808 14:51:17.534770 6791 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:51:17.535108 6791 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:51:17.537989 6791 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200577490656-27451-0/minicluster-data/master-0/data/instance:
uuid: "65c1afdf586844c0bcd567d29e7ad08b"
format_stamp: "Formatted at 2026-08-08 14:51:17 on dist-test-slave-6k22"
server_key: "576cbffd84251a3be2843d9469bf5e05"
server_key_iv: "a213565d9002b43c343f56da35973c88"
server_key_version: "encryptionkey@0"
I20260808 14:51:17.538748 6791 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200577490656-27451-0/minicluster-data/master-0/wal/instance:
uuid: "65c1afdf586844c0bcd567d29e7ad08b"
format_stamp: "Formatted at 2026-08-08 14:51:17 on dist-test-slave-6k22"
server_key: "576cbffd84251a3be2843d9469bf5e05"
server_key_iv: "a213565d9002b43c343f56da35973c88"
server_key_version: "encryptionkey@0"
I20260808 14:51:17.543956 6791 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260808 14:51:17.547188 6808 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:51:17.548512 6791 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 14:51:17.548702 6791 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200577490656-27451-0/minicluster-data/master-0/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200577490656-27451-0/minicluster-data/master-0/wal
uuid: "65c1afdf586844c0bcd567d29e7ad08b"
format_stamp: "Formatted at 2026-08-08 14:51:17 on dist-test-slave-6k22"
server_key: "576cbffd84251a3be2843d9469bf5e05"
server_key_iv: "a213565d9002b43c343f56da35973c88"
server_key_version: "encryptionkey@0"
I20260808 14:51:17.548892 6791 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200577490656-27451-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200577490656-27451-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200577490656-27451-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:51:17.564038 6791 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:51:17.567811 6791 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:51:17.568087 6791 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:51:17.586285 6791 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.254:39173
I20260808 14:51:17.586315 6865 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.254:39173 every 8 connection(s)
I20260808 14:51:17.587687 6791 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
I20260808 14:51:17.591342 6866 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:51:17.597191 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 6791
I20260808 14:51:17.597430 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200577490656-27451-0/minicluster-data/master-0/wal/instance
I20260808 14:51:17.598281 27451 external_mini_cluster.cc:1428] Setting key 7d4695d7ae0f3011c8ae17be4395742f
I20260808 14:51:17.602484 6866 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 65c1afdf586844c0bcd567d29e7ad08b: Bootstrap starting.
I20260808 14:51:17.606153 6866 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 65c1afdf586844c0bcd567d29e7ad08b: Neither blocks nor log segments found. Creating new log.
I20260808 14:51:17.607335 6866 log.cc:824] T 00000000000000000000000000000000 P 65c1afdf586844c0bcd567d29e7ad08b: Log is configured to *not* fsync() on all Append() calls
I20260808 14:51:17.610373 6866 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 65c1afdf586844c0bcd567d29e7ad08b: No bootstrap required, opened a new log
Aug 08 14:51:17 dist-test-slave-6k22 krb5kdc[6773](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200677, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.206.254@KRBTEST.COM
I20260808 14:51:17.618438 6866 raft_consensus.cc:348] T 00000000000000000000000000000000 P 65c1afdf586844c0bcd567d29e7ad08b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "65c1afdf586844c0bcd567d29e7ad08b" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 39173 } }
I20260808 14:51:17.618818 6866 raft_consensus.cc:374] T 00000000000000000000000000000000 P 65c1afdf586844c0bcd567d29e7ad08b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:51:17.618937 6866 raft_consensus.cc:729] T 00000000000000000000000000000000 P 65c1afdf586844c0bcd567d29e7ad08b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65c1afdf586844c0bcd567d29e7ad08b, State: Initialized, Role: FOLLOWER
I20260808 14:51:17.619692 6866 consensus_queue.cc:260] T 00000000000000000000000000000000 P 65c1afdf586844c0bcd567d29e7ad08b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "65c1afdf586844c0bcd567d29e7ad08b" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 39173 } }
I20260808 14:51:17.620011 6866 raft_consensus.cc:388] T 00000000000000000000000000000000 P 65c1afdf586844c0bcd567d29e7ad08b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:51:17.620167 6866 raft_consensus.cc:482] T 00000000000000000000000000000000 P 65c1afdf586844c0bcd567d29e7ad08b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:51:17.620361 6866 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 65c1afdf586844c0bcd567d29e7ad08b [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:51:17.621147 6870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:51:17.600397 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46254 (local address 127.26.206.254:39173)
0808 14:51:17.601157 (+ 760us) server_negotiation.cc:206] Beginning negotiation
0808 14:51:17.601168 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 14:51:17.601208 (+ 40us) server_negotiation.cc:407] Connection header received
0808 14:51:17.602886 (+ 1678us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:51:17.602906 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:51:17.603254 (+ 348us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:51:17.603616 (+ 362us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:51:17.605548 (+ 1932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:51:17.606851 (+ 1303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:51:17.608468 (+ 1617us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:51:17.609115 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:51:17.609254 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:51:17.613900 (+ 4646us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:51:17.613908 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:51:17.613921 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:51:17.613956 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:51:17.617052 (+ 3096us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:51:17.617712 (+ 660us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:51:17.617718 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:51:17.617724 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:51:17.617890 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:51:17.618258 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:51:17.618262 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:51:17.618264 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:51:17.618840 (+ 576us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:51:17.619162 (+ 322us) server_negotiation.cc:1035] Waiting for connection context
0808 14:51:17.619614 (+ 452us) server_negotiation.cc:299] Negotiation successful
0808 14:51:17.620011 (+ 397us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":568,"thread_start_us":368,"threads_started":1}
I20260808 14:51:17.622784 6866 raft_consensus.cc:504] T 00000000000000000000000000000000 P 65c1afdf586844c0bcd567d29e7ad08b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "65c1afdf586844c0bcd567d29e7ad08b" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 39173 } }
I20260808 14:51:17.623270 6866 leader_election.cc:302] T 00000000000000000000000000000000 P 65c1afdf586844c0bcd567d29e7ad08b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 65c1afdf586844c0bcd567d29e7ad08b; no voters:
I20260808 14:51:17.623891 6866 leader_election.cc:288] T 00000000000000000000000000000000 P 65c1afdf586844c0bcd567d29e7ad08b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:51:17.623994 6873 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 65c1afdf586844c0bcd567d29e7ad08b [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:51:17.624747 6873 raft_consensus.cc:686] T 00000000000000000000000000000000 P 65c1afdf586844c0bcd567d29e7ad08b [term 1 LEADER]: Becoming Leader. State: Replica: 65c1afdf586844c0bcd567d29e7ad08b, State: Running, Role: LEADER
I20260808 14:51:17.625329 6873 consensus_queue.cc:237] T 00000000000000000000000000000000 P 65c1afdf586844c0bcd567d29e7ad08b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "65c1afdf586844c0bcd567d29e7ad08b" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 39173 } }
I20260808 14:51:17.625905 6866 sys_catalog.cc:564] T 00000000000000000000000000000000 P 65c1afdf586844c0bcd567d29e7ad08b [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:51:17.628420 6874 sys_catalog.cc:455] T 00000000000000000000000000000000 P 65c1afdf586844c0bcd567d29e7ad08b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "65c1afdf586844c0bcd567d29e7ad08b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "65c1afdf586844c0bcd567d29e7ad08b" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 39173 } } }
I20260808 14:51:17.628368 6875 sys_catalog.cc:455] T 00000000000000000000000000000000 P 65c1afdf586844c0bcd567d29e7ad08b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 65c1afdf586844c0bcd567d29e7ad08b. Latest consensus state: current_term: 1 leader_uuid: "65c1afdf586844c0bcd567d29e7ad08b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "65c1afdf586844c0bcd567d29e7ad08b" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 39173 } } }
I20260808 14:51:17.628878 6874 sys_catalog.cc:458] T 00000000000000000000000000000000 P 65c1afdf586844c0bcd567d29e7ad08b [sys.catalog]: This master's current role is: LEADER
I20260808 14:51:17.628896 6875 sys_catalog.cc:458] T 00000000000000000000000000000000 P 65c1afdf586844c0bcd567d29e7ad08b [sys.catalog]: This master's current role is: LEADER
I20260808 14:51:17.630985 6881 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:51:17.636478 6881 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:51:17.645313 6881 catalog_manager.cc:1347] Generated new cluster ID: cd40830d2b3e41628eec88ecbe3266a0
I20260808 14:51:17.645430 6881 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:51:17.658926 6881 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:51:17.660715 6881 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:51:17.678736 6881 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 65c1afdf586844c0bcd567d29e7ad08b: Generated new TSK 0
I20260808 14:51:17.679538 6881 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.206.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.206.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.206.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.193.keytab.
Entry for principal kudu/127.26.206.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.193.keytab.
I20260808 14:51:17.756996 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200577490656-27451-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200577490656-27451-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200577490656-27451-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200577490656-27451-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.206.193:0
--local_ip_for_outbound_sockets=127.26.206.193
--webserver_interface=127.26.206.193
--webserver_port=0
--tserver_master_addrs=127.26.206.254:39173
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.193.keytab
--principal=kudu/127.26.206.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.206.212:39689
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:51:18.083055 6896 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:51:18.083372 6896 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:51:18.083539 6896 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:51:18.090318 6896 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:51:18.090452 6896 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:51:18.090718 6896 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.206.193
I20260808 14:51:18.100061 6896 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:39689
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200577490656-27451-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200577490656-27451-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.193.keytab
--principal=kudu/127.26.206.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.206.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200577490656-27451-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.206.193
--webserver_port=0
--tserver_master_addrs=127.26.206.254:39173
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.206.193
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200577490656-27451-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:51:18.101343 6896 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:51:18.102605 6896 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:51:18.115435 6904 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:51:18.115413 6905 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:51:18.115549 6909 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:51:18.116513 6896 server_base.cc:1034] running on GCE node
I20260808 14:51:18.117117 6896 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:51:18.118008 6896 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:51:18.119222 6896 hybrid_clock.cc:648] HybridClock initialized: now 1786200678119179 us; error 52 us; skew 500 ppm
I20260808 14:51:18.119527 6896 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:51:18 dist-test-slave-6k22 krb5kdc[6773](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200678, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:51:18.122874 6896 init.cc:377] Logged in from keytab as kudu/127.26.206.193@KRBTEST.COM (short username kudu)
I20260808 14:51:18.124261 6896 webserver.cc:460] Webserver started at http://127.26.206.193:44731/ using document root <none> and password file <none>
I20260808 14:51:18.124871 6896 fs_manager.cc:359] Metadata directory not provided
I20260808 14:51:18.124967 6896 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:51:18.125222 6896 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:51:18.128186 6896 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200577490656-27451-0/minicluster-data/ts-0/data/instance:
uuid: "f1b0a539a9724568b8381d883fd84f29"
format_stamp: "Formatted at 2026-08-08 14:51:18 on dist-test-slave-6k22"
server_key: "b7416c042495a17b73271d090f5595ba"
server_key_iv: "688ff8c1ae680a84ccc8e872d3a1202c"
server_key_version: "encryptionkey@0"
I20260808 14:51:18.128937 6896 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200577490656-27451-0/minicluster-data/ts-0/wal/instance:
uuid: "f1b0a539a9724568b8381d883fd84f29"
format_stamp: "Formatted at 2026-08-08 14:51:18 on dist-test-slave-6k22"
server_key: "b7416c042495a17b73271d090f5595ba"
server_key_iv: "688ff8c1ae680a84ccc8e872d3a1202c"
server_key_version: "encryptionkey@0"
I20260808 14:51:18.134372 6896 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260808 14:51:18.137630 6917 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:51:18.138877 6896 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260808 14:51:18.139004 6896 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200577490656-27451-0/minicluster-data/ts-0/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200577490656-27451-0/minicluster-data/ts-0/wal
uuid: "f1b0a539a9724568b8381d883fd84f29"
format_stamp: "Formatted at 2026-08-08 14:51:18 on dist-test-slave-6k22"
server_key: "b7416c042495a17b73271d090f5595ba"
server_key_iv: "688ff8c1ae680a84ccc8e872d3a1202c"
server_key_version: "encryptionkey@0"
I20260808 14:51:18.139153 6896 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200577490656-27451-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200577490656-27451-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200577490656-27451-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:51:18.153406 6896 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:51:18.156949 6896 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:51:18.157181 6896 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:51:18.158015 6896 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:51:18.159307 6896 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:51:18.159387 6896 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:51:18.159478 6896 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:51:18.159526 6896 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:51:18.198644 6896 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.193:37619
I20260808 14:51:18.198702 7048 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.193:37619 every 8 connection(s)
I20260808 14:51:18.200076 6896 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200577490656-27451-0/minicluster-data/ts-0/data/info.pb
I20260808 14:51:18.202605 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 6896
I20260808 14:51:18.202852 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200577490656-27451-0/minicluster-data/ts-0/wal/instance
I20260808 14:51:18.203819 27451 external_mini_cluster.cc:1428] Setting key 9d6b462e0ebf8b51590d3723257fbf90
Aug 08 14:51:18 dist-test-slave-6k22 krb5kdc[6773](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200678, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.193@KRBTEST.COM for kudu/127.26.206.254@KRBTEST.COM
I20260808 14:51:18.223301 7051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:51:18.202647 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.193:44363 (local address 127.26.206.254:39173)
0808 14:51:18.203201 (+ 554us) server_negotiation.cc:206] Beginning negotiation
0808 14:51:18.203210 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:51:18.204312 (+ 1102us) server_negotiation.cc:407] Connection header received
0808 14:51:18.206515 (+ 2203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:51:18.206519 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:51:18.206582 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:51:18.206679 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:51:18.208725 (+ 2046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:51:18.209419 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:51:18.211818 (+ 2399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:51:18.212202 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:51:18.212311 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:51:18.216797 (+ 4486us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:51:18.216801 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:51:18.216804 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:51:18.216834 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:51:18.220112 (+ 3278us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:51:18.220812 (+ 700us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:51:18.220820 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:51:18.220826 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:51:18.220971 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:51:18.221374 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:51:18.221381 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:51:18.221387 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:51:18.221751 (+ 364us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:51:18.221898 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0808 14:51:18.222567 (+ 669us) server_negotiation.cc:299] Negotiation successful
0808 14:51:18.222809 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":402,"thread_start_us":263,"threads_started":1}
I20260808 14:51:18.223887 7052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:51:18.203217 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:39173 (local address 127.26.206.193:44363)
0808 14:51:18.204111 (+ 894us) negotiation.cc:107] Waiting for socket to connect
0808 14:51:18.204179 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0808 14:51:18.206240 (+ 2061us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:51:18.206958 (+ 718us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:51:18.206970 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:51:18.207765 (+ 795us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:51:18.208564 (+ 799us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:51:18.208592 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:51:18.209574 (+ 982us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:51:18.209581 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:51:18.211682 (+ 2101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:51:18.211700 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:51:18.212413 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:51:18.212422 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:51:18.212749 (+ 327us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:51:18.213485 (+ 736us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:51:18.213520 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:51:18.216577 (+ 3057us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:51:18.220256 (+ 3679us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:51:18.220274 (+ 18us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:51:18.220285 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:51:18.220684 (+ 399us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:51:18.221074 (+ 390us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:51:18.221077 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:51:18.221079 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:51:18.221251 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:51:18.221872 (+ 621us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:51:18.221877 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:51:18.222163 (+ 286us) client_negotiation.cc:769] Sending connection context
0808 14:51:18.222388 (+ 225us) client_negotiation.cc:240] Negotiation successful
0808 14:51:18.222751 (+ 363us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":587,"thread_start_us":367,"threads_started":1}
I20260808 14:51:18.225420 7049 heartbeater.cc:347] Connected to a master server at 127.26.206.254:39173
I20260808 14:51:18.225765 7049 heartbeater.cc:464] Registering TS with master...
I20260808 14:51:18.226521 7049 heartbeater.cc:511] Master 127.26.206.254:39173 requested a full tablet report, sending...
I20260808 14:51:18.228720 6828 ts_manager.cc:194] Registered new tserver with Master: f1b0a539a9724568b8381d883fd84f29 (127.26.206.193:37619)
I20260808 14:51:18.230115 6828 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.206.193@KRBTEST.COM'} at 127.26.206.193:44363
WARNING: no policy specified for kudu/127.26.206.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.206.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.206.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.194.keytab.
Entry for principal kudu/127.26.206.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.194.keytab.
I20260808 14:51:18.267232 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200577490656-27451-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200577490656-27451-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200577490656-27451-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200577490656-27451-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.206.194:0
--local_ip_for_outbound_sockets=127.26.206.194
--webserver_interface=127.26.206.194
--webserver_port=0
--tserver_master_addrs=127.26.206.254:39173
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.194.keytab
--principal=kudu/127.26.206.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.206.212:39689
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:51:18.594970 7056 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:51:18.595252 7056 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:51:18.595419 7056 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:51:18.602587 7056 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:51:18.602721 7056 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:51:18.602901 7056 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.206.194
I20260808 14:51:18.612329 7056 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:39689
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200577490656-27451-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200577490656-27451-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.194.keytab
--principal=kudu/127.26.206.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.206.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200577490656-27451-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.206.194
--webserver_port=0
--tserver_master_addrs=127.26.206.254:39173
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.206.194
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200577490656-27451-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:51:18.613559 7056 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:51:18.614821 7056 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:51:18.627729 7062 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:51:18.627691 7063 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:51:18.627766 7065 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:51:18.628626 7056 server_base.cc:1034] running on GCE node
I20260808 14:51:18.629172 7056 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:51:18.630070 7056 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:51:18.631291 7056 hybrid_clock.cc:648] HybridClock initialized: now 1786200678631243 us; error 50 us; skew 500 ppm
I20260808 14:51:18.631685 7056 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:51:18 dist-test-slave-6k22 krb5kdc[6773](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200678, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:51:18.634941 7056 init.cc:377] Logged in from keytab as kudu/127.26.206.194@KRBTEST.COM (short username kudu)
I20260808 14:51:18.636422 7056 webserver.cc:460] Webserver started at http://127.26.206.194:32925/ using document root <none> and password file <none>
I20260808 14:51:18.637101 7056 fs_manager.cc:359] Metadata directory not provided
I20260808 14:51:18.637243 7056 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:51:18.637543 7056 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:51:18.640489 7056 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200577490656-27451-0/minicluster-data/ts-1/data/instance:
uuid: "8dfb2fd996274c1d9f071b275898d233"
format_stamp: "Formatted at 2026-08-08 14:51:18 on dist-test-slave-6k22"
server_key: "8835807a07a71b062edc495ad6bc3a6d"
server_key_iv: "2d92e71f0e9cd786899e43c7ceea31b2"
server_key_version: "encryptionkey@0"
I20260808 14:51:18.641300 7056 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200577490656-27451-0/minicluster-data/ts-1/wal/instance:
uuid: "8dfb2fd996274c1d9f071b275898d233"
format_stamp: "Formatted at 2026-08-08 14:51:18 on dist-test-slave-6k22"
server_key: "8835807a07a71b062edc495ad6bc3a6d"
server_key_iv: "2d92e71f0e9cd786899e43c7ceea31b2"
server_key_version: "encryptionkey@0"
I20260808 14:51:18.646418 7056 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260808 14:51:18.649767 7075 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:51:18.651058 7056 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.001s
I20260808 14:51:18.651224 7056 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200577490656-27451-0/minicluster-data/ts-1/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200577490656-27451-0/minicluster-data/ts-1/wal
uuid: "8dfb2fd996274c1d9f071b275898d233"
format_stamp: "Formatted at 2026-08-08 14:51:18 on dist-test-slave-6k22"
server_key: "8835807a07a71b062edc495ad6bc3a6d"
server_key_iv: "2d92e71f0e9cd786899e43c7ceea31b2"
server_key_version: "encryptionkey@0"
I20260808 14:51:18.651430 7056 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200577490656-27451-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200577490656-27451-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200577490656-27451-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:51:18.674957 7056 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:51:18.678807 7056 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:51:18.679109 7056 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:51:18.680059 7056 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:51:18.681380 7056 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:51:18.681478 7056 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:51:18.681618 7056 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:51:18.681689 7056 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:51:18.714136 7056 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.194:33961
I20260808 14:51:18.714179 7206 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.194:33961 every 8 connection(s)
I20260808 14:51:18.715391 7056 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200577490656-27451-0/minicluster-data/ts-1/data/info.pb
I20260808 14:51:18.723429 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 7056
I20260808 14:51:18.723682 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200577490656-27451-0/minicluster-data/ts-1/wal/instance
I20260808 14:51:18.724339 27451 external_mini_cluster.cc:1428] Setting key a21faa502d8d312c04f66370fc961047
Aug 08 14:51:18 dist-test-slave-6k22 krb5kdc[6773](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200678, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.194@KRBTEST.COM for kudu/127.26.206.254@KRBTEST.COM
I20260808 14:51:18.736900 7051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:51:18.717956 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.194:39205 (local address 127.26.206.254:39173)
0808 14:51:18.718123 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0808 14:51:18.718128 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:51:18.719276 (+ 1148us) server_negotiation.cc:407] Connection header received
0808 14:51:18.721145 (+ 1869us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:51:18.721152 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:51:18.721243 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:51:18.721374 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:51:18.722827 (+ 1453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:51:18.723871 (+ 1044us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:51:18.726054 (+ 2183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:51:18.726708 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:51:18.726807 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:51:18.731115 (+ 4308us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:51:18.731136 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:51:18.731143 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:51:18.731183 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:51:18.733894 (+ 2711us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:51:18.734611 (+ 717us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:51:18.734617 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:51:18.734621 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:51:18.734748 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:51:18.735154 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:51:18.735159 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:51:18.735162 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:51:18.735481 (+ 319us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:51:18.735649 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0808 14:51:18.736313 (+ 664us) server_negotiation.cc:299] Negotiation successful
0808 14:51:18.736536 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260808 14:51:18.737838 7209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:51:18.718412 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:39173 (local address 127.26.206.194:39205)
0808 14:51:18.719120 (+ 708us) negotiation.cc:107] Waiting for socket to connect
0808 14:51:18.719159 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 14:51:18.720880 (+ 1721us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:51:18.721601 (+ 721us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:51:18.721609 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:51:18.722101 (+ 492us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:51:18.722658 (+ 557us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:51:18.722673 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:51:18.724059 (+ 1386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:51:18.724066 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:51:18.725918 (+ 1852us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:51:18.725931 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:51:18.726955 (+ 1024us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:51:18.726962 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:51:18.727266 (+ 304us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:51:18.728049 (+ 783us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:51:18.728084 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:51:18.730873 (+ 2789us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:51:18.734052 (+ 3179us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:51:18.734060 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:51:18.734075 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:51:18.734486 (+ 411us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:51:18.734861 (+ 375us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:51:18.734866 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:51:18.734869 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:51:18.735045 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:51:18.735616 (+ 571us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:51:18.735624 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:51:18.735955 (+ 331us) client_negotiation.cc:769] Sending connection context
0808 14:51:18.736223 (+ 268us) client_negotiation.cc:240] Negotiation successful
0808 14:51:18.736756 (+ 533us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":485,"thread_start_us":270,"threads_started":1}
I20260808 14:51:18.739271 7207 heartbeater.cc:347] Connected to a master server at 127.26.206.254:39173
I20260808 14:51:18.739652 7207 heartbeater.cc:464] Registering TS with master...
I20260808 14:51:18.740587 7207 heartbeater.cc:511] Master 127.26.206.254:39173 requested a full tablet report, sending...
I20260808 14:51:18.742105 6828 ts_manager.cc:194] Registered new tserver with Master: 8dfb2fd996274c1d9f071b275898d233 (127.26.206.194:33961)
I20260808 14:51:18.743029 6828 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.206.194@KRBTEST.COM'} at 127.26.206.194:39205
WARNING: no policy specified for kudu/127.26.206.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.206.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.206.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.195.keytab.
Entry for principal kudu/127.26.206.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.195.keytab.
I20260808 14:51:18.786727 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200577490656-27451-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200577490656-27451-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200577490656-27451-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200577490656-27451-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.206.195:0
--local_ip_for_outbound_sockets=127.26.206.195
--webserver_interface=127.26.206.195
--webserver_port=0
--tserver_master_addrs=127.26.206.254:39173
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.195.keytab
--principal=kudu/127.26.206.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.206.212:39689
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:51:19.114913 7212 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:51:19.115178 7212 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:51:19.115270 7212 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:51:19.122681 7212 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:51:19.122797 7212 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:51:19.122905 7212 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.206.195
I20260808 14:51:19.132074 7212 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:39689
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200577490656-27451-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200577490656-27451-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.195.keytab
--principal=kudu/127.26.206.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.206.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200577490656-27451-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.206.195
--webserver_port=0
--tserver_master_addrs=127.26.206.254:39173
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.206.195
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200577490656-27451-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:51:19.133320 7212 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:51:19.134538 7212 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:51:19.147154 7218 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:51:19.147212 7219 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:51:19.147243 7222 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:51:19.148401 7212 server_base.cc:1034] running on GCE node
I20260808 14:51:19.148944 7212 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:51:19.149847 7212 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:51:19.151065 7212 hybrid_clock.cc:648] HybridClock initialized: now 1786200679151024 us; error 47 us; skew 500 ppm
I20260808 14:51:19.151377 7212 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:51:19 dist-test-slave-6k22 krb5kdc[6773](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200679, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:51:19.154677 7212 init.cc:377] Logged in from keytab as kudu/127.26.206.195@KRBTEST.COM (short username kudu)
I20260808 14:51:19.156069 7212 webserver.cc:460] Webserver started at http://127.26.206.195:35247/ using document root <none> and password file <none>
I20260808 14:51:19.156802 7212 fs_manager.cc:359] Metadata directory not provided
I20260808 14:51:19.156944 7212 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:51:19.157232 7212 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:51:19.160081 7212 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200577490656-27451-0/minicluster-data/ts-2/data/instance:
uuid: "5d904e7b346344f8b9a334ce40bd6e67"
format_stamp: "Formatted at 2026-08-08 14:51:19 on dist-test-slave-6k22"
server_key: "f365248aa2e68f93d470907441f67f6e"
server_key_iv: "e6df17e4d3312f0e0d5b8c468313065a"
server_key_version: "encryptionkey@0"
I20260808 14:51:19.160826 7212 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200577490656-27451-0/minicluster-data/ts-2/wal/instance:
uuid: "5d904e7b346344f8b9a334ce40bd6e67"
format_stamp: "Formatted at 2026-08-08 14:51:19 on dist-test-slave-6k22"
server_key: "f365248aa2e68f93d470907441f67f6e"
server_key_iv: "e6df17e4d3312f0e0d5b8c468313065a"
server_key_version: "encryptionkey@0"
I20260808 14:51:19.165721 7212 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.003s
I20260808 14:51:19.168963 7231 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:51:19.170135 7212 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 14:51:19.170310 7212 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200577490656-27451-0/minicluster-data/ts-2/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200577490656-27451-0/minicluster-data/ts-2/wal
uuid: "5d904e7b346344f8b9a334ce40bd6e67"
format_stamp: "Formatted at 2026-08-08 14:51:19 on dist-test-slave-6k22"
server_key: "f365248aa2e68f93d470907441f67f6e"
server_key_iv: "e6df17e4d3312f0e0d5b8c468313065a"
server_key_version: "encryptionkey@0"
I20260808 14:51:19.170509 7212 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200577490656-27451-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200577490656-27451-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200577490656-27451-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:51:19.186053 7212 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:51:19.190289 7212 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:51:19.190593 7212 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:51:19.191538 7212 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:51:19.192958 7212 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:51:19.193065 7212 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:51:19.193223 7212 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:51:19.193300 7212 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:51:19.233121 7049 heartbeater.cc:503] Master 127.26.206.254:39173 was elected leader, sending a full tablet report...
I20260808 14:51:19.234681 7212 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.195:35753
I20260808 14:51:19.234673 7363 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.195:35753 every 8 connection(s)
I20260808 14:51:19.236351 7212 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200577490656-27451-0/minicluster-data/ts-2/data/info.pb
I20260808 14:51:19.244704 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 7212
I20260808 14:51:19.244910 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200577490656-27451-0/minicluster-data/ts-2/wal/instance
I20260808 14:51:19.245410 27451 external_mini_cluster.cc:1428] Setting key d94f0ea088cca5b9fe5aba5e6bdc5544
Aug 08 14:51:19 dist-test-slave-6k22 krb5kdc[6773](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200679, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.195@KRBTEST.COM for kudu/127.26.206.254@KRBTEST.COM
I20260808 14:51:19.257493 7366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:51:19.238945 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.195:47431 (local address 127.26.206.254:39173)
0808 14:51:19.239364 (+ 419us) server_negotiation.cc:206] Beginning negotiation
0808 14:51:19.239368 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:51:19.240418 (+ 1050us) server_negotiation.cc:407] Connection header received
0808 14:51:19.242181 (+ 1763us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:51:19.242186 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:51:19.242308 (+ 122us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:51:19.242419 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:51:19.244053 (+ 1634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:51:19.244986 (+ 933us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:51:19.246909 (+ 1923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:51:19.247491 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:51:19.247731 (+ 240us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:51:19.251231 (+ 3500us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:51:19.251244 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:51:19.251247 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:51:19.251280 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:51:19.254267 (+ 2987us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:51:19.255000 (+ 733us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:51:19.255007 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:51:19.255011 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:51:19.255145 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:51:19.255660 (+ 515us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:51:19.255664 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:51:19.255666 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:51:19.255940 (+ 274us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:51:19.256097 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0808 14:51:19.256819 (+ 722us) server_negotiation.cc:299] Negotiation successful
0808 14:51:19.257057 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":327,"thread_start_us":228,"threads_started":1}
I20260808 14:51:19.258420 7367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:51:19.239454 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:39173 (local address 127.26.206.195:47431)
0808 14:51:19.240271 (+ 817us) negotiation.cc:107] Waiting for socket to connect
0808 14:51:19.240313 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 14:51:19.241934 (+ 1621us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:51:19.242668 (+ 734us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:51:19.242680 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:51:19.243203 (+ 523us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:51:19.243894 (+ 691us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:51:19.243913 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:51:19.245141 (+ 1228us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:51:19.245146 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:51:19.246560 (+ 1414us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:51:19.246571 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:51:19.247791 (+ 1220us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:51:19.247797 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:51:19.247989 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:51:19.248766 (+ 777us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:51:19.248803 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:51:19.251010 (+ 2207us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:51:19.254425 (+ 3415us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:51:19.254435 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:51:19.254449 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:51:19.254873 (+ 424us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:51:19.255259 (+ 386us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:51:19.255266 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:51:19.255270 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:51:19.255487 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:51:19.256073 (+ 586us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:51:19.256080 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:51:19.256416 (+ 336us) client_negotiation.cc:769] Sending connection context
0808 14:51:19.256713 (+ 297us) client_negotiation.cc:240] Negotiation successful
0808 14:51:19.257239 (+ 526us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":536,"thread_start_us":296,"threads_started":1}
I20260808 14:51:19.259974 7364 heartbeater.cc:347] Connected to a master server at 127.26.206.254:39173
I20260808 14:51:19.260293 7364 heartbeater.cc:464] Registering TS with master...
I20260808 14:51:19.261173 7364 heartbeater.cc:511] Master 127.26.206.254:39173 requested a full tablet report, sending...
I20260808 14:51:19.262463 6828 ts_manager.cc:194] Registered new tserver with Master: 5d904e7b346344f8b9a334ce40bd6e67 (127.26.206.195:35753)
I20260808 14:51:19.263206 6828 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.206.195@KRBTEST.COM'} at 127.26.206.195:47431
I20260808 14:51:19.273275 27451 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 14:51:19.290303 7366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:51:19.277910 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34426 (local address 127.26.206.254:39173)
0808 14:51:19.278070 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0808 14:51:19.278075 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:51:19.278591 (+ 516us) server_negotiation.cc:407] Connection header received
0808 14:51:19.278785 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:51:19.278790 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:51:19.278863 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:51:19.278970 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:51:19.280431 (+ 1461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:51:19.281138 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:51:19.282377 (+ 1239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:51:19.282777 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:51:19.282909 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:51:19.285303 (+ 2394us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:51:19.285308 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:51:19.285311 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:51:19.285340 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:51:19.287803 (+ 2463us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:51:19.288402 (+ 599us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:51:19.288409 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:51:19.288412 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:51:19.288529 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:51:19.288878 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:51:19.288883 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:51:19.288887 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:51:19.289195 (+ 308us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:51:19.289456 (+ 261us) server_negotiation.cc:1035] Waiting for connection context
0808 14:51:19.289796 (+ 340us) server_negotiation.cc:299] Negotiation successful
0808 14:51:19.290004 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260808 14:51:19.294389 6828 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34426:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:51:19.301093 6828 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:51:19.327380 7378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:51:19.312964 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.193:37619 (local address 127.0.0.1:41286)
0808 14:51:19.314470 (+ 1506us) negotiation.cc:107] Waiting for socket to connect
0808 14:51:19.314518 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0808 14:51:19.314672 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:51:19.316542 (+ 1870us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:51:19.316550 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:51:19.316578 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:51:19.317182 (+ 604us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:51:19.317204 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:51:19.320145 (+ 2941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:51:19.320150 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:51:19.323390 (+ 3240us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:51:19.323413 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:51:19.326203 (+ 2790us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:51:19.326213 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:51:19.326519 (+ 306us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:51:19.326593 (+ 74us) client_negotiation.cc:769] Sending connection context
0808 14:51:19.326748 (+ 155us) client_negotiation.cc:240] Negotiation successful
0808 14:51:19.326939 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1324,"thread_start_us":1206,"threads_started":1}
I20260808 14:51:19.327443 7380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:51:19.313185 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41286 (local address 127.26.206.193:37619)
0808 14:51:19.314047 (+ 862us) server_negotiation.cc:206] Beginning negotiation
0808 14:51:19.314054 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:51:19.314632 (+ 578us) server_negotiation.cc:407] Connection header received
0808 14:51:19.314894 (+ 262us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:51:19.314905 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:51:19.315161 (+ 256us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:51:19.315382 (+ 221us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:51:19.317493 (+ 2111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:51:19.319975 (+ 2482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:51:19.323687 (+ 3712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:51:19.325413 (+ 1726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:51:19.325670 (+ 257us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:51:19.325908 (+ 238us) server_negotiation.cc:1035] Waiting for connection context
0808 14:51:19.326924 (+ 1016us) server_negotiation.cc:299] Negotiation successful
0808 14:51:19.327099 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":703,"thread_start_us":520,"threads_started":1}
I20260808 14:51:19.331528 6974 tablet_service.cc:1467] Processing CreateTablet for tablet 23ba314cb7654f1ca9e4d1da7c0664fd (DEFAULT_TABLE table=test-table [id=0c10de67f1f94f2ea4b26cb9aa6bb634]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:51:19.333052 6974 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 23ba314cb7654f1ca9e4d1da7c0664fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:51:19.334635 7384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:51:19.316139 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40624 (local address 127.26.206.195:35753)
0808 14:51:19.326611 (+ 10472us) server_negotiation.cc:206] Beginning negotiation
0808 14:51:19.326621 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 14:51:19.326659 (+ 38us) server_negotiation.cc:407] Connection header received
0808 14:51:19.326755 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:51:19.326763 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:51:19.327007 (+ 244us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:51:19.327803 (+ 796us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:51:19.328126 (+ 323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:51:19.329451 (+ 1325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:51:19.332104 (+ 2653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:51:19.333493 (+ 1389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:51:19.333689 (+ 196us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:51:19.333837 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0808 14:51:19.334143 (+ 306us) server_negotiation.cc:299] Negotiation successful
0808 14:51:19.334309 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10293,"thread_start_us":10132,"threads_started":1}
I20260808 14:51:19.334765 7381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:51:19.314854 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.194:33961 (local address 127.0.0.1:51606)
0808 14:51:19.315382 (+ 528us) negotiation.cc:107] Waiting for socket to connect
0808 14:51:19.315404 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 14:51:19.315549 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:51:19.327495 (+ 11946us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:51:19.327499 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:51:19.327519 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:51:19.328007 (+ 488us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:51:19.328018 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:51:19.330077 (+ 2059us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:51:19.330083 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:51:19.332371 (+ 2288us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:51:19.332384 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:51:19.333819 (+ 1435us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:51:19.333825 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:51:19.333981 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:51:19.334017 (+ 36us) client_negotiation.cc:769] Sending connection context
0808 14:51:19.334076 (+ 59us) client_negotiation.cc:240] Negotiation successful
0808 14:51:19.334211 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":396,"mutex_wait_us":6,"thread_start_us":270,"threads_started":1}
I20260808 14:51:19.335529 7383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:51:19.315494 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.195:35753 (local address 127.0.0.1:40624)
0808 14:51:19.325551 (+ 10057us) negotiation.cc:107] Waiting for socket to connect
0808 14:51:19.325578 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0808 14:51:19.325924 (+ 346us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:51:19.327233 (+ 1309us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:51:19.327238 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:51:19.327266 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:51:19.327751 (+ 485us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:51:19.327761 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:51:19.329622 (+ 1861us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:51:19.329627 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:51:19.331872 (+ 2245us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:51:19.331889 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:51:19.333721 (+ 1832us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:51:19.333728 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:51:19.333928 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:51:19.333966 (+ 38us) client_negotiation.cc:769] Sending connection context
0808 14:51:19.334059 (+ 93us) client_negotiation.cc:240] Negotiation successful
0808 14:51:19.334197 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9912,"mutex_wait_us":4,"thread_start_us":10184,"threads_started":1}
I20260808 14:51:19.335837 7382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:51:19.315105 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51606 (local address 127.26.206.194:33961)
0808 14:51:19.326880 (+ 11775us) server_negotiation.cc:206] Beginning negotiation
0808 14:51:19.326888 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:51:19.326912 (+ 24us) server_negotiation.cc:407] Connection header received
0808 14:51:19.327005 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:51:19.327012 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:51:19.327260 (+ 248us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:51:19.328309 (+ 1049us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:51:19.328519 (+ 210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:51:19.329905 (+ 1386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:51:19.332537 (+ 2632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:51:19.333552 (+ 1015us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:51:19.334987 (+ 1435us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:51:19.335188 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0808 14:51:19.335261 (+ 73us) server_negotiation.cc:299] Negotiation successful
0808 14:51:19.335436 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11621,"thread_start_us":11522,"threads_started":1}
I20260808 14:51:19.338950 7129 tablet_service.cc:1467] Processing CreateTablet for tablet 23ba314cb7654f1ca9e4d1da7c0664fd (DEFAULT_TABLE table=test-table [id=0c10de67f1f94f2ea4b26cb9aa6bb634]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:51:19.339466 7291 tablet_service.cc:1467] Processing CreateTablet for tablet 23ba314cb7654f1ca9e4d1da7c0664fd (DEFAULT_TABLE table=test-table [id=0c10de67f1f94f2ea4b26cb9aa6bb634]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:51:19.340198 7129 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 23ba314cb7654f1ca9e4d1da7c0664fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:51:19.340749 7291 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 23ba314cb7654f1ca9e4d1da7c0664fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:51:19.347633 7385 tablet_bootstrap.cc:492] T 23ba314cb7654f1ca9e4d1da7c0664fd P f1b0a539a9724568b8381d883fd84f29: Bootstrap starting.
I20260808 14:51:19.351513 7385 tablet_bootstrap.cc:654] T 23ba314cb7654f1ca9e4d1da7c0664fd P f1b0a539a9724568b8381d883fd84f29: Neither blocks nor log segments found. Creating new log.
I20260808 14:51:19.352905 7385 log.cc:824] T 23ba314cb7654f1ca9e4d1da7c0664fd P f1b0a539a9724568b8381d883fd84f29: Log is configured to *not* fsync() on all Append() calls
I20260808 14:51:19.353485 7386 tablet_bootstrap.cc:492] T 23ba314cb7654f1ca9e4d1da7c0664fd P 8dfb2fd996274c1d9f071b275898d233: Bootstrap starting.
I20260808 14:51:19.355628 7387 tablet_bootstrap.cc:492] T 23ba314cb7654f1ca9e4d1da7c0664fd P 5d904e7b346344f8b9a334ce40bd6e67: Bootstrap starting.
I20260808 14:51:19.356739 7385 tablet_bootstrap.cc:492] T 23ba314cb7654f1ca9e4d1da7c0664fd P f1b0a539a9724568b8381d883fd84f29: No bootstrap required, opened a new log
I20260808 14:51:19.357012 7385 ts_tablet_manager.cc:1397] T 23ba314cb7654f1ca9e4d1da7c0664fd P f1b0a539a9724568b8381d883fd84f29: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.001s
I20260808 14:51:19.357369 7386 tablet_bootstrap.cc:654] T 23ba314cb7654f1ca9e4d1da7c0664fd P 8dfb2fd996274c1d9f071b275898d233: Neither blocks nor log segments found. Creating new log.
I20260808 14:51:19.358624 7386 log.cc:824] T 23ba314cb7654f1ca9e4d1da7c0664fd P 8dfb2fd996274c1d9f071b275898d233: Log is configured to *not* fsync() on all Append() calls
I20260808 14:51:19.359118 7387 tablet_bootstrap.cc:654] T 23ba314cb7654f1ca9e4d1da7c0664fd P 5d904e7b346344f8b9a334ce40bd6e67: Neither blocks nor log segments found. Creating new log.
I20260808 14:51:19.360368 7387 log.cc:824] T 23ba314cb7654f1ca9e4d1da7c0664fd P 5d904e7b346344f8b9a334ce40bd6e67: Log is configured to *not* fsync() on all Append() calls
I20260808 14:51:19.362353 7386 tablet_bootstrap.cc:492] T 23ba314cb7654f1ca9e4d1da7c0664fd P 8dfb2fd996274c1d9f071b275898d233: No bootstrap required, opened a new log
I20260808 14:51:19.362603 7386 ts_tablet_manager.cc:1397] T 23ba314cb7654f1ca9e4d1da7c0664fd P 8dfb2fd996274c1d9f071b275898d233: Time spent bootstrapping tablet: real 0.009s user 0.008s sys 0.000s
I20260808 14:51:19.363251 7387 tablet_bootstrap.cc:492] T 23ba314cb7654f1ca9e4d1da7c0664fd P 5d904e7b346344f8b9a334ce40bd6e67: No bootstrap required, opened a new log
I20260808 14:51:19.363514 7387 ts_tablet_manager.cc:1397] T 23ba314cb7654f1ca9e4d1da7c0664fd P 5d904e7b346344f8b9a334ce40bd6e67: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.005s
I20260808 14:51:19.366832 7385 raft_consensus.cc:348] T 23ba314cb7654f1ca9e4d1da7c0664fd P f1b0a539a9724568b8381d883fd84f29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b0a539a9724568b8381d883fd84f29" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 37619 } } peers { permanent_uuid: "8dfb2fd996274c1d9f071b275898d233" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 33961 } } peers { permanent_uuid: "5d904e7b346344f8b9a334ce40bd6e67" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 35753 } }
I20260808 14:51:19.367268 7385 raft_consensus.cc:374] T 23ba314cb7654f1ca9e4d1da7c0664fd P f1b0a539a9724568b8381d883fd84f29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:51:19.367375 7385 raft_consensus.cc:729] T 23ba314cb7654f1ca9e4d1da7c0664fd P f1b0a539a9724568b8381d883fd84f29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1b0a539a9724568b8381d883fd84f29, State: Initialized, Role: FOLLOWER
I20260808 14:51:19.368021 7385 consensus_queue.cc:260] T 23ba314cb7654f1ca9e4d1da7c0664fd P f1b0a539a9724568b8381d883fd84f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b0a539a9724568b8381d883fd84f29" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 37619 } } peers { permanent_uuid: "8dfb2fd996274c1d9f071b275898d233" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 33961 } } peers { permanent_uuid: "5d904e7b346344f8b9a334ce40bd6e67" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 35753 } }
I20260808 14:51:19.369755 7385 ts_tablet_manager.cc:1428] T 23ba314cb7654f1ca9e4d1da7c0664fd P f1b0a539a9724568b8381d883fd84f29: Time spent starting tablet: real 0.013s user 0.010s sys 0.003s
I20260808 14:51:19.370385 7386 raft_consensus.cc:348] T 23ba314cb7654f1ca9e4d1da7c0664fd P 8dfb2fd996274c1d9f071b275898d233 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b0a539a9724568b8381d883fd84f29" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 37619 } } peers { permanent_uuid: "8dfb2fd996274c1d9f071b275898d233" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 33961 } } peers { permanent_uuid: "5d904e7b346344f8b9a334ce40bd6e67" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 35753 } }
I20260808 14:51:19.370838 7386 raft_consensus.cc:374] T 23ba314cb7654f1ca9e4d1da7c0664fd P 8dfb2fd996274c1d9f071b275898d233 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:51:19.370949 7386 raft_consensus.cc:729] T 23ba314cb7654f1ca9e4d1da7c0664fd P 8dfb2fd996274c1d9f071b275898d233 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dfb2fd996274c1d9f071b275898d233, State: Initialized, Role: FOLLOWER
I20260808 14:51:19.371498 7386 consensus_queue.cc:260] T 23ba314cb7654f1ca9e4d1da7c0664fd P 8dfb2fd996274c1d9f071b275898d233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b0a539a9724568b8381d883fd84f29" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 37619 } } peers { permanent_uuid: "8dfb2fd996274c1d9f071b275898d233" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 33961 } } peers { permanent_uuid: "5d904e7b346344f8b9a334ce40bd6e67" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 35753 } }
I20260808 14:51:19.372570 7207 heartbeater.cc:503] Master 127.26.206.254:39173 was elected leader, sending a full tablet report...
I20260808 14:51:19.373199 7386 ts_tablet_manager.cc:1428] T 23ba314cb7654f1ca9e4d1da7c0664fd P 8dfb2fd996274c1d9f071b275898d233: Time spent starting tablet: real 0.010s user 0.010s sys 0.000s
I20260808 14:51:19.373756 7387 raft_consensus.cc:348] T 23ba314cb7654f1ca9e4d1da7c0664fd P 5d904e7b346344f8b9a334ce40bd6e67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b0a539a9724568b8381d883fd84f29" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 37619 } } peers { permanent_uuid: "8dfb2fd996274c1d9f071b275898d233" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 33961 } } peers { permanent_uuid: "5d904e7b346344f8b9a334ce40bd6e67" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 35753 } }
I20260808 14:51:19.374181 7387 raft_consensus.cc:374] T 23ba314cb7654f1ca9e4d1da7c0664fd P 5d904e7b346344f8b9a334ce40bd6e67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:51:19.374305 7387 raft_consensus.cc:729] T 23ba314cb7654f1ca9e4d1da7c0664fd P 5d904e7b346344f8b9a334ce40bd6e67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d904e7b346344f8b9a334ce40bd6e67, State: Initialized, Role: FOLLOWER
I20260808 14:51:19.375010 7387 consensus_queue.cc:260] T 23ba314cb7654f1ca9e4d1da7c0664fd P 5d904e7b346344f8b9a334ce40bd6e67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b0a539a9724568b8381d883fd84f29" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 37619 } } peers { permanent_uuid: "8dfb2fd996274c1d9f071b275898d233" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 33961 } } peers { permanent_uuid: "5d904e7b346344f8b9a334ce40bd6e67" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 35753 } }
I20260808 14:51:19.376106 7364 heartbeater.cc:503] Master 127.26.206.254:39173 was elected leader, sending a full tablet report...
I20260808 14:51:19.376894 7387 ts_tablet_manager.cc:1428] T 23ba314cb7654f1ca9e4d1da7c0664fd P 5d904e7b346344f8b9a334ce40bd6e67: Time spent starting tablet: real 0.013s user 0.012s sys 0.000s
I20260808 14:51:19.420344 7392 raft_consensus.cc:482] T 23ba314cb7654f1ca9e4d1da7c0664fd P f1b0a539a9724568b8381d883fd84f29 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:51:19.420652 7392 raft_consensus.cc:504] T 23ba314cb7654f1ca9e4d1da7c0664fd P f1b0a539a9724568b8381d883fd84f29 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b0a539a9724568b8381d883fd84f29" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 37619 } } peers { permanent_uuid: "8dfb2fd996274c1d9f071b275898d233" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 33961 } } peers { permanent_uuid: "5d904e7b346344f8b9a334ce40bd6e67" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 35753 } }
I20260808 14:51:19.422283 7392 leader_election.cc:288] T 23ba314cb7654f1ca9e4d1da7c0664fd P f1b0a539a9724568b8381d883fd84f29 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8dfb2fd996274c1d9f071b275898d233 (127.26.206.194:33961), 5d904e7b346344f8b9a334ce40bd6e67 (127.26.206.195:35753)
I20260808 14:51:19.430285 7382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:51:19.422757 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.193:34631 (local address 127.26.206.194:33961)
0808 14:51:19.423060 (+ 303us) server_negotiation.cc:206] Beginning negotiation
0808 14:51:19.423066 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:51:19.423351 (+ 285us) server_negotiation.cc:407] Connection header received
0808 14:51:19.423600 (+ 249us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:51:19.423605 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:51:19.423685 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:51:19.423795 (+ 110us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:51:19.424597 (+ 802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:51:19.425544 (+ 947us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:51:19.428180 (+ 2636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:51:19.429342 (+ 1162us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:51:19.429488 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:51:19.429563 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0808 14:51:19.429942 (+ 379us) server_negotiation.cc:299] Negotiation successful
0808 14:51:19.430032 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260808 14:51:19.430491 7384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:51:19.423792 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.193:38841 (local address 127.26.206.195:35753)
0808 14:51:19.423986 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0808 14:51:19.423990 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:51:19.424248 (+ 258us) server_negotiation.cc:407] Connection header received
0808 14:51:19.424427 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:51:19.424430 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:51:19.424484 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:51:19.424601 (+ 117us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:51:19.425013 (+ 412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:51:19.425986 (+ 973us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:51:19.428387 (+ 2401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:51:19.429574 (+ 1187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:51:19.429693 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:51:19.429739 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0808 14:51:19.430125 (+ 386us) server_negotiation.cc:299] Negotiation successful
0808 14:51:19.430241 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260808 14:51:19.430490 7395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:51:19.422548 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.194:33961 (local address 127.26.206.193:34631)
0808 14:51:19.423247 (+ 699us) negotiation.cc:107] Waiting for socket to connect
0808 14:51:19.423264 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 14:51:19.423420 (+ 156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:51:19.423989 (+ 569us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:51:19.423993 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:51:19.424018 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:51:19.424454 (+ 436us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:51:19.424470 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:51:19.425660 (+ 1190us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:51:19.425663 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:51:19.428043 (+ 2380us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:51:19.428057 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:51:19.429543 (+ 1486us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:51:19.429547 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:51:19.429701 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:51:19.429772 (+ 71us) client_negotiation.cc:769] Sending connection context
0808 14:51:19.429897 (+ 125us) client_negotiation.cc:240] Negotiation successful
0808 14:51:19.430022 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":580,"mutex_wait_us":58,"spinlock_wait_cycles":3840,"thread_start_us":552,"threads_started":1}
I20260808 14:51:19.430584 7397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:51:19.423504 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.195:35753 (local address 127.26.206.193:38841)
0808 14:51:19.424139 (+ 635us) negotiation.cc:107] Waiting for socket to connect
0808 14:51:19.424161 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 14:51:19.424298 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:51:19.424615 (+ 317us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:51:19.424617 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:51:19.424635 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:51:19.424885 (+ 250us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:51:19.424892 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:51:19.426107 (+ 1215us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:51:19.426114 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:51:19.428259 (+ 2145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:51:19.428268 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:51:19.429776 (+ 1508us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:51:19.429781 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:51:19.429981 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:51:19.430010 (+ 29us) client_negotiation.cc:769] Sending connection context
0808 14:51:19.430084 (+ 74us) client_negotiation.cc:240] Negotiation successful
0808 14:51:19.430201 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":503,"mutex_wait_us":5,"thread_start_us":292,"threads_started":1}
I20260808 14:51:19.431617 7153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "23ba314cb7654f1ca9e4d1da7c0664fd" candidate_uuid: "f1b0a539a9724568b8381d883fd84f29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dfb2fd996274c1d9f071b275898d233" is_pre_election: true
I20260808 14:51:19.431638 7313 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "23ba314cb7654f1ca9e4d1da7c0664fd" candidate_uuid: "f1b0a539a9724568b8381d883fd84f29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d904e7b346344f8b9a334ce40bd6e67" is_pre_election: true
I20260808 14:51:19.432099 7153 raft_consensus.cc:2454] T 23ba314cb7654f1ca9e4d1da7c0664fd P 8dfb2fd996274c1d9f071b275898d233 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1b0a539a9724568b8381d883fd84f29 in term 0.
I20260808 14:51:19.432101 7313 raft_consensus.cc:2454] T 23ba314cb7654f1ca9e4d1da7c0664fd P 5d904e7b346344f8b9a334ce40bd6e67 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1b0a539a9724568b8381d883fd84f29 in term 0.
I20260808 14:51:19.432730 6918 leader_election.cc:302] T 23ba314cb7654f1ca9e4d1da7c0664fd P f1b0a539a9724568b8381d883fd84f29 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dfb2fd996274c1d9f071b275898d233, f1b0a539a9724568b8381d883fd84f29; no voters:
I20260808 14:51:19.433089 7392 raft_consensus.cc:2781] T 23ba314cb7654f1ca9e4d1da7c0664fd P f1b0a539a9724568b8381d883fd84f29 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:51:19.433224 7392 raft_consensus.cc:482] T 23ba314cb7654f1ca9e4d1da7c0664fd P f1b0a539a9724568b8381d883fd84f29 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:51:19.433337 7392 raft_consensus.cc:3037] T 23ba314cb7654f1ca9e4d1da7c0664fd P f1b0a539a9724568b8381d883fd84f29 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:51:19.435786 7392 raft_consensus.cc:504] T 23ba314cb7654f1ca9e4d1da7c0664fd P f1b0a539a9724568b8381d883fd84f29 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b0a539a9724568b8381d883fd84f29" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 37619 } } peers { permanent_uuid: "8dfb2fd996274c1d9f071b275898d233" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 33961 } } peers { permanent_uuid: "5d904e7b346344f8b9a334ce40bd6e67" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 35753 } }
I20260808 14:51:19.436305 7392 leader_election.cc:288] T 23ba314cb7654f1ca9e4d1da7c0664fd P f1b0a539a9724568b8381d883fd84f29 [CANDIDATE]: Term 1 election: Requested vote from peers 8dfb2fd996274c1d9f071b275898d233 (127.26.206.194:33961), 5d904e7b346344f8b9a334ce40bd6e67 (127.26.206.195:35753)
I20260808 14:51:19.436721 7153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "23ba314cb7654f1ca9e4d1da7c0664fd" candidate_uuid: "f1b0a539a9724568b8381d883fd84f29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dfb2fd996274c1d9f071b275898d233"
I20260808 14:51:19.436784 7313 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "23ba314cb7654f1ca9e4d1da7c0664fd" candidate_uuid: "f1b0a539a9724568b8381d883fd84f29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d904e7b346344f8b9a334ce40bd6e67"
I20260808 14:51:19.436952 7153 raft_consensus.cc:3037] T 23ba314cb7654f1ca9e4d1da7c0664fd P 8dfb2fd996274c1d9f071b275898d233 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:51:19.436968 7313 raft_consensus.cc:3037] T 23ba314cb7654f1ca9e4d1da7c0664fd P 5d904e7b346344f8b9a334ce40bd6e67 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:51:19.440248 7153 raft_consensus.cc:2454] T 23ba314cb7654f1ca9e4d1da7c0664fd P 8dfb2fd996274c1d9f071b275898d233 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1b0a539a9724568b8381d883fd84f29 in term 1.
I20260808 14:51:19.440246 7313 raft_consensus.cc:2454] T 23ba314cb7654f1ca9e4d1da7c0664fd P 5d904e7b346344f8b9a334ce40bd6e67 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1b0a539a9724568b8381d883fd84f29 in term 1.
I20260808 14:51:19.440619 6918 leader_election.cc:302] T 23ba314cb7654f1ca9e4d1da7c0664fd P f1b0a539a9724568b8381d883fd84f29 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d904e7b346344f8b9a334ce40bd6e67, f1b0a539a9724568b8381d883fd84f29; no voters:
I20260808 14:51:19.440922 7392 raft_consensus.cc:2781] T 23ba314cb7654f1ca9e4d1da7c0664fd P f1b0a539a9724568b8381d883fd84f29 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:51:19.441334 7392 raft_consensus.cc:686] T 23ba314cb7654f1ca9e4d1da7c0664fd P f1b0a539a9724568b8381d883fd84f29 [term 1 LEADER]: Becoming Leader. State: Replica: f1b0a539a9724568b8381d883fd84f29, State: Running, Role: LEADER
I20260808 14:51:19.441790 7392 consensus_queue.cc:237] T 23ba314cb7654f1ca9e4d1da7c0664fd P f1b0a539a9724568b8381d883fd84f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b0a539a9724568b8381d883fd84f29" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 37619 } } peers { permanent_uuid: "8dfb2fd996274c1d9f071b275898d233" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 33961 } } peers { permanent_uuid: "5d904e7b346344f8b9a334ce40bd6e67" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 35753 } }
I20260808 14:51:19.446394 6827 catalog_manager.cc:5495] T 23ba314cb7654f1ca9e4d1da7c0664fd P f1b0a539a9724568b8381d883fd84f29 reported cstate change: term changed from 0 to 1, leader changed from <none> to f1b0a539a9724568b8381d883fd84f29 (127.26.206.193). New cstate: current_term: 1 leader_uuid: "f1b0a539a9724568b8381d883fd84f29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1b0a539a9724568b8381d883fd84f29" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 37619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dfb2fd996274c1d9f071b275898d233" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 33961 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d904e7b346344f8b9a334ce40bd6e67" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 35753 } health_report { overall_health: UNKNOWN } } }
W20260808 14:51:19.452322 7050 tablet.cc:2369] T 23ba314cb7654f1ca9e4d1da7c0664fd P f1b0a539a9724568b8381d883fd84f29: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 14:51:19.467309 7208 tablet.cc:2369] T 23ba314cb7654f1ca9e4d1da7c0664fd P 8dfb2fd996274c1d9f071b275898d233: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:51:19.475605 7380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:51:19.470577 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41292 (local address 127.26.206.193:37619)
0808 14:51:19.470753 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0808 14:51:19.470758 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:51:19.470847 (+ 89us) server_negotiation.cc:407] Connection header received
0808 14:51:19.471007 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:51:19.471011 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:51:19.471084 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:51:19.471201 (+ 117us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:51:19.471535 (+ 334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:51:19.472272 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:51:19.473516 (+ 1244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:51:19.473932 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:51:19.474018 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:51:19.474504 (+ 486us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:51:19.475033 (+ 529us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:51:19.475158 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0808 14:51:19.475281 (+ 123us) server_negotiation.cc:299] Negotiation successful
0808 14:51:19.475342 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260808 14:51:19.483320 7153 raft_consensus.cc:1261] T 23ba314cb7654f1ca9e4d1da7c0664fd P 8dfb2fd996274c1d9f071b275898d233 [term 1 FOLLOWER]: Refusing update from remote peer f1b0a539a9724568b8381d883fd84f29: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:51:19.483364 7313 raft_consensus.cc:1261] T 23ba314cb7654f1ca9e4d1da7c0664fd P 5d904e7b346344f8b9a334ce40bd6e67 [term 1 FOLLOWER]: Refusing update from remote peer f1b0a539a9724568b8381d883fd84f29: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:51:19.484261 7392 consensus_queue.cc:1035] T 23ba314cb7654f1ca9e4d1da7c0664fd P f1b0a539a9724568b8381d883fd84f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dfb2fd996274c1d9f071b275898d233" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 33961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:51:19.484561 7398 consensus_queue.cc:1035] T 23ba314cb7654f1ca9e4d1da7c0664fd P f1b0a539a9724568b8381d883fd84f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d904e7b346344f8b9a334ce40bd6e67" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 35753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260808 14:51:19.488044 7365 tablet.cc:2369] T 23ba314cb7654f1ca9e4d1da7c0664fd P 5d904e7b346344f8b9a334ce40bd6e67: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:51:19.499719 7403 mvcc.cc:205] Tried to move back new op lower bound from 7316277983154524160 to 7316277982997114880. Current Snapshot: MvccSnapshot[applied={T|T < 7316277983154524160}]
I20260808 14:51:19.512188 6826 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34426:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:51:19.512511 6826 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34426:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:51:19.516067 6826 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 65c1afdf586844c0bcd567d29e7ad08b: Sending DeleteTablet for 3 replicas of tablet 23ba314cb7654f1ca9e4d1da7c0664fd
I20260808 14:51:19.517129 6974 tablet_service.cc:1514] Processing DeleteTablet for tablet 23ba314cb7654f1ca9e4d1da7c0664fd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:51:19 UTC) from {username='kudu', principal='kudu/127.26.206.254@KRBTEST.COM'} at 127.0.0.1:41286
I20260808 14:51:19.517222 7291 tablet_service.cc:1514] Processing DeleteTablet for tablet 23ba314cb7654f1ca9e4d1da7c0664fd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:51:19 UTC) from {username='kudu', principal='kudu/127.26.206.254@KRBTEST.COM'} at 127.0.0.1:40624
I20260808 14:51:19.517953 7129 tablet_service.cc:1514] Processing DeleteTablet for tablet 23ba314cb7654f1ca9e4d1da7c0664fd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:51:19 UTC) from {username='kudu', principal='kudu/127.26.206.254@KRBTEST.COM'} at 127.0.0.1:51606
I20260808 14:51:19.518072 7413 tablet_replica.cc:330] T 23ba314cb7654f1ca9e4d1da7c0664fd P f1b0a539a9724568b8381d883fd84f29: stopping tablet replica
I20260808 14:51:19.518510 7413 raft_consensus.cc:2229] T 23ba314cb7654f1ca9e4d1da7c0664fd P f1b0a539a9724568b8381d883fd84f29 [term 1 LEADER]: Raft consensus shutting down.
I20260808 14:51:19.519337 7413 raft_consensus.cc:2258] T 23ba314cb7654f1ca9e4d1da7c0664fd P f1b0a539a9724568b8381d883fd84f29 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:51:19.519381 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 6896
I20260808 14:51:19.525341 7413 ts_tablet_manager.cc:1905] T 23ba314cb7654f1ca9e4d1da7c0664fd P f1b0a539a9724568b8381d883fd84f29: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:51:19.532829 7415 tablet_replica.cc:330] T 23ba314cb7654f1ca9e4d1da7c0664fd P 5d904e7b346344f8b9a334ce40bd6e67: stopping tablet replica
I20260808 14:51:19.533439 7415 raft_consensus.cc:2229] T 23ba314cb7654f1ca9e4d1da7c0664fd P 5d904e7b346344f8b9a334ce40bd6e67 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:51:19.534170 7416 tablet_replica.cc:330] T 23ba314cb7654f1ca9e4d1da7c0664fd P 8dfb2fd996274c1d9f071b275898d233: stopping tablet replica
I20260808 14:51:19.534678 7415 raft_consensus.cc:2258] T 23ba314cb7654f1ca9e4d1da7c0664fd P 5d904e7b346344f8b9a334ce40bd6e67 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:51:19.535166 7416 raft_consensus.cc:2229] T 23ba314cb7654f1ca9e4d1da7c0664fd P 8dfb2fd996274c1d9f071b275898d233 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:51:19.535898 7416 raft_consensus.cc:2258] T 23ba314cb7654f1ca9e4d1da7c0664fd P 8dfb2fd996274c1d9f071b275898d233 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:51:19.536592 7413 ts_tablet_manager.cc:1918] T 23ba314cb7654f1ca9e4d1da7c0664fd P f1b0a539a9724568b8381d883fd84f29: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:51:19.536796 7413 log.cc:1196] T 23ba314cb7654f1ca9e4d1da7c0664fd P f1b0a539a9724568b8381d883fd84f29: Deleting WAL directory at /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200577490656-27451-0/minicluster-data/ts-0/wal/wals/23ba314cb7654f1ca9e4d1da7c0664fd
I20260808 14:51:19.537400 7413 ts_tablet_manager.cc:1939] T 23ba314cb7654f1ca9e4d1da7c0664fd P f1b0a539a9724568b8381d883fd84f29: Deleting consensus metadata
I20260808 14:51:19.539340 6810 catalog_manager.cc:4841] TS f1b0a539a9724568b8381d883fd84f29 (127.26.206.193:37619): tablet 23ba314cb7654f1ca9e4d1da7c0664fd (table test-table [id=0c10de67f1f94f2ea4b26cb9aa6bb634]) successfully deleted
I20260808 14:51:19.539968 7416 ts_tablet_manager.cc:1905] T 23ba314cb7654f1ca9e4d1da7c0664fd P 8dfb2fd996274c1d9f071b275898d233: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:51:19.540172 7415 ts_tablet_manager.cc:1905] T 23ba314cb7654f1ca9e4d1da7c0664fd P 5d904e7b346344f8b9a334ce40bd6e67: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 08 14:51:19 dist-test-slave-6k22 krb5kdc[6773](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200677, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.206.193@KRBTEST.COM
I20260808 14:51:19.547453 7415 ts_tablet_manager.cc:1918] T 23ba314cb7654f1ca9e4d1da7c0664fd P 5d904e7b346344f8b9a334ce40bd6e67: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:51:19.547703 7415 log.cc:1196] T 23ba314cb7654f1ca9e4d1da7c0664fd P 5d904e7b346344f8b9a334ce40bd6e67: Deleting WAL directory at /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200577490656-27451-0/minicluster-data/ts-2/wal/wals/23ba314cb7654f1ca9e4d1da7c0664fd
I20260808 14:51:19.547701 7416 ts_tablet_manager.cc:1918] T 23ba314cb7654f1ca9e4d1da7c0664fd P 8dfb2fd996274c1d9f071b275898d233: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:51:19.547866 7416 log.cc:1196] T 23ba314cb7654f1ca9e4d1da7c0664fd P 8dfb2fd996274c1d9f071b275898d233: Deleting WAL directory at /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200577490656-27451-0/minicluster-data/ts-1/wal/wals/23ba314cb7654f1ca9e4d1da7c0664fd
I20260808 14:51:19.548341 7415 ts_tablet_manager.cc:1939] T 23ba314cb7654f1ca9e4d1da7c0664fd P 5d904e7b346344f8b9a334ce40bd6e67: Deleting consensus metadata
I20260808 14:51:19.548382 7416 ts_tablet_manager.cc:1939] T 23ba314cb7654f1ca9e4d1da7c0664fd P 8dfb2fd996274c1d9f071b275898d233: Deleting consensus metadata
I20260808 14:51:19.550091 6810 catalog_manager.cc:4841] TS 5d904e7b346344f8b9a334ce40bd6e67 (127.26.206.195:35753): tablet 23ba314cb7654f1ca9e4d1da7c0664fd (table test-table [id=0c10de67f1f94f2ea4b26cb9aa6bb634]) successfully deleted
I20260808 14:51:19.550524 6810 catalog_manager.cc:4841] TS 8dfb2fd996274c1d9f071b275898d233 (127.26.206.194:33961): tablet 23ba314cb7654f1ca9e4d1da7c0664fd (table test-table [id=0c10de67f1f94f2ea4b26cb9aa6bb634]) successfully deleted
I20260808 14:51:19.552054 7380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:51:19.521274 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41304 (local address 127.26.206.193:37619)
0808 14:51:19.521458 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0808 14:51:19.521464 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:51:19.532074 (+ 10610us) server_negotiation.cc:407] Connection header received
0808 14:51:19.532277 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:51:19.532283 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:51:19.532385 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:51:19.532496 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:51:19.534328 (+ 1832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:51:19.535659 (+ 1331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:51:19.538010 (+ 2351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:51:19.538762 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:51:19.538870 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:51:19.544416 (+ 5546us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:51:19.544431 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:51:19.544447 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:51:19.544485 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:51:19.548539 (+ 4054us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:51:19.549483 (+ 944us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:51:19.549492 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:51:19.549496 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:51:19.549673 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:51:19.550169 (+ 496us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:51:19.550175 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:51:19.550178 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:51:19.550621 (+ 443us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:51:19.550906 (+ 285us) server_negotiation.cc:1035] Waiting for connection context
0808 14:51:19.551491 (+ 585us) server_negotiation.cc:299] Negotiation successful
0808 14:51:19.551764 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260808 14:51:19.553917 7042 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:51:19.652493 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 6896
I20260808 14:51:19.673434 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 7056
Aug 08 14:51:19 dist-test-slave-6k22 krb5kdc[6773](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200677, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.206.194@KRBTEST.COM
I20260808 14:51:19.687466 7382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:51:19.674225 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51610 (local address 127.26.206.194:33961)
0808 14:51:19.674390 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0808 14:51:19.674393 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:51:19.674410 (+ 17us) server_negotiation.cc:407] Connection header received
0808 14:51:19.674589 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:51:19.674594 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:51:19.674716 (+ 122us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:51:19.674807 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:51:19.676039 (+ 1232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:51:19.676726 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:51:19.677814 (+ 1088us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:51:19.678190 (+ 376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:51:19.678276 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:51:19.682363 (+ 4087us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:51:19.682376 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:51:19.682390 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:51:19.682424 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:51:19.685200 (+ 2776us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:51:19.685804 (+ 604us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:51:19.685811 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:51:19.685813 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:51:19.685925 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:51:19.686219 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:51:19.686222 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:51:19.686224 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:51:19.686559 (+ 335us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:51:19.686767 (+ 208us) server_negotiation.cc:1035] Waiting for connection context
0808 14:51:19.686975 (+ 208us) server_negotiation.cc:299] Negotiation successful
0808 14:51:19.687126 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260808 14:51:19.688135 7200 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:51:19.776686 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 7056
I20260808 14:51:19.796487 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 7212
Aug 08 14:51:19 dist-test-slave-6k22 krb5kdc[6773](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200677, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.206.195@KRBTEST.COM
I20260808 14:51:19.811458 7384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:51:19.797230 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40640 (local address 127.26.206.195:35753)
0808 14:51:19.797416 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0808 14:51:19.797435 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0808 14:51:19.797454 (+ 19us) server_negotiation.cc:407] Connection header received
0808 14:51:19.797667 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:51:19.797671 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:51:19.797741 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:51:19.797862 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:51:19.799180 (+ 1318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:51:19.800096 (+ 916us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:51:19.801274 (+ 1178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:51:19.801690 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:51:19.801819 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:51:19.806052 (+ 4233us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:51:19.806066 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:51:19.806083 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:51:19.806113 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:51:19.808705 (+ 2592us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:51:19.809402 (+ 697us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:51:19.809410 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:51:19.809412 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:51:19.809534 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:51:19.809901 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:51:19.809906 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:51:19.809910 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:51:19.810274 (+ 364us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:51:19.810590 (+ 316us) server_negotiation.cc:1035] Waiting for connection context
0808 14:51:19.810872 (+ 282us) server_negotiation.cc:299] Negotiation successful
0808 14:51:19.811125 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260808 14:51:19.812101 7359 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:51:19.899187 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 7212
I20260808 14:51:19.918403 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 6791
I20260808 14:51:19.919518 6861 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:51:20.027675 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 6791
2026-08-08T14:51:20Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (4389 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200577490656-27451-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:51:20 dist-test-slave-6k22 krb5kdc[7424](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:51:20 dist-test-slave-6k22 krb5kdc[7424](info): set up 2 sockets
Aug 08 14:51:20 dist-test-slave-6k22 krb5kdc[7424](info): commencing operation
krb5kdc: starting...
W20260808 14:51:21.211953 27451 mini_kdc.cc:121] Time spent starting KDC: real 1.138s user 0.002s sys 0.033s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200577490656-27451-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200577490656-27451-0/krb5kdc/test-user.keytab.
Aug 08 14:51:21 dist-test-slave-6k22 krb5kdc[7424](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200681, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:51:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:51:21Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.26.206.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.26.206.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.26.206.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200577490656-27451-0/krb5kdc/rangeradmin_127.26.206.212@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.26.206.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200577490656-27451-0/krb5kdc/rangeradmin_127.26.206.212@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.26.206.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.26.206.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.26.206.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200577490656-27451-0/krb5kdc/rangerlookup_127.26.206.212@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.26.206.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200577490656-27451-0/krb5kdc/rangerlookup_127.26.206.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.26.206.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.26.206.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.26.206.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200577490656-27451-0/krb5kdc/HTTP_127.26.206.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.26.206.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200577490656-27451-0/krb5kdc/HTTP_127.26.206.212@KRBTEST.COM.keytab.
I20260808 14:51:21.590502 27451 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200577490656-27451-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskBCPck2/build/asan/bin/postgres/pg_ctl -D /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200577490656-27451-0/minicluster-data/postgres -l logfile start
2026-08-08 14:51:24.088 UTC [7459] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-08 14:51:24.088 UTC [7459] LOG: listening on IPv4 address "127.26.206.212", port 46423
2026-08-08 14:51:24.092 UTC [7459] LOG: listening on Unix socket "/tmp/.s.PGSQL.46423"
2026-08-08 14:51:24.132 UTC [7461] LOG: database system was shut down at 2026-08-08 14:51:22 UTC
2026-08-08 14:51:24.136 UTC [7459] LOG: database system is ready to accept connections
I20260808 14:51:25.748620 27451 mini_postgres.cc:96] Postgres bound to 46423
2026-08-08 14:51:25.790 UTC [7471] FATAL: database "slave" does not exist
127.26.206.212:46423 - accepting connections
I20260808 14:51:25.792440 27451 mini_ranger.cc:161] Starting Ranger...
I20260808 14:51:25.846048 27451 mini_ranger.cc:84] Created miniranger Postgres user
I20260808 14:51:26.390998 27451 mini_ranger.cc:87] Created ranger Postgres database
I20260808 14:51:26.391191 27451 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200577490656-27451-0/minicluster-data/ranger-admin
2026-08-08 14:51:26,724 [I] DB FLAVOR :POSTGRES
2026-08-08 14:51:26,725 [I] --------- Verifying Ranger DB connection ---------
2026-08-08 14:51:26,725 [I] Checking connection..
2026-08-08 14:51:26,725 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBCPck2/build/asan/bin/postgresql.jar:/tmp/dist-test-taskBCPck2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.206.212:46423/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-08 14:51:27,009 [I] Checking connection passed.
2026-08-08 14:51:27,009 [I] --------- Verifying version history table ---------
2026-08-08 14:51:27,009 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBCPck2/build/asan/bin/postgresql.jar:/tmp/dist-test-taskBCPck2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.206.212:46423/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 14:51:27,250 [I] Table x_db_version_h does not exist in database ranger
2026-08-08 14:51:27,250 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBCPck2/build/asan/bin/postgresql.jar:/tmp/dist-test-taskBCPck2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.206.212:46423/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 14:51:27,486 [I] Table x_db_version_h does not exist in database ranger
2026-08-08 14:51:27,486 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-08 14:51:27,486 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBCPck2/build/asan/bin/postgresql.jar:/tmp/dist-test-taskBCPck2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.206.212:46423/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskBCPck2/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-08 14:51:27.731 UTC [7542] WARNING: there is no transaction in progress
2026-08-08 14:51:27,738 [I] create_dbversion_catalog.sql file imported successfully
2026-08-08 14:51:27,739 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBCPck2/build/asan/bin/postgresql.jar:/tmp/dist-test-taskBCPck2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.206.212:46423/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 14:51:28,000 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-08 14:51:28,001 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-08 14:51:28,001 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBCPck2/build/asan/bin/postgresql.jar:/tmp/dist-test-taskBCPck2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.206.212:46423/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-08 14:51:28,231 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBCPck2/build/asan/bin/postgresql.jar:/tmp/dist-test-taskBCPck2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.206.212:46423/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-08 14:51:28,477 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBCPck2/build/asan/bin/postgresql.jar:/tmp/dist-test-taskBCPck2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.206.212:46423/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-6k22.c.gcp-upstream.internal','N') ;"
2026-08-08 14:51:28,732 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBCPck2/build/asan/bin/postgresql.jar:/tmp/dist-test-taskBCPck2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.206.212:46423/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-08 14:51:29,001 [I] Table x_portal_user does not exist in database ranger
2026-08-08 14:51:29,001 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBCPck2/build/asan/bin/postgresql.jar:/tmp/dist-test-taskBCPck2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.206.212:46423/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-08 14:51:29,239 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-08 14:51:29,239 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBCPck2/build/asan/bin/postgresql.jar:/tmp/dist-test-taskBCPck2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.206.212:46423/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-08 14:51:29,479 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBCPck2/build/asan/bin/postgresql.jar:/tmp/dist-test-taskBCPck2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.206.212:46423/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-08 14:51:29,722 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-08 14:51:29,722 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBCPck2/build/asan/bin/postgresql.jar:/tmp/dist-test-taskBCPck2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.206.212:46423/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskBCPck2/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-08 14:51:30.651 UTC [7666] WARNING: there is no transaction in progress
2026-08-08 14:51:30.666 UTC [7666] WARNING: there is no transaction in progress
2026-08-08 14:51:30.682 UTC [7666] WARNING: there is no transaction in progress
2026-08-08 14:51:30.696 UTC [7666] WARNING: there is no transaction in progress
2026-08-08 14:51:30.710 UTC [7666] WARNING: there is no transaction in progress
2026-08-08 14:51:30.728 UTC [7666] WARNING: there is no transaction in progress
2026-08-08 14:51:30.783 UTC [7666] WARNING: there is no transaction in progress
2026-08-08 14:51:30.789 UTC [7666] WARNING: there is no transaction in progress
2026-08-08 14:51:30.802 UTC [7666] WARNING: there is no transaction in progress
2026-08-08 14:51:30.812 UTC [7666] WARNING: there is no transaction in progress
2026-08-08 14:51:30.821 UTC [7666] WARNING: there is no transaction in progress
2026-08-08 14:51:30.834 UTC [7666] WARNING: there is no transaction in progress
2026-08-08 14:51:30.843 UTC [7666] WARNING: there is no transaction in progress
2026-08-08 14:51:30.848 UTC [7666] WARNING: there is no transaction in progress
2026-08-08 14:51:30.854 UTC [7666] WARNING: there is no transaction in progress
2026-08-08 14:51:30.860 UTC [7666] WARNING: there is no transaction in progress
2026-08-08 14:51:31,454 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-08 14:51:31,454 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBCPck2/build/asan/bin/postgresql.jar:/tmp/dist-test-taskBCPck2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.206.212:46423/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-08 14:51:31,701 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-08 14:51:31,701 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBCPck2/build/asan/bin/postgresql.jar:/tmp/dist-test-taskBCPck2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.206.212:46423/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-08 14:51:31,949 [I] Table x_portal_user already exists in database 'ranger'
2026-08-08 14:51:31,949 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBCPck2/build/asan/bin/postgresql.jar:/tmp/dist-test-taskBCPck2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.206.212:46423/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-08 14:51:32,212 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-08 14:51:32,212 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBCPck2/build/asan/bin/postgresql.jar:/tmp/dist-test-taskBCPck2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.206.212:46423/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-08 14:51:32,487 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBCPck2/build/asan/bin/postgresql.jar:/tmp/dist-test-taskBCPck2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.206.212:46423/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-08 14:51:32,720 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBCPck2/build/asan/bin/postgresql.jar:/tmp/dist-test-taskBCPck2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.206.212:46423/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-6k22.c.gcp-upstream.internal';"
2026-08-08 14:51:32,951 [I] CORE_DB_SCHEMA import status has been updated
2026-08-08 14:51:32,952 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBCPck2/build/asan/bin/postgresql.jar:/tmp/dist-test-taskBCPck2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.206.212:46423/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-08 14:51:33,212 [I] DB_PATCHES have already been applied
I20260808 14:51:33.218881 27451 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200577490656-27451-0/minicluster-data/ranger-admin:/tmp/dist-test-taskBCPck2/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskBCPck2/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskBCPck2/build/asan/bin/postgresql.jar:/tmp/dist-test-taskBCPck2/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260808 14:51:33.218997 27451 mini_ranger.cc:193] Using host: 127.26.206.212
I20260808 14:51:33.240746 27451 mini_ranger.cc:227] Ranger admin URL: http://127.26.206.212:41979
Aug 08, 2026 2:51:33 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 08, 2026 2:51:33 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 08, 2026 2:51:33 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200577490656-27451-0/minicluster-data/ranger-admin/ews/webapp
Aug 08, 2026 2:51:33 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200577490656-27451-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 08, 2026 2:51:33 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200577490656-27451-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 08, 2026 2:51:34 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200577490656-27451-0/minicluster-data/ranger-admin/ews/webapp].
Aug 08, 2026 2:51:34 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260808 14:51:34.461867 27451 mini_ranger.cc:160] Time spent starting Ranger: real 8.669s user 0.003s sys 0.085s
Aug 08, 2026 2:51:53 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 08, 2026 2:51:53 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 08, 2026 2:51:53 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 08, 2026 2:51:53 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 08, 2026 2:51:53 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 08, 2026 2:51:53 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 08, 2026 2:51:53 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 08, 2026 2:51:53 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 08, 2026 2:51:53 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 08, 2026 2:51:53 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 08, 2026 2:51:53 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 08, 2026 2:51:53 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 08, 2026 2:51:53 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 08, 2026 2:51:53 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 08, 2026 2:51:53 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 08, 2026 2:51:53 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 08, 2026 2:51:53 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 08, 2026 2:51:54 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260808 14:51:55.040901 27451 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.26.206.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.26.206.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.26.206.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200577490656-27451-0/krb5kdc/rangerkms_127.26.206.212@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.26.206.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200577490656-27451-0/krb5kdc/rangerkms_127.26.206.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.26.206.212@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.26.206.212@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.26.206.212@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200577490656-27451-0/krb5kdc/HTTP_127.26.206.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.26.206.212@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200577490656-27451-0/krb5kdc/HTTP_127.26.206.212@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 08 14:51:55 dist-test-slave-6k22 krb5kdc[7424](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200715, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260808 14:51:55.261082 27451 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260808 14:51:55.286773 27451 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260808 14:51:56.172238 27451 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260808 14:51:56.172394 27451 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200577490656-27451-0/minicluster-data/ranger-kms
I20260808 14:51:56.172772 27451 mini_ranger_kms.cc:227] Using postgres at 127.26.206.212:46423
2026-08-08 14:51:56,686 [I] DB FLAVOR :POSTGRES
2026-08-08 14:51:56,686 [I] --------- Verifying Ranger DB connection ---------
2026-08-08 14:51:56,686 [I] Checking connection
2026-08-08 14:51:56,687 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBCPck2/build/asan/bin/postgresql.jar:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200577490656-27451-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.206.212:46423/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-08 14:51:56,929 [I] connection success
2026-08-08 14:51:56,929 [I] --------- Verifying Ranger DB tables ---------
2026-08-08 14:51:56,929 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-08 14:51:56,929 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBCPck2/build/asan/bin/postgresql.jar:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200577490656-27451-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.206.212:46423/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-08 14:51:57,180 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-08 14:51:57,181 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-08 14:51:57,181 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-08 14:51:57,181 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBCPck2/build/asan/bin/postgresql.jar:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200577490656-27451-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.206.212:46423/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200577490656-27451-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-08 14:51:57,438 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260808 14:51:57.885327 27451 mini_ranger_kms.cc:310] Created kms service
I20260808 14:51:58.094559 27451 mini_ranger_kms.cc:326] Created kudu user
I20260808 14:51:58.138831 27451 mini_ranger_kms.cc:343] Created rangerkms user
Aug 08 14:51:58 dist-test-slave-6k22 krb5kdc[7424](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200715, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.26.206.212@KRBTEST.COM
I20260808 14:51:58.532959 27451 mini_ranger_kms.cc:384] Added ranger policy
I20260808 14:51:58.534246 27451 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200577490656-27451-0/minicluster-data/ranger-kms:/tmp/dist-test-taskBCPck2/build/asan/bin/postgresql.jar:/tmp/dist-test-taskBCPck2/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskBCPck2/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260808 14:51:58.534348 27451 mini_ranger_kms.cc:240] Using host: 127.26.206.212
I20260808 14:51:58.560422 27451 mini_ranger_kms.cc:276] Ranger KMS PID: 7874
I20260808 14:51:58.560638 27451 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.26.206.212:57925
Aug 08, 2026 2:51:59 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 08, 2026 2:51:59 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 08, 2026 2:51:59 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200577490656-27451-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 08, 2026 2:51:59 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200577490656-27451-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 08, 2026 2:51:59 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200577490656-27451-0/minicluster-data/ranger-kms/ews/webapp].
Aug 08, 2026 2:51:59 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 08 14:52:00 dist-test-slave-6k22 krb5kdc[7424](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786200720, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.26.206.212@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:52:00.947906 27451 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.687s user 0.121s sys 0.432s
I20260808 14:52:00.948263 27451 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260808 14:52:00.948478 27451 mini_ranger_kms.cc:401] 127.26.206.212:57925/kms/v1/keys
Aug 08 14:52:01 dist-test-slave-6k22 krb5kdc[7424](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200720, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.26.206.212@KRBTEST.COM for HTTP/127.26.206.212@KRBTEST.COM
Aug 08 14:52:01 dist-test-slave-6k22 krb5kdc[7424](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200720, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.26.206.212@KRBTEST.COM for HTTP/127.26.206.212@KRBTEST.COM
Aug 08 14:52:03 dist-test-slave-6k22 krb5kdc[7424](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200723, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.26.206.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.206.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.206.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.254.keytab.
Entry for principal kudu/127.26.206.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.254.keytab.
I20260808 14:52:04.016007 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200577490656-27451-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200577490656-27451-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200577490656-27451-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.206.254:34791
--webserver_interface=127.26.206.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.254.keytab
--principal=kudu/127.26.206.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.206.212:35321
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.206.254:34791
--ranger_config_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200577490656-27451-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.26.206.212:57925/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:52:04.356964 7933 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:52:04.357239 7933 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:52:04.357422 7933 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:52:04.364585 7933 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:52:04.364750 7933 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:52:04.364858 7933 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:52:04.364962 7933 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:52:04.365049 7933 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:52:04.374897 7933 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:35321
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200577490656-27451-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200577490656-27451-0/minicluster-data/master-0/wal
--ranger_kms_url=127.26.206.212:57925/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.26.206.254:34791
--ranger_config_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200577490656-27451-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.254.keytab
--principal=kudu/127.26.206.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.206.254:34791
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.206.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200577490656-27451-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:52:04.376142 7933 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:52:04.377447 7933 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:52:04.389853 7938 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:52:04.389832 7941 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:52:04.389853 7939 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:52:04.390683 7933 server_base.cc:1034] running on GCE node
I20260808 14:52:04.391381 7933 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:52:04.392817 7933 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:52:04.394045 7933 hybrid_clock.cc:648] HybridClock initialized: now 1786200724394001 us; error 51 us; skew 500 ppm
I20260808 14:52:04.394392 7933 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:52:04 dist-test-slave-6k22 krb5kdc[7424](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200724, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:52:04.397698 7933 init.cc:377] Logged in from keytab as kudu/127.26.206.254@KRBTEST.COM (short username kudu)
I20260808 14:52:04.399197 7933 webserver.cc:460] Webserver started at http://127.26.206.254:40699/ using document root <none> and password file <none>
I20260808 14:52:04.399917 7933 fs_manager.cc:359] Metadata directory not provided
I20260808 14:52:04.400063 7933 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:52:04.400382 7933 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 14:52:04 dist-test-slave-6k22 krb5kdc[7424](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200724, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.254@KRBTEST.COM for HTTP/127.26.206.212@KRBTEST.COM
I20260808 14:52:04.457675 7933 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200577490656-27451-0/minicluster-data/master-0/data/instance:
uuid: "96852056c2d44b45bcaa9d6405a53ad4"
format_stamp: "Formatted at 2026-08-08 14:52:04 on dist-test-slave-6k22"
server_key: "d279ea4bb9015413ee41972767826524"
server_key_iv: "9fbcf3a74db6e85c6743202c84478e1a"
server_key_version: "kuduclusterkey@0"
I20260808 14:52:04.458561 7933 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200577490656-27451-0/minicluster-data/master-0/wal/instance:
uuid: "96852056c2d44b45bcaa9d6405a53ad4"
format_stamp: "Formatted at 2026-08-08 14:52:04 on dist-test-slave-6k22"
server_key: "d279ea4bb9015413ee41972767826524"
server_key_iv: "9fbcf3a74db6e85c6743202c84478e1a"
server_key_version: "kuduclusterkey@0"
I20260808 14:52:04.464293 7933 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260808 14:52:04.480414 7948 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:52:04.481986 7933 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 14:52:04.482172 7933 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200577490656-27451-0/minicluster-data/master-0/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200577490656-27451-0/minicluster-data/master-0/wal
uuid: "96852056c2d44b45bcaa9d6405a53ad4"
format_stamp: "Formatted at 2026-08-08 14:52:04 on dist-test-slave-6k22"
server_key: "d279ea4bb9015413ee41972767826524"
server_key_iv: "9fbcf3a74db6e85c6743202c84478e1a"
server_key_version: "kuduclusterkey@0"
I20260808 14:52:04.482415 7933 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200577490656-27451-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200577490656-27451-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200577490656-27451-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:52:04.502887 7933 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:52:04.507051 7933 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:52:04.507378 7933 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:52:04.528558 7933 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.254:34791
I20260808 14:52:04.528573 8009 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.254:34791 every 8 connection(s)
I20260808 14:52:04.530141 7933 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
I20260808 14:52:04.534135 8010 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:52:04.539276 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 7933
I20260808 14:52:04.539510 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200577490656-27451-0/minicluster-data/master-0/wal/instance
I20260808 14:52:04.540375 27451 external_mini_cluster.cc:1428] Setting key f853c061932b7e39c46bbd0d4da84f0e
I20260808 14:52:04.548625 8010 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 96852056c2d44b45bcaa9d6405a53ad4: Bootstrap starting.
I20260808 14:52:04.553964 8010 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 96852056c2d44b45bcaa9d6405a53ad4: Neither blocks nor log segments found. Creating new log.
I20260808 14:52:04.556272 8010 log.cc:824] T 00000000000000000000000000000000 P 96852056c2d44b45bcaa9d6405a53ad4: Log is configured to *not* fsync() on all Append() calls
I20260808 14:52:04.559536 8010 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 96852056c2d44b45bcaa9d6405a53ad4: No bootstrap required, opened a new log
I20260808 14:52:04.569027 8010 raft_consensus.cc:348] T 00000000000000000000000000000000 P 96852056c2d44b45bcaa9d6405a53ad4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96852056c2d44b45bcaa9d6405a53ad4" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 34791 } }
I20260808 14:52:04.569540 8010 raft_consensus.cc:374] T 00000000000000000000000000000000 P 96852056c2d44b45bcaa9d6405a53ad4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:52:04.569692 8010 raft_consensus.cc:729] T 00000000000000000000000000000000 P 96852056c2d44b45bcaa9d6405a53ad4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96852056c2d44b45bcaa9d6405a53ad4, State: Initialized, Role: FOLLOWER
Aug 08 14:52:04 dist-test-slave-6k22 krb5kdc[7424](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200723, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.206.254@KRBTEST.COM
I20260808 14:52:04.570384 8010 consensus_queue.cc:260] T 00000000000000000000000000000000 P 96852056c2d44b45bcaa9d6405a53ad4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96852056c2d44b45bcaa9d6405a53ad4" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 34791 } }
I20260808 14:52:04.570628 8010 raft_consensus.cc:388] T 00000000000000000000000000000000 P 96852056c2d44b45bcaa9d6405a53ad4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:52:04.570775 8010 raft_consensus.cc:482] T 00000000000000000000000000000000 P 96852056c2d44b45bcaa9d6405a53ad4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:52:04.570976 8010 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 96852056c2d44b45bcaa9d6405a53ad4 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:52:04.573961 8010 raft_consensus.cc:504] T 00000000000000000000000000000000 P 96852056c2d44b45bcaa9d6405a53ad4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96852056c2d44b45bcaa9d6405a53ad4" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 34791 } }
I20260808 14:52:04.574479 8010 leader_election.cc:302] T 00000000000000000000000000000000 P 96852056c2d44b45bcaa9d6405a53ad4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 96852056c2d44b45bcaa9d6405a53ad4; no voters:
I20260808 14:52:04.575205 8010 leader_election.cc:288] T 00000000000000000000000000000000 P 96852056c2d44b45bcaa9d6405a53ad4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:52:04.575345 8015 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 96852056c2d44b45bcaa9d6405a53ad4 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:52:04.581156 8013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:52:04.542622 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39442 (local address 127.26.206.254:34791)
0808 14:52:04.555135 (+ 12513us) server_negotiation.cc:206] Beginning negotiation
0808 14:52:04.555152 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 14:52:04.555206 (+ 54us) server_negotiation.cc:407] Connection header received
0808 14:52:04.558042 (+ 2836us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:52:04.558072 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:52:04.558612 (+ 540us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:52:04.559050 (+ 438us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:52:04.560790 (+ 1740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:52:04.562986 (+ 2196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:52:04.564871 (+ 1885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:52:04.565965 (+ 1094us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:52:04.566133 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:52:04.571119 (+ 4986us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:52:04.571130 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:52:04.571149 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:52:04.571198 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:52:04.575398 (+ 4200us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:52:04.576319 (+ 921us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:52:04.576327 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:52:04.576336 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:52:04.576503 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:52:04.576949 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:52:04.576954 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:52:04.576957 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:52:04.577667 (+ 710us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:52:04.579095 (+ 1428us) server_negotiation.cc:1035] Waiting for connection context
0808 14:52:04.579387 (+ 292us) server_negotiation.cc:299] Negotiation successful
0808 14:52:04.579823 (+ 436us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12263,"thread_start_us":12035,"threads_started":1}
I20260808 14:52:04.583495 8010 sys_catalog.cc:564] T 00000000000000000000000000000000 P 96852056c2d44b45bcaa9d6405a53ad4 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:52:04.587846 8015 raft_consensus.cc:686] T 00000000000000000000000000000000 P 96852056c2d44b45bcaa9d6405a53ad4 [term 1 LEADER]: Becoming Leader. State: Replica: 96852056c2d44b45bcaa9d6405a53ad4, State: Running, Role: LEADER
I20260808 14:52:04.588600 8015 consensus_queue.cc:237] T 00000000000000000000000000000000 P 96852056c2d44b45bcaa9d6405a53ad4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96852056c2d44b45bcaa9d6405a53ad4" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 34791 } }
I20260808 14:52:04.597270 8017 sys_catalog.cc:455] T 00000000000000000000000000000000 P 96852056c2d44b45bcaa9d6405a53ad4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 96852056c2d44b45bcaa9d6405a53ad4. Latest consensus state: current_term: 1 leader_uuid: "96852056c2d44b45bcaa9d6405a53ad4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96852056c2d44b45bcaa9d6405a53ad4" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 34791 } } }
I20260808 14:52:04.597747 8017 sys_catalog.cc:458] T 00000000000000000000000000000000 P 96852056c2d44b45bcaa9d6405a53ad4 [sys.catalog]: This master's current role is: LEADER
I20260808 14:52:04.598498 8016 sys_catalog.cc:455] T 00000000000000000000000000000000 P 96852056c2d44b45bcaa9d6405a53ad4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "96852056c2d44b45bcaa9d6405a53ad4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96852056c2d44b45bcaa9d6405a53ad4" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 34791 } } }
I20260808 14:52:04.599472 8016 sys_catalog.cc:458] T 00000000000000000000000000000000 P 96852056c2d44b45bcaa9d6405a53ad4 [sys.catalog]: This master's current role is: LEADER
I20260808 14:52:04.613473 8022 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:52:04.619863 8022 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:52:04.633155 8010 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200577490656-27451-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260808 14:52:04.633841 8022 catalog_manager.cc:1347] Generated new cluster ID: 73a329a025704479b9ca07876e983cc3
I20260808 14:52:04.633958 8022 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:52:04.675758 8022 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:52:04.678174 8022 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:52:04.694571 8022 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 96852056c2d44b45bcaa9d6405a53ad4: Generated new TSK 0
I20260808 14:52:04.695526 8022 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:52:05.426409 8060 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
WARNING: no policy specified for kudu/127.26.206.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.206.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.206.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.193.keytab.
Entry for principal kudu/127.26.206.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.193.keytab.
I20260808 14:52:05.544206 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200577490656-27451-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200577490656-27451-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200577490656-27451-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200577490656-27451-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.26.206.212:57925/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.206.193:0
--local_ip_for_outbound_sockets=127.26.206.193
--webserver_interface=127.26.206.193
--webserver_port=0
--tserver_master_addrs=127.26.206.254:34791
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.193.keytab
--principal=kudu/127.26.206.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.206.212:35321
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 14:52:05 dist-test-slave-6k22 krb5kdc[7424](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786200725, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260808 14:52:05.930159 8064 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:52:05.930486 8064 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:52:05.930660 8064 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:52:05.937851 8064 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:52:05.937980 8064 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:52:05.938161 8064 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.206.193
I20260808 14:52:05.948134 8064 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:35321
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200577490656-27451-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200577490656-27451-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.26.206.212:57925/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.193.keytab
--principal=kudu/127.26.206.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.206.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200577490656-27451-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.206.193
--webserver_port=0
--tserver_master_addrs=127.26.206.254:34791
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.206.193
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200577490656-27451-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:52:05.949465 8064 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:52:05.950860 8064 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:52:05.970189 8074 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:52:05.972805 8075 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:52:05.975113 8064 server_base.cc:1034] running on GCE node
W20260808 14:52:05.975834 8077 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:52:05.976570 8064 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:52:05.977687 8064 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:52:05.978962 8064 hybrid_clock.cc:648] HybridClock initialized: now 1786200725978861 us; error 92 us; skew 500 ppm
I20260808 14:52:05.979425 8064 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:52:05 dist-test-slave-6k22 krb5kdc[7424](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200725, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:52:05.983743 8064 init.cc:377] Logged in from keytab as kudu/127.26.206.193@KRBTEST.COM (short username kudu)
I20260808 14:52:05.985836 8064 webserver.cc:460] Webserver started at http://127.26.206.193:41125/ using document root <none> and password file <none>
I20260808 14:52:05.986928 8064 fs_manager.cc:359] Metadata directory not provided
I20260808 14:52:05.987068 8064 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:52:05.987430 8064 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 14:52:05 dist-test-slave-6k22 krb5kdc[7424](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200725, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.193@KRBTEST.COM for HTTP/127.26.206.212@KRBTEST.COM
I20260808 14:52:06.010812 8064 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200577490656-27451-0/minicluster-data/ts-0/data/instance:
uuid: "3b5c7af379bd4ff8af71aab540ee5b85"
format_stamp: "Formatted at 2026-08-08 14:52:06 on dist-test-slave-6k22"
server_key: "488de44974e0621dd99c78419bd61846"
server_key_iv: "a5be7821cc19ce21deb791640d0f2fe9"
server_key_version: "kuduclusterkey@0"
I20260808 14:52:06.013996 8064 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200577490656-27451-0/minicluster-data/ts-0/wal/instance:
uuid: "3b5c7af379bd4ff8af71aab540ee5b85"
format_stamp: "Formatted at 2026-08-08 14:52:06 on dist-test-slave-6k22"
server_key: "488de44974e0621dd99c78419bd61846"
server_key_iv: "a5be7821cc19ce21deb791640d0f2fe9"
server_key_version: "kuduclusterkey@0"
I20260808 14:52:06.033787 8064 fs_manager.cc:691] Time spent creating directory manager: real 0.019s user 0.007s sys 0.011s
I20260808 14:52:06.063107 8088 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:52:06.065339 8064 fs_manager.cc:725] Time spent opening block manager: real 0.012s user 0.004s sys 0.005s
I20260808 14:52:06.065651 8064 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200577490656-27451-0/minicluster-data/ts-0/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200577490656-27451-0/minicluster-data/ts-0/wal
uuid: "3b5c7af379bd4ff8af71aab540ee5b85"
format_stamp: "Formatted at 2026-08-08 14:52:06 on dist-test-slave-6k22"
server_key: "488de44974e0621dd99c78419bd61846"
server_key_iv: "a5be7821cc19ce21deb791640d0f2fe9"
server_key_version: "kuduclusterkey@0"
I20260808 14:52:06.065997 8064 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200577490656-27451-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200577490656-27451-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200577490656-27451-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:52:06.107535 8064 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:52:06.113119 8064 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:52:06.113456 8064 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:52:06.114495 8064 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:52:06.115985 8064 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:52:06.116060 8064 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:52:06.116210 8064 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:52:06.116268 8064 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:52:06.202045 8064 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.193:42425
I20260808 14:52:06.202093 8214 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.193:42425 every 8 connection(s)
I20260808 14:52:06.203936 8064 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200577490656-27451-0/minicluster-data/ts-0/data/info.pb
I20260808 14:52:06.205376 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 8064
I20260808 14:52:06.205638 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200577490656-27451-0/minicluster-data/ts-0/wal/instance
I20260808 14:52:06.206594 27451 external_mini_cluster.cc:1428] Setting key 62a7ce635eca4837f3b6526bb1fc326c
Aug 08 14:52:06 dist-test-slave-6k22 krb5kdc[7424](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200725, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.193@KRBTEST.COM for kudu/127.26.206.254@KRBTEST.COM
I20260808 14:52:06.251504 8218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:52:06.212915 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:34791 (local address 127.26.206.193:33353)
0808 14:52:06.226369 (+ 13454us) negotiation.cc:107] Waiting for socket to connect
0808 14:52:06.226419 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0808 14:52:06.228985 (+ 2566us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:52:06.229784 (+ 799us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:52:06.229793 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:52:06.230238 (+ 445us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:52:06.230812 (+ 574us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:52:06.230829 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:52:06.232260 (+ 1431us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:52:06.232266 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:52:06.234301 (+ 2035us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:52:06.234327 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:52:06.236063 (+ 1736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:52:06.236072 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:52:06.236416 (+ 344us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:52:06.237375 (+ 959us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:52:06.237412 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:52:06.240823 (+ 3411us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:52:06.245831 (+ 5008us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:52:06.245843 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:52:06.245862 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:52:06.246559 (+ 697us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:52:06.247093 (+ 534us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:52:06.247099 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:52:06.247103 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:52:06.247400 (+ 297us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:52:06.248336 (+ 936us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:52:06.248346 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:52:06.248857 (+ 511us) client_negotiation.cc:769] Sending connection context
0808 14:52:06.249253 (+ 396us) client_negotiation.cc:240] Negotiation successful
0808 14:52:06.249874 (+ 621us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13129,"thread_start_us":12868,"threads_started":1}
I20260808 14:52:06.253093 8217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:52:06.212145 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.193:33353 (local address 127.26.206.254:34791)
0808 14:52:06.228871 (+ 16726us) server_negotiation.cc:206] Beginning negotiation
0808 14:52:06.228878 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:52:06.228902 (+ 24us) server_negotiation.cc:407] Connection header received
0808 14:52:06.229286 (+ 384us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:52:06.229292 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:52:06.229389 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:52:06.229526 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:52:06.230977 (+ 1451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:52:06.232031 (+ 1054us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:52:06.234502 (+ 2471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:52:06.235304 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:52:06.235706 (+ 402us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:52:06.241119 (+ 5413us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:52:06.241128 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:52:06.241134 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:52:06.241208 (+ 74us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:52:06.245578 (+ 4370us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:52:06.246756 (+ 1178us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:52:06.246763 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:52:06.246767 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:52:06.246933 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:52:06.247605 (+ 672us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:52:06.247613 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:52:06.247617 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:52:06.248047 (+ 430us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:52:06.248220 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0808 14:52:06.252160 (+ 3940us) server_negotiation.cc:299] Negotiation successful
0808 14:52:06.252448 (+ 288us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16589,"thread_start_us":16756,"threads_started":1}
WARNING: no policy specified for kudu/127.26.206.194@KRBTEST.COM; defaulting to no policy
I20260808 14:52:06.256181 8215 heartbeater.cc:347] Connected to a master server at 127.26.206.254:34791
I20260808 14:52:06.256546 8215 heartbeater.cc:464] Registering TS with master...
I20260808 14:52:06.257302 8215 heartbeater.cc:511] Master 127.26.206.254:34791 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.206.194@KRBTEST.COM" created.
I20260808 14:52:06.260509 7971 ts_manager.cc:194] Registered new tserver with Master: 3b5c7af379bd4ff8af71aab540ee5b85 (127.26.206.193:42425)
I20260808 14:52:06.262737 7971 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.206.193@KRBTEST.COM'} at 127.26.206.193:33353
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.206.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.194.keytab.
Entry for principal kudu/127.26.206.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.194.keytab.
I20260808 14:52:06.299513 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200577490656-27451-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200577490656-27451-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200577490656-27451-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200577490656-27451-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.26.206.212:57925/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.206.194:0
--local_ip_for_outbound_sockets=127.26.206.194
--webserver_interface=127.26.206.194
--webserver_port=0
--tserver_master_addrs=127.26.206.254:34791
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.194.keytab
--principal=kudu/127.26.206.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.206.212:35321
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 14:52:06 dist-test-slave-6k22 krb5kdc[7424](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200725, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.254@KRBTEST.COM for HTTP/127.26.206.212@KRBTEST.COM
Aug 08 14:52:06 dist-test-slave-6k22 krb5kdc[7424](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200725, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.254@KRBTEST.COM for HTTP/127.26.206.212@KRBTEST.COM
W20260808 14:52:06.799296 8221 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:52:06.799813 8221 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:52:06.800022 8221 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:52:06.812618 8221 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:52:06.812845 8221 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:52:06.813091 8221 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.206.194
I20260808 14:52:06.830297 8221 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:35321
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200577490656-27451-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200577490656-27451-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.26.206.212:57925/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.194.keytab
--principal=kudu/127.26.206.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.206.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200577490656-27451-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.206.194
--webserver_port=0
--tserver_master_addrs=127.26.206.254:34791
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.206.194
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200577490656-27451-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:52:06.832532 8221 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:52:06.834540 8221 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:52:06.873059 8228 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:52:06.873214 8229 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:52:06.886921 8232 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:52:06.889822 8221 server_base.cc:1034] running on GCE node
I20260808 14:52:06.891013 8221 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:52:06.905857 8221 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:52:06.907232 8221 hybrid_clock.cc:648] HybridClock initialized: now 1786200726907113 us; error 114 us; skew 500 ppm
I20260808 14:52:06.907793 8221 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:52:06 dist-test-slave-6k22 krb5kdc[7424](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200726, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:52:06.912817 8221 init.cc:377] Logged in from keytab as kudu/127.26.206.194@KRBTEST.COM (short username kudu)
I20260808 14:52:06.931654 8221 webserver.cc:460] Webserver started at http://127.26.206.194:35401/ using document root <none> and password file <none>
I20260808 14:52:06.932818 8221 fs_manager.cc:359] Metadata directory not provided
I20260808 14:52:06.933044 8221 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:52:06.933502 8221 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 14:52:06 dist-test-slave-6k22 krb5kdc[7424](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200726, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.194@KRBTEST.COM for HTTP/127.26.206.212@KRBTEST.COM
I20260808 14:52:06.966687 8221 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200577490656-27451-0/minicluster-data/ts-1/data/instance:
uuid: "7e7a38f24fe048929b40bfcc369bd98e"
format_stamp: "Formatted at 2026-08-08 14:52:06 on dist-test-slave-6k22"
server_key: "21aea3a40f37958649e8bcb74ceb0ec7"
server_key_iv: "d7f566dd4d82cb81c92257e38170c306"
server_key_version: "kuduclusterkey@0"
I20260808 14:52:06.967862 8221 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200577490656-27451-0/minicluster-data/ts-1/wal/instance:
uuid: "7e7a38f24fe048929b40bfcc369bd98e"
format_stamp: "Formatted at 2026-08-08 14:52:06 on dist-test-slave-6k22"
server_key: "21aea3a40f37958649e8bcb74ceb0ec7"
server_key_iv: "d7f566dd4d82cb81c92257e38170c306"
server_key_version: "kuduclusterkey@0"
I20260808 14:52:06.981369 8221 fs_manager.cc:691] Time spent creating directory manager: real 0.013s user 0.010s sys 0.001s
I20260808 14:52:07.020780 8242 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:52:07.022918 8221 fs_manager.cc:725] Time spent opening block manager: real 0.012s user 0.001s sys 0.007s
I20260808 14:52:07.023253 8221 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200577490656-27451-0/minicluster-data/ts-1/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200577490656-27451-0/minicluster-data/ts-1/wal
uuid: "7e7a38f24fe048929b40bfcc369bd98e"
format_stamp: "Formatted at 2026-08-08 14:52:06 on dist-test-slave-6k22"
server_key: "21aea3a40f37958649e8bcb74ceb0ec7"
server_key_iv: "d7f566dd4d82cb81c92257e38170c306"
server_key_version: "kuduclusterkey@0"
I20260808 14:52:07.023672 8221 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200577490656-27451-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200577490656-27451-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200577490656-27451-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:52:07.059808 8221 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:52:07.064538 8221 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:52:07.064893 8221 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:52:07.066054 8221 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:52:07.067816 8221 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:52:07.067894 8221 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:52:07.068068 8221 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:52:07.068123 8221 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:52:07.105863 8221 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.194:40223
I20260808 14:52:07.105909 8374 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.194:40223 every 8 connection(s)
I20260808 14:52:07.107252 8221 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200577490656-27451-0/minicluster-data/ts-1/data/info.pb
I20260808 14:52:07.112764 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 8221
I20260808 14:52:07.113003 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200577490656-27451-0/minicluster-data/ts-1/wal/instance
I20260808 14:52:07.113441 27451 external_mini_cluster.cc:1428] Setting key 0b84898e251dbfac63c2969d66c124ed
Aug 08 14:52:07 dist-test-slave-6k22 krb5kdc[7424](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200726, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.194@KRBTEST.COM for kudu/127.26.206.254@KRBTEST.COM
I20260808 14:52:07.130482 8378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:52:07.110010 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.194:39619 (local address 127.26.206.254:34791)
0808 14:52:07.110521 (+ 511us) server_negotiation.cc:206] Beginning negotiation
0808 14:52:07.110528 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:52:07.111622 (+ 1094us) server_negotiation.cc:407] Connection header received
0808 14:52:07.113886 (+ 2264us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:52:07.113892 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:52:07.113991 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:52:07.114111 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:52:07.115943 (+ 1832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:52:07.116714 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:52:07.119330 (+ 2616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:52:07.119828 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:52:07.119950 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:52:07.124368 (+ 4418us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:52:07.124372 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:52:07.124376 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:52:07.124410 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:52:07.127152 (+ 2742us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:52:07.127932 (+ 780us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:52:07.127940 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:52:07.127945 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:52:07.128116 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:52:07.128531 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:52:07.128538 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:52:07.128544 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:52:07.128926 (+ 382us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:52:07.129111 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0808 14:52:07.129705 (+ 594us) server_negotiation.cc:299] Negotiation successful
0808 14:52:07.129944 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":375,"thread_start_us":248,"threads_started":1}
I20260808 14:52:07.131031 8379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:52:07.110562 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:34791 (local address 127.26.206.194:39619)
0808 14:52:07.111393 (+ 831us) negotiation.cc:107] Waiting for socket to connect
0808 14:52:07.111434 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 14:52:07.113551 (+ 2117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:52:07.114354 (+ 803us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:52:07.114361 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:52:07.114970 (+ 609us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:52:07.115734 (+ 764us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:52:07.115772 (+ 38us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:52:07.116888 (+ 1116us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:52:07.116897 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:52:07.119153 (+ 2256us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:52:07.119170 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:52:07.120068 (+ 898us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:52:07.120078 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:52:07.120421 (+ 343us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:52:07.121175 (+ 754us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:52:07.121230 (+ 55us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:52:07.124047 (+ 2817us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:52:07.127330 (+ 3283us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:52:07.127336 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:52:07.127346 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:52:07.127807 (+ 461us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:52:07.128221 (+ 414us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:52:07.128224 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:52:07.128227 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:52:07.128411 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:52:07.129086 (+ 675us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:52:07.129092 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:52:07.129374 (+ 282us) client_negotiation.cc:769] Sending connection context
0808 14:52:07.129576 (+ 202us) client_negotiation.cc:240] Negotiation successful
0808 14:52:07.129950 (+ 374us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":593,"thread_start_us":325,"threads_started":1}
I20260808 14:52:07.132442 8375 heartbeater.cc:347] Connected to a master server at 127.26.206.254:34791
I20260808 14:52:07.132759 8375 heartbeater.cc:464] Registering TS with master...
I20260808 14:52:07.133562 8375 heartbeater.cc:511] Master 127.26.206.254:34791 requested a full tablet report, sending...
I20260808 14:52:07.135083 7971 ts_manager.cc:194] Registered new tserver with Master: 7e7a38f24fe048929b40bfcc369bd98e (127.26.206.194:40223)
I20260808 14:52:07.136325 7971 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.206.194@KRBTEST.COM'} at 127.26.206.194:39619
WARNING: no policy specified for kudu/127.26.206.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.206.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.206.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.195.keytab.
Entry for principal kudu/127.26.206.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.195.keytab.
I20260808 14:52:07.174796 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200577490656-27451-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200577490656-27451-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200577490656-27451-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200577490656-27451-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.26.206.212:57925/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.206.195:0
--local_ip_for_outbound_sockets=127.26.206.195
--webserver_interface=127.26.206.195
--webserver_port=0
--tserver_master_addrs=127.26.206.254:34791
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.195.keytab
--principal=kudu/127.26.206.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.206.212:35321
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 14:52:07.266840 8215 heartbeater.cc:503] Master 127.26.206.254:34791 was elected leader, sending a full tablet report...
W20260808 14:52:07.511518 8382 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:52:07.511886 8382 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:52:07.512056 8382 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:52:07.519407 8382 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:52:07.519595 8382 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:52:07.519797 8382 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.206.195
I20260808 14:52:07.529500 8382 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:35321
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200577490656-27451-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200577490656-27451-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.26.206.212:57925/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.195.keytab
--principal=kudu/127.26.206.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.206.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200577490656-27451-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.206.195
--webserver_port=0
--tserver_master_addrs=127.26.206.254:34791
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.206.195
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200577490656-27451-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:52:07.530838 8382 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:52:07.532336 8382 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:52:07.545696 8390 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:52:07.545833 8389 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:52:07.545667 8392 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:52:07.546465 8382 server_base.cc:1034] running on GCE node
I20260808 14:52:07.546968 8382 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:52:07.547859 8382 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:52:07.549052 8382 hybrid_clock.cc:648] HybridClock initialized: now 1786200727549015 us; error 36 us; skew 500 ppm
I20260808 14:52:07.549316 8382 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:52:07 dist-test-slave-6k22 krb5kdc[7424](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200727, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:52:07.557021 8382 init.cc:377] Logged in from keytab as kudu/127.26.206.195@KRBTEST.COM (short username kudu)
I20260808 14:52:07.558534 8382 webserver.cc:460] Webserver started at http://127.26.206.195:42695/ using document root <none> and password file <none>
I20260808 14:52:07.559195 8382 fs_manager.cc:359] Metadata directory not provided
I20260808 14:52:07.559355 8382 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:52:07.559764 8382 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 14:52:07 dist-test-slave-6k22 krb5kdc[7424](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200727, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.195@KRBTEST.COM for HTTP/127.26.206.212@KRBTEST.COM
I20260808 14:52:07.574929 8382 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200577490656-27451-0/minicluster-data/ts-2/data/instance:
uuid: "ea6394b65d3d48948299ef789395bdd4"
format_stamp: "Formatted at 2026-08-08 14:52:07 on dist-test-slave-6k22"
server_key: "4441079aa411773d399255b214726db1"
server_key_iv: "0cc8af2da0d63deaed00c5aaf3259f4d"
server_key_version: "kuduclusterkey@0"
I20260808 14:52:07.575855 8382 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200577490656-27451-0/minicluster-data/ts-2/wal/instance:
uuid: "ea6394b65d3d48948299ef789395bdd4"
format_stamp: "Formatted at 2026-08-08 14:52:07 on dist-test-slave-6k22"
server_key: "4441079aa411773d399255b214726db1"
server_key_iv: "0cc8af2da0d63deaed00c5aaf3259f4d"
server_key_version: "kuduclusterkey@0"
I20260808 14:52:07.581487 8382 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260808 14:52:07.599109 8402 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:52:07.600802 8382 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260808 14:52:07.600978 8382 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200577490656-27451-0/minicluster-data/ts-2/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200577490656-27451-0/minicluster-data/ts-2/wal
uuid: "ea6394b65d3d48948299ef789395bdd4"
format_stamp: "Formatted at 2026-08-08 14:52:07 on dist-test-slave-6k22"
server_key: "4441079aa411773d399255b214726db1"
server_key_iv: "0cc8af2da0d63deaed00c5aaf3259f4d"
server_key_version: "kuduclusterkey@0"
I20260808 14:52:07.601222 8382 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200577490656-27451-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200577490656-27451-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200577490656-27451-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:52:07.641104 8382 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:52:07.644923 8382 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:52:07.645179 8382 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:52:07.646088 8382 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:52:07.647365 8382 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:52:07.647439 8382 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:52:07.647522 8382 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:52:07.647625 8382 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.001s sys 0.000s
I20260808 14:52:07.681193 8382 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.195:38541
I20260808 14:52:07.681233 8524 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.195:38541 every 8 connection(s)
I20260808 14:52:07.682394 8382 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200577490656-27451-0/minicluster-data/ts-2/data/info.pb
I20260808 14:52:07.689014 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 8382
I20260808 14:52:07.689203 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200577490656-27451-0/minicluster-data/ts-2/wal/instance
I20260808 14:52:07.689606 27451 external_mini_cluster.cc:1428] Setting key 6e6b2db08e3b5d1713b87f983e58479b
Aug 08 14:52:07 dist-test-slave-6k22 krb5kdc[7424](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200727, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.195@KRBTEST.COM for kudu/127.26.206.254@KRBTEST.COM
I20260808 14:52:07.701537 8527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:52:07.684921 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.195:51281 (local address 127.26.206.254:34791)
0808 14:52:07.685415 (+ 494us) server_negotiation.cc:206] Beginning negotiation
0808 14:52:07.685420 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:52:07.686423 (+ 1003us) server_negotiation.cc:407] Connection header received
0808 14:52:07.688371 (+ 1948us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:52:07.688377 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:52:07.688466 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:52:07.688595 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:52:07.690120 (+ 1525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:52:07.690899 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:52:07.692632 (+ 1733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:52:07.693122 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:52:07.693223 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:52:07.696425 (+ 3202us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:52:07.696429 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:52:07.696432 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:52:07.696464 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:52:07.698973 (+ 2509us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:52:07.699679 (+ 706us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:52:07.699683 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:52:07.699685 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:52:07.699804 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:52:07.700181 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:52:07.700184 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:52:07.700186 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:52:07.700437 (+ 251us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:52:07.700543 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0808 14:52:07.701124 (+ 581us) server_negotiation.cc:299] Negotiation successful
0808 14:52:07.701274 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":389,"thread_start_us":242,"threads_started":1}
I20260808 14:52:07.702417 8528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:52:07.685508 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:34791 (local address 127.26.206.195:51281)
0808 14:52:07.686269 (+ 761us) negotiation.cc:107] Waiting for socket to connect
0808 14:52:07.686311 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 14:52:07.688113 (+ 1802us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:52:07.688846 (+ 733us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:52:07.688854 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:52:07.689358 (+ 504us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:52:07.689960 (+ 602us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:52:07.689978 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:52:07.691053 (+ 1075us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:52:07.691058 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:52:07.692462 (+ 1404us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:52:07.692476 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:52:07.693313 (+ 837us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:52:07.693318 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:52:07.693509 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:52:07.694104 (+ 595us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:52:07.694125 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:52:07.696232 (+ 2107us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:52:07.699090 (+ 2858us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:52:07.699097 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:52:07.699107 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:52:07.699518 (+ 411us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:52:07.699896 (+ 378us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:52:07.699899 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:52:07.699901 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:52:07.700085 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:52:07.700545 (+ 460us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:52:07.700550 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:52:07.700811 (+ 261us) client_negotiation.cc:769] Sending connection context
0808 14:52:07.701029 (+ 218us) client_negotiation.cc:240] Negotiation successful
0808 14:52:07.701381 (+ 352us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":511,"thread_start_us":329,"threads_started":1}
I20260808 14:52:07.703883 8525 heartbeater.cc:347] Connected to a master server at 127.26.206.254:34791
I20260808 14:52:07.704187 8525 heartbeater.cc:464] Registering TS with master...
I20260808 14:52:07.704974 8525 heartbeater.cc:511] Master 127.26.206.254:34791 requested a full tablet report, sending...
I20260808 14:52:07.706346 7971 ts_manager.cc:194] Registered new tserver with Master: ea6394b65d3d48948299ef789395bdd4 (127.26.206.195:38541)
I20260808 14:52:07.707213 7971 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.206.195@KRBTEST.COM'} at 127.26.206.195:51281
I20260808 14:52:07.717083 27451 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 14:52:07.734433 8527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:52:07.721558 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39452 (local address 127.26.206.254:34791)
0808 14:52:07.721724 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0808 14:52:07.721728 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:52:07.722183 (+ 455us) server_negotiation.cc:407] Connection header received
0808 14:52:07.722372 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:52:07.722377 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:52:07.722470 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:52:07.722571 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:52:07.724157 (+ 1586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:52:07.724883 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:52:07.726239 (+ 1356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:52:07.726694 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:52:07.726857 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:52:07.729273 (+ 2416us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:52:07.729287 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:52:07.729297 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:52:07.729326 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:52:07.731780 (+ 2454us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:52:07.732471 (+ 691us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:52:07.732478 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:52:07.732481 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:52:07.732606 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:52:07.732998 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:52:07.733004 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:52:07.733007 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:52:07.733286 (+ 279us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:52:07.733545 (+ 259us) server_negotiation.cc:1035] Waiting for connection context
0808 14:52:07.733879 (+ 334us) server_negotiation.cc:299] Negotiation successful
0808 14:52:07.734107 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260808 14:52:07.738160 7971 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39452:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:52:07.745519 7971 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:52:07.768239 8542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:52:07.757594 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33030 (local address 127.26.206.194:40223)
0808 14:52:07.760475 (+ 2881us) server_negotiation.cc:206] Beginning negotiation
0808 14:52:07.760486 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 14:52:07.760519 (+ 33us) server_negotiation.cc:407] Connection header received
0808 14:52:07.760613 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:52:07.760623 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:52:07.760866 (+ 243us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:52:07.761066 (+ 200us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:52:07.761930 (+ 864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:52:07.763439 (+ 1509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:52:07.765554 (+ 2115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:52:07.767040 (+ 1486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:52:07.767221 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:52:07.767408 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0808 14:52:07.767728 (+ 320us) server_negotiation.cc:299] Negotiation successful
0808 14:52:07.767891 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2714,"thread_start_us":2605,"threads_started":1}
I20260808 14:52:07.768333 8546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:52:07.757522 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.194:40223 (local address 127.0.0.1:33030)
0808 14:52:07.759273 (+ 1751us) negotiation.cc:107] Waiting for socket to connect
0808 14:52:07.759290 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 14:52:07.759410 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:52:07.761081 (+ 1671us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:52:07.761089 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:52:07.761121 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:52:07.761753 (+ 632us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:52:07.761767 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:52:07.763608 (+ 1841us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:52:07.763614 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:52:07.765395 (+ 1781us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:52:07.765407 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:52:07.767256 (+ 1849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:52:07.767262 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:52:07.767444 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:52:07.767492 (+ 48us) client_negotiation.cc:769] Sending connection context
0808 14:52:07.767673 (+ 181us) client_negotiation.cc:240] Negotiation successful
0808 14:52:07.767890 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1632,"mutex_wait_us":3,"thread_start_us":3569,"threads_started":1}
I20260808 14:52:07.769366 8541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:52:07.757503 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.195:38541 (local address 127.0.0.1:34984)
0808 14:52:07.758497 (+ 994us) negotiation.cc:107] Waiting for socket to connect
0808 14:52:07.758537 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 14:52:07.758723 (+ 186us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:52:07.760030 (+ 1307us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:52:07.760041 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:52:07.760080 (+ 39us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:52:07.761187 (+ 1107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:52:07.761203 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:52:07.763378 (+ 2175us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:52:07.763384 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:52:07.766175 (+ 2791us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:52:07.766189 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:52:07.768465 (+ 2276us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:52:07.768471 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:52:07.768634 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:52:07.768665 (+ 31us) client_negotiation.cc:769] Sending connection context
0808 14:52:07.768754 (+ 89us) client_negotiation.cc:240] Negotiation successful
0808 14:52:07.768904 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":678,"thread_start_us":510,"threads_started":1}
I20260808 14:52:07.770897 8544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:52:07.758408 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.193:42425 (local address 127.0.0.1:48634)
0808 14:52:07.761632 (+ 3224us) negotiation.cc:107] Waiting for socket to connect
0808 14:52:07.761645 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 14:52:07.761798 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:52:07.763129 (+ 1331us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:52:07.763134 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:52:07.763162 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:52:07.763873 (+ 711us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:52:07.763893 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:52:07.765944 (+ 2051us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:52:07.765949 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:52:07.768136 (+ 2187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:52:07.768151 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:52:07.770112 (+ 1961us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:52:07.770125 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:52:07.770307 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:52:07.770341 (+ 34us) client_negotiation.cc:769] Sending connection context
0808 14:52:07.770433 (+ 92us) client_negotiation.cc:240] Negotiation successful
0808 14:52:07.770569 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3125,"mutex_wait_us":29,"thread_start_us":730,"threads_started":1}
I20260808 14:52:07.771021 8547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:52:07.759127 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48634 (local address 127.26.206.193:42425)
0808 14:52:07.761070 (+ 1943us) server_negotiation.cc:206] Beginning negotiation
0808 14:52:07.761079 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:52:07.761746 (+ 667us) server_negotiation.cc:407] Connection header received
0808 14:52:07.762504 (+ 758us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:52:07.762511 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:52:07.762697 (+ 186us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:52:07.762866 (+ 169us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:52:07.764084 (+ 1218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:52:07.765781 (+ 1697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:52:07.768346 (+ 2565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:52:07.769882 (+ 1536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:52:07.770095 (+ 213us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:52:07.770286 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0808 14:52:07.770520 (+ 234us) server_negotiation.cc:299] Negotiation successful
0808 14:52:07.770694 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1761,"thread_start_us":1582,"threads_started":1}
I20260808 14:52:07.771211 8545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:52:07.758040 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34984 (local address 127.26.206.195:38541)
0808 14:52:07.759268 (+ 1228us) server_negotiation.cc:206] Beginning negotiation
0808 14:52:07.759287 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0808 14:52:07.759328 (+ 41us) server_negotiation.cc:407] Connection header received
0808 14:52:07.759440 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:52:07.759447 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:52:07.759775 (+ 328us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:52:07.760698 (+ 923us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:52:07.761521 (+ 823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:52:07.763218 (+ 1697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:52:07.766366 (+ 3148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:52:07.767928 (+ 1562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:52:07.768114 (+ 186us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:52:07.768302 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0808 14:52:07.769585 (+ 1283us) server_negotiation.cc:299] Negotiation successful
0808 14:52:07.770864 (+ 1279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1058,"thread_start_us":1300,"threads_started":1}
I20260808 14:52:07.772557 8303 tablet_service.cc:1467] Processing CreateTablet for tablet bac22ff91e7d4029b237c28af86d4c71 (DEFAULT_TABLE table=test-table [id=8e6f8d34d9644c8c9dab92dd7e7122d6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:52:07.774210 8303 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bac22ff91e7d4029b237c28af86d4c71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:52:07.774183 8140 tablet_service.cc:1467] Processing CreateTablet for tablet bac22ff91e7d4029b237c28af86d4c71 (DEFAULT_TABLE table=test-table [id=8e6f8d34d9644c8c9dab92dd7e7122d6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:52:07.774820 8452 tablet_service.cc:1467] Processing CreateTablet for tablet bac22ff91e7d4029b237c28af86d4c71 (DEFAULT_TABLE table=test-table [id=8e6f8d34d9644c8c9dab92dd7e7122d6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:52:07.775620 8140 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bac22ff91e7d4029b237c28af86d4c71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:52:07.776212 8452 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bac22ff91e7d4029b237c28af86d4c71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:52:07.786438 8548 tablet_bootstrap.cc:492] T bac22ff91e7d4029b237c28af86d4c71 P 3b5c7af379bd4ff8af71aab540ee5b85: Bootstrap starting.
I20260808 14:52:07.790445 8550 tablet_bootstrap.cc:492] T bac22ff91e7d4029b237c28af86d4c71 P ea6394b65d3d48948299ef789395bdd4: Bootstrap starting.
I20260808 14:52:07.790673 8548 tablet_bootstrap.cc:654] T bac22ff91e7d4029b237c28af86d4c71 P 3b5c7af379bd4ff8af71aab540ee5b85: Neither blocks nor log segments found. Creating new log.
I20260808 14:52:07.791827 8549 tablet_bootstrap.cc:492] T bac22ff91e7d4029b237c28af86d4c71 P 7e7a38f24fe048929b40bfcc369bd98e: Bootstrap starting.
I20260808 14:52:07.792339 8548 log.cc:824] T bac22ff91e7d4029b237c28af86d4c71 P 3b5c7af379bd4ff8af71aab540ee5b85: Log is configured to *not* fsync() on all Append() calls
I20260808 14:52:07.793969 8550 tablet_bootstrap.cc:654] T bac22ff91e7d4029b237c28af86d4c71 P ea6394b65d3d48948299ef789395bdd4: Neither blocks nor log segments found. Creating new log.
I20260808 14:52:07.795212 8550 log.cc:824] T bac22ff91e7d4029b237c28af86d4c71 P ea6394b65d3d48948299ef789395bdd4: Log is configured to *not* fsync() on all Append() calls
I20260808 14:52:07.795529 8549 tablet_bootstrap.cc:654] T bac22ff91e7d4029b237c28af86d4c71 P 7e7a38f24fe048929b40bfcc369bd98e: Neither blocks nor log segments found. Creating new log.
I20260808 14:52:07.795609 8548 tablet_bootstrap.cc:492] T bac22ff91e7d4029b237c28af86d4c71 P 3b5c7af379bd4ff8af71aab540ee5b85: No bootstrap required, opened a new log
I20260808 14:52:07.796136 8548 ts_tablet_manager.cc:1397] T bac22ff91e7d4029b237c28af86d4c71 P 3b5c7af379bd4ff8af71aab540ee5b85: Time spent bootstrapping tablet: real 0.010s user 0.008s sys 0.000s
I20260808 14:52:07.796871 8549 log.cc:824] T bac22ff91e7d4029b237c28af86d4c71 P 7e7a38f24fe048929b40bfcc369bd98e: Log is configured to *not* fsync() on all Append() calls
I20260808 14:52:07.798409 8550 tablet_bootstrap.cc:492] T bac22ff91e7d4029b237c28af86d4c71 P ea6394b65d3d48948299ef789395bdd4: No bootstrap required, opened a new log
I20260808 14:52:07.798671 8550 ts_tablet_manager.cc:1397] T bac22ff91e7d4029b237c28af86d4c71 P ea6394b65d3d48948299ef789395bdd4: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.005s
I20260808 14:52:07.799942 8549 tablet_bootstrap.cc:492] T bac22ff91e7d4029b237c28af86d4c71 P 7e7a38f24fe048929b40bfcc369bd98e: No bootstrap required, opened a new log
I20260808 14:52:07.800197 8549 ts_tablet_manager.cc:1397] T bac22ff91e7d4029b237c28af86d4c71 P 7e7a38f24fe048929b40bfcc369bd98e: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.002s
I20260808 14:52:07.803996 8548 raft_consensus.cc:348] T bac22ff91e7d4029b237c28af86d4c71 P 3b5c7af379bd4ff8af71aab540ee5b85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e7a38f24fe048929b40bfcc369bd98e" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 40223 } } peers { permanent_uuid: "ea6394b65d3d48948299ef789395bdd4" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 38541 } } peers { permanent_uuid: "3b5c7af379bd4ff8af71aab540ee5b85" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 42425 } }
I20260808 14:52:07.804354 8548 raft_consensus.cc:374] T bac22ff91e7d4029b237c28af86d4c71 P 3b5c7af379bd4ff8af71aab540ee5b85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:52:07.804490 8548 raft_consensus.cc:729] T bac22ff91e7d4029b237c28af86d4c71 P 3b5c7af379bd4ff8af71aab540ee5b85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b5c7af379bd4ff8af71aab540ee5b85, State: Initialized, Role: FOLLOWER
I20260808 14:52:07.805081 8548 consensus_queue.cc:260] T bac22ff91e7d4029b237c28af86d4c71 P 3b5c7af379bd4ff8af71aab540ee5b85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e7a38f24fe048929b40bfcc369bd98e" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 40223 } } peers { permanent_uuid: "ea6394b65d3d48948299ef789395bdd4" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 38541 } } peers { permanent_uuid: "3b5c7af379bd4ff8af71aab540ee5b85" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 42425 } }
I20260808 14:52:07.806887 8548 ts_tablet_manager.cc:1428] T bac22ff91e7d4029b237c28af86d4c71 P 3b5c7af379bd4ff8af71aab540ee5b85: Time spent starting tablet: real 0.011s user 0.006s sys 0.004s
I20260808 14:52:07.809273 8550 raft_consensus.cc:348] T bac22ff91e7d4029b237c28af86d4c71 P ea6394b65d3d48948299ef789395bdd4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e7a38f24fe048929b40bfcc369bd98e" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 40223 } } peers { permanent_uuid: "ea6394b65d3d48948299ef789395bdd4" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 38541 } } peers { permanent_uuid: "3b5c7af379bd4ff8af71aab540ee5b85" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 42425 } }
I20260808 14:52:07.809671 8550 raft_consensus.cc:374] T bac22ff91e7d4029b237c28af86d4c71 P ea6394b65d3d48948299ef789395bdd4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:52:07.809768 8550 raft_consensus.cc:729] T bac22ff91e7d4029b237c28af86d4c71 P ea6394b65d3d48948299ef789395bdd4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea6394b65d3d48948299ef789395bdd4, State: Initialized, Role: FOLLOWER
I20260808 14:52:07.810376 8550 consensus_queue.cc:260] T bac22ff91e7d4029b237c28af86d4c71 P ea6394b65d3d48948299ef789395bdd4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e7a38f24fe048929b40bfcc369bd98e" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 40223 } } peers { permanent_uuid: "ea6394b65d3d48948299ef789395bdd4" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 38541 } } peers { permanent_uuid: "3b5c7af379bd4ff8af71aab540ee5b85" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 42425 } }
I20260808 14:52:07.810882 8549 raft_consensus.cc:348] T bac22ff91e7d4029b237c28af86d4c71 P 7e7a38f24fe048929b40bfcc369bd98e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e7a38f24fe048929b40bfcc369bd98e" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 40223 } } peers { permanent_uuid: "ea6394b65d3d48948299ef789395bdd4" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 38541 } } peers { permanent_uuid: "3b5c7af379bd4ff8af71aab540ee5b85" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 42425 } }
I20260808 14:52:07.811440 8525 heartbeater.cc:503] Master 127.26.206.254:34791 was elected leader, sending a full tablet report...
I20260808 14:52:07.811445 8549 raft_consensus.cc:374] T bac22ff91e7d4029b237c28af86d4c71 P 7e7a38f24fe048929b40bfcc369bd98e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:52:07.811575 8549 raft_consensus.cc:729] T bac22ff91e7d4029b237c28af86d4c71 P 7e7a38f24fe048929b40bfcc369bd98e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e7a38f24fe048929b40bfcc369bd98e, State: Initialized, Role: FOLLOWER
I20260808 14:52:07.812191 8550 ts_tablet_manager.cc:1428] T bac22ff91e7d4029b237c28af86d4c71 P ea6394b65d3d48948299ef789395bdd4: Time spent starting tablet: real 0.013s user 0.008s sys 0.006s
I20260808 14:52:07.812345 8549 consensus_queue.cc:260] T bac22ff91e7d4029b237c28af86d4c71 P 7e7a38f24fe048929b40bfcc369bd98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e7a38f24fe048929b40bfcc369bd98e" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 40223 } } peers { permanent_uuid: "ea6394b65d3d48948299ef789395bdd4" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 38541 } } peers { permanent_uuid: "3b5c7af379bd4ff8af71aab540ee5b85" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 42425 } }
I20260808 14:52:07.813547 8375 heartbeater.cc:503] Master 127.26.206.254:34791 was elected leader, sending a full tablet report...
I20260808 14:52:07.814081 8549 ts_tablet_manager.cc:1428] T bac22ff91e7d4029b237c28af86d4c71 P 7e7a38f24fe048929b40bfcc369bd98e: Time spent starting tablet: real 0.014s user 0.009s sys 0.004s
W20260808 14:52:07.859356 8377 tablet.cc:2369] T bac22ff91e7d4029b237c28af86d4c71 P 7e7a38f24fe048929b40bfcc369bd98e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:52:07.917649 8555 raft_consensus.cc:482] T bac22ff91e7d4029b237c28af86d4c71 P 3b5c7af379bd4ff8af71aab540ee5b85 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:52:07.917973 8555 raft_consensus.cc:504] T bac22ff91e7d4029b237c28af86d4c71 P 3b5c7af379bd4ff8af71aab540ee5b85 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e7a38f24fe048929b40bfcc369bd98e" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 40223 } } peers { permanent_uuid: "ea6394b65d3d48948299ef789395bdd4" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 38541 } } peers { permanent_uuid: "3b5c7af379bd4ff8af71aab540ee5b85" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 42425 } }
I20260808 14:52:07.919804 8555 leader_election.cc:288] T bac22ff91e7d4029b237c28af86d4c71 P 3b5c7af379bd4ff8af71aab540ee5b85 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e7a38f24fe048929b40bfcc369bd98e (127.26.206.194:40223), ea6394b65d3d48948299ef789395bdd4 (127.26.206.195:38541)
I20260808 14:52:07.926865 8545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:52:07.920485 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.193:59119 (local address 127.26.206.195:38541)
0808 14:52:07.920683 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0808 14:52:07.920690 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:52:07.921112 (+ 422us) server_negotiation.cc:407] Connection header received
0808 14:52:07.921358 (+ 246us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:52:07.921365 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:52:07.921447 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:52:07.921554 (+ 107us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:52:07.922208 (+ 654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:52:07.923235 (+ 1027us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:52:07.925097 (+ 1862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:52:07.925921 (+ 824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:52:07.926079 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:52:07.926152 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 14:52:07.926476 (+ 324us) server_negotiation.cc:299] Negotiation successful
0808 14:52:07.926597 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260808 14:52:07.926868 8542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:52:07.920116 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.193:59131 (local address 127.26.206.194:40223)
0808 14:52:07.920334 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0808 14:52:07.920340 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:52:07.921282 (+ 942us) server_negotiation.cc:407] Connection header received
0808 14:52:07.921572 (+ 290us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:52:07.921577 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:52:07.921657 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:52:07.921776 (+ 119us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:52:07.922395 (+ 619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:52:07.923125 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:52:07.925039 (+ 1914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:52:07.925811 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:52:07.925925 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:52:07.925977 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0808 14:52:07.926448 (+ 471us) server_negotiation.cc:299] Negotiation successful
0808 14:52:07.926577 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260808 14:52:07.926986 8559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:52:07.920201 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.194:40223 (local address 127.26.206.193:59131)
0808 14:52:07.921173 (+ 972us) negotiation.cc:107] Waiting for socket to connect
0808 14:52:07.921188 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 14:52:07.921388 (+ 200us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:52:07.921797 (+ 409us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:52:07.921800 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:52:07.921823 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:52:07.922226 (+ 403us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:52:07.922240 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:52:07.923290 (+ 1050us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:52:07.923308 (+ 18us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:52:07.924867 (+ 1559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:52:07.924883 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:52:07.926049 (+ 1166us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:52:07.926056 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:52:07.926242 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:52:07.926312 (+ 70us) client_negotiation.cc:769] Sending connection context
0808 14:52:07.926388 (+ 76us) client_negotiation.cc:240] Negotiation successful
0808 14:52:07.926534 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":822,"mutex_wait_us":36,"thread_start_us":622,"threads_started":1}
I20260808 14:52:07.927034 8558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:52:07.920055 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.195:38541 (local address 127.26.206.193:59119)
0808 14:52:07.920976 (+ 921us) negotiation.cc:107] Waiting for socket to connect
0808 14:52:07.921000 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0808 14:52:07.921164 (+ 164us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:52:07.921587 (+ 423us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:52:07.921592 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:52:07.921617 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:52:07.922039 (+ 422us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:52:07.922050 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:52:07.923384 (+ 1334us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:52:07.923388 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:52:07.924921 (+ 1533us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:52:07.924934 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:52:07.926152 (+ 1218us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:52:07.926156 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:52:07.926298 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:52:07.926324 (+ 26us) client_negotiation.cc:769] Sending connection context
0808 14:52:07.926433 (+ 109us) client_negotiation.cc:240] Negotiation successful
0808 14:52:07.926564 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":758,"mutex_wait_us":13,"thread_start_us":481,"threads_started":1}
I20260808 14:52:07.927975 8325 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bac22ff91e7d4029b237c28af86d4c71" candidate_uuid: "3b5c7af379bd4ff8af71aab540ee5b85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e7a38f24fe048929b40bfcc369bd98e" is_pre_election: true
I20260808 14:52:07.928210 8476 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bac22ff91e7d4029b237c28af86d4c71" candidate_uuid: "3b5c7af379bd4ff8af71aab540ee5b85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea6394b65d3d48948299ef789395bdd4" is_pre_election: true
I20260808 14:52:07.928455 8325 raft_consensus.cc:2454] T bac22ff91e7d4029b237c28af86d4c71 P 7e7a38f24fe048929b40bfcc369bd98e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b5c7af379bd4ff8af71aab540ee5b85 in term 0.
I20260808 14:52:07.928745 8476 raft_consensus.cc:2454] T bac22ff91e7d4029b237c28af86d4c71 P ea6394b65d3d48948299ef789395bdd4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b5c7af379bd4ff8af71aab540ee5b85 in term 0.
I20260808 14:52:07.929193 8091 leader_election.cc:302] T bac22ff91e7d4029b237c28af86d4c71 P 3b5c7af379bd4ff8af71aab540ee5b85 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b5c7af379bd4ff8af71aab540ee5b85, 7e7a38f24fe048929b40bfcc369bd98e; no voters:
I20260808 14:52:07.929638 8555 raft_consensus.cc:2781] T bac22ff91e7d4029b237c28af86d4c71 P 3b5c7af379bd4ff8af71aab540ee5b85 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:52:07.929829 8555 raft_consensus.cc:482] T bac22ff91e7d4029b237c28af86d4c71 P 3b5c7af379bd4ff8af71aab540ee5b85 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:52:07.929941 8555 raft_consensus.cc:3037] T bac22ff91e7d4029b237c28af86d4c71 P 3b5c7af379bd4ff8af71aab540ee5b85 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:52:07.932247 8555 raft_consensus.cc:504] T bac22ff91e7d4029b237c28af86d4c71 P 3b5c7af379bd4ff8af71aab540ee5b85 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e7a38f24fe048929b40bfcc369bd98e" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 40223 } } peers { permanent_uuid: "ea6394b65d3d48948299ef789395bdd4" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 38541 } } peers { permanent_uuid: "3b5c7af379bd4ff8af71aab540ee5b85" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 42425 } }
I20260808 14:52:07.932806 8555 leader_election.cc:288] T bac22ff91e7d4029b237c28af86d4c71 P 3b5c7af379bd4ff8af71aab540ee5b85 [CANDIDATE]: Term 1 election: Requested vote from peers 7e7a38f24fe048929b40bfcc369bd98e (127.26.206.194:40223), ea6394b65d3d48948299ef789395bdd4 (127.26.206.195:38541)
I20260808 14:52:07.933230 8325 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bac22ff91e7d4029b237c28af86d4c71" candidate_uuid: "3b5c7af379bd4ff8af71aab540ee5b85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e7a38f24fe048929b40bfcc369bd98e"
I20260808 14:52:07.933254 8476 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bac22ff91e7d4029b237c28af86d4c71" candidate_uuid: "3b5c7af379bd4ff8af71aab540ee5b85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea6394b65d3d48948299ef789395bdd4"
I20260808 14:52:07.933422 8325 raft_consensus.cc:3037] T bac22ff91e7d4029b237c28af86d4c71 P 7e7a38f24fe048929b40bfcc369bd98e [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:52:07.933450 8476 raft_consensus.cc:3037] T bac22ff91e7d4029b237c28af86d4c71 P ea6394b65d3d48948299ef789395bdd4 [term 0 FOLLOWER]: Advancing to term 1
W20260808 14:52:07.934064 8526 tablet.cc:2369] T bac22ff91e7d4029b237c28af86d4c71 P ea6394b65d3d48948299ef789395bdd4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:52:07.935866 8476 raft_consensus.cc:2454] T bac22ff91e7d4029b237c28af86d4c71 P ea6394b65d3d48948299ef789395bdd4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b5c7af379bd4ff8af71aab540ee5b85 in term 1.
I20260808 14:52:07.936136 8325 raft_consensus.cc:2454] T bac22ff91e7d4029b237c28af86d4c71 P 7e7a38f24fe048929b40bfcc369bd98e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b5c7af379bd4ff8af71aab540ee5b85 in term 1.
I20260808 14:52:07.936291 8089 leader_election.cc:302] T bac22ff91e7d4029b237c28af86d4c71 P 3b5c7af379bd4ff8af71aab540ee5b85 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b5c7af379bd4ff8af71aab540ee5b85, ea6394b65d3d48948299ef789395bdd4; no voters:
I20260808 14:52:07.936618 8555 raft_consensus.cc:2781] T bac22ff91e7d4029b237c28af86d4c71 P 3b5c7af379bd4ff8af71aab540ee5b85 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:52:07.937036 8555 raft_consensus.cc:686] T bac22ff91e7d4029b237c28af86d4c71 P 3b5c7af379bd4ff8af71aab540ee5b85 [term 1 LEADER]: Becoming Leader. State: Replica: 3b5c7af379bd4ff8af71aab540ee5b85, State: Running, Role: LEADER
I20260808 14:52:07.937580 8555 consensus_queue.cc:237] T bac22ff91e7d4029b237c28af86d4c71 P 3b5c7af379bd4ff8af71aab540ee5b85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e7a38f24fe048929b40bfcc369bd98e" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 40223 } } peers { permanent_uuid: "ea6394b65d3d48948299ef789395bdd4" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 38541 } } peers { permanent_uuid: "3b5c7af379bd4ff8af71aab540ee5b85" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 42425 } }
I20260808 14:52:07.942114 7969 catalog_manager.cc:5495] T bac22ff91e7d4029b237c28af86d4c71 P 3b5c7af379bd4ff8af71aab540ee5b85 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3b5c7af379bd4ff8af71aab540ee5b85 (127.26.206.193). New cstate: current_term: 1 leader_uuid: "3b5c7af379bd4ff8af71aab540ee5b85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e7a38f24fe048929b40bfcc369bd98e" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 40223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea6394b65d3d48948299ef789395bdd4" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 38541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3b5c7af379bd4ff8af71aab540ee5b85" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 42425 } health_report { overall_health: HEALTHY } } }
I20260808 14:52:07.958427 8547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:52:07.953483 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48650 (local address 127.26.206.193:42425)
0808 14:52:07.953655 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0808 14:52:07.953659 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:52:07.953673 (+ 14us) server_negotiation.cc:407] Connection header received
0808 14:52:07.953740 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:52:07.953744 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:52:07.953817 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:52:07.953928 (+ 111us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:52:07.954318 (+ 390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:52:07.955038 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:52:07.956486 (+ 1448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:52:07.956874 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:52:07.956961 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:52:07.957447 (+ 486us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:52:07.957914 (+ 467us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:52:07.958019 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0808 14:52:07.958113 (+ 94us) server_negotiation.cc:299] Negotiation successful
0808 14:52:07.958173 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260808 14:52:07.966393 8476 raft_consensus.cc:1261] T bac22ff91e7d4029b237c28af86d4c71 P ea6394b65d3d48948299ef789395bdd4 [term 1 FOLLOWER]: Refusing update from remote peer 3b5c7af379bd4ff8af71aab540ee5b85: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:52:07.966398 8325 raft_consensus.cc:1261] T bac22ff91e7d4029b237c28af86d4c71 P 7e7a38f24fe048929b40bfcc369bd98e [term 1 FOLLOWER]: Refusing update from remote peer 3b5c7af379bd4ff8af71aab540ee5b85: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:52:07.967371 8561 consensus_queue.cc:1035] T bac22ff91e7d4029b237c28af86d4c71 P 3b5c7af379bd4ff8af71aab540ee5b85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e7a38f24fe048929b40bfcc369bd98e" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 40223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:52:07.967810 8555 consensus_queue.cc:1035] T bac22ff91e7d4029b237c28af86d4c71 P 3b5c7af379bd4ff8af71aab540ee5b85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea6394b65d3d48948299ef789395bdd4" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 38541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260808 14:52:07.976900 8216 tablet.cc:2369] T bac22ff91e7d4029b237c28af86d4c71 P 3b5c7af379bd4ff8af71aab540ee5b85: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:52:07.982072 8567 mvcc.cc:205] Tried to move back new op lower bound from 7316278181740822528 to 7316278181636165632. Current Snapshot: MvccSnapshot[applied={T|T < 7316278181740822528}]
I20260808 14:52:07.994452 7971 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39452:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:52:07.994756 7971 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39452:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:52:07.998551 7971 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 96852056c2d44b45bcaa9d6405a53ad4: Sending DeleteTablet for 3 replicas of tablet bac22ff91e7d4029b237c28af86d4c71
I20260808 14:52:07.999672 8303 tablet_service.cc:1514] Processing DeleteTablet for tablet bac22ff91e7d4029b237c28af86d4c71 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:52:07 UTC) from {username='kudu', principal='kudu/127.26.206.254@KRBTEST.COM'} at 127.0.0.1:33030
I20260808 14:52:07.999869 8452 tablet_service.cc:1514] Processing DeleteTablet for tablet bac22ff91e7d4029b237c28af86d4c71 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:52:07 UTC) from {username='kudu', principal='kudu/127.26.206.254@KRBTEST.COM'} at 127.0.0.1:34984
I20260808 14:52:08.000677 8140 tablet_service.cc:1514] Processing DeleteTablet for tablet bac22ff91e7d4029b237c28af86d4c71 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:52:07 UTC) from {username='kudu', principal='kudu/127.26.206.254@KRBTEST.COM'} at 127.0.0.1:48634
I20260808 14:52:08.001569 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 8064
I20260808 14:52:08.014297 8578 tablet_replica.cc:330] T bac22ff91e7d4029b237c28af86d4c71 P 3b5c7af379bd4ff8af71aab540ee5b85: stopping tablet replica
I20260808 14:52:08.017087 8577 tablet_replica.cc:330] T bac22ff91e7d4029b237c28af86d4c71 P ea6394b65d3d48948299ef789395bdd4: stopping tablet replica
I20260808 14:52:08.017630 8578 raft_consensus.cc:2229] T bac22ff91e7d4029b237c28af86d4c71 P 3b5c7af379bd4ff8af71aab540ee5b85 [term 1 LEADER]: Raft consensus shutting down.
I20260808 14:52:08.017614 8577 raft_consensus.cc:2229] T bac22ff91e7d4029b237c28af86d4c71 P ea6394b65d3d48948299ef789395bdd4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:52:08.018155 8577 raft_consensus.cc:2258] T bac22ff91e7d4029b237c28af86d4c71 P ea6394b65d3d48948299ef789395bdd4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:52:08.018501 8578 raft_consensus.cc:2258] T bac22ff91e7d4029b237c28af86d4c71 P 3b5c7af379bd4ff8af71aab540ee5b85 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:52:08.020599 8578 ts_tablet_manager.cc:1905] T bac22ff91e7d4029b237c28af86d4c71 P 3b5c7af379bd4ff8af71aab540ee5b85: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:52:08.020591 8577 ts_tablet_manager.cc:1905] T bac22ff91e7d4029b237c28af86d4c71 P ea6394b65d3d48948299ef789395bdd4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:52:08.024104 8576 tablet_replica.cc:330] T bac22ff91e7d4029b237c28af86d4c71 P 7e7a38f24fe048929b40bfcc369bd98e: stopping tablet replica
I20260808 14:52:08.024655 8576 raft_consensus.cc:2229] T bac22ff91e7d4029b237c28af86d4c71 P 7e7a38f24fe048929b40bfcc369bd98e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:52:08.025243 8576 raft_consensus.cc:2258] T bac22ff91e7d4029b237c28af86d4c71 P 7e7a38f24fe048929b40bfcc369bd98e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:52:08.028895 8576 ts_tablet_manager.cc:1905] T bac22ff91e7d4029b237c28af86d4c71 P 7e7a38f24fe048929b40bfcc369bd98e: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 08 14:52:08 dist-test-slave-6k22 krb5kdc[7424](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200723, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.206.193@KRBTEST.COM
I20260808 14:52:08.032403 8578 ts_tablet_manager.cc:1918] T bac22ff91e7d4029b237c28af86d4c71 P 3b5c7af379bd4ff8af71aab540ee5b85: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:52:08.032631 8578 log.cc:1196] T bac22ff91e7d4029b237c28af86d4c71 P 3b5c7af379bd4ff8af71aab540ee5b85: Deleting WAL directory at /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200577490656-27451-0/minicluster-data/ts-0/wal/wals/bac22ff91e7d4029b237c28af86d4c71
I20260808 14:52:08.033634 8578 ts_tablet_manager.cc:1939] T bac22ff91e7d4029b237c28af86d4c71 P 3b5c7af379bd4ff8af71aab540ee5b85: Deleting consensus metadata
I20260808 14:52:08.033993 8577 ts_tablet_manager.cc:1918] T bac22ff91e7d4029b237c28af86d4c71 P ea6394b65d3d48948299ef789395bdd4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:52:08.034214 8577 log.cc:1196] T bac22ff91e7d4029b237c28af86d4c71 P ea6394b65d3d48948299ef789395bdd4: Deleting WAL directory at /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200577490656-27451-0/minicluster-data/ts-2/wal/wals/bac22ff91e7d4029b237c28af86d4c71
I20260808 14:52:08.034765 8577 ts_tablet_manager.cc:1939] T bac22ff91e7d4029b237c28af86d4c71 P ea6394b65d3d48948299ef789395bdd4: Deleting consensus metadata
I20260808 14:52:08.035727 7950 catalog_manager.cc:4841] TS 3b5c7af379bd4ff8af71aab540ee5b85 (127.26.206.193:42425): tablet bac22ff91e7d4029b237c28af86d4c71 (table test-table [id=8e6f8d34d9644c8c9dab92dd7e7122d6]) successfully deleted
I20260808 14:52:08.036563 7949 catalog_manager.cc:4841] TS ea6394b65d3d48948299ef789395bdd4 (127.26.206.195:38541): tablet bac22ff91e7d4029b237c28af86d4c71 (table test-table [id=8e6f8d34d9644c8c9dab92dd7e7122d6]) successfully deleted
I20260808 14:52:08.037364 8576 ts_tablet_manager.cc:1918] T bac22ff91e7d4029b237c28af86d4c71 P 7e7a38f24fe048929b40bfcc369bd98e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:52:08.037539 8576 log.cc:1196] T bac22ff91e7d4029b237c28af86d4c71 P 7e7a38f24fe048929b40bfcc369bd98e: Deleting WAL directory at /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200577490656-27451-0/minicluster-data/ts-1/wal/wals/bac22ff91e7d4029b237c28af86d4c71
I20260808 14:52:08.038079 8576 ts_tablet_manager.cc:1939] T bac22ff91e7d4029b237c28af86d4c71 P 7e7a38f24fe048929b40bfcc369bd98e: Deleting consensus metadata
I20260808 14:52:08.039774 7951 catalog_manager.cc:4841] TS 7e7a38f24fe048929b40bfcc369bd98e (127.26.206.194:40223): tablet bac22ff91e7d4029b237c28af86d4c71 (table test-table [id=8e6f8d34d9644c8c9dab92dd7e7122d6]) successfully deleted
I20260808 14:52:08.040190 8547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:52:08.003152 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48658 (local address 127.26.206.193:42425)
0808 14:52:08.003369 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0808 14:52:08.003377 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:52:08.013505 (+ 10128us) server_negotiation.cc:407] Connection header received
0808 14:52:08.014776 (+ 1271us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:52:08.014785 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:52:08.014897 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:52:08.014995 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:52:08.020822 (+ 5827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:52:08.021934 (+ 1112us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:52:08.024034 (+ 2100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:52:08.024759 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:52:08.024902 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:52:08.030942 (+ 6040us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:52:08.030961 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:52:08.030983 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:52:08.031028 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:52:08.036339 (+ 5311us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:52:08.037223 (+ 884us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:52:08.037231 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:52:08.037235 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:52:08.037446 (+ 211us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:52:08.037964 (+ 518us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:52:08.037969 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:52:08.037974 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:52:08.038473 (+ 499us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:52:08.038770 (+ 297us) server_negotiation.cc:1035] Waiting for connection context
0808 14:52:08.039171 (+ 401us) server_negotiation.cc:299] Negotiation successful
0808 14:52:08.039431 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260808 14:52:08.040918 8210 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:52:08.139806 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 8064
I20260808 14:52:08.162209 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 8221
Aug 08 14:52:08 dist-test-slave-6k22 krb5kdc[7424](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200723, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.206.194@KRBTEST.COM
I20260808 14:52:08.179177 8542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:52:08.163077 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33034 (local address 127.26.206.194:40223)
0808 14:52:08.163248 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0808 14:52:08.163252 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:52:08.163272 (+ 20us) server_negotiation.cc:407] Connection header received
0808 14:52:08.163376 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:52:08.163379 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:52:08.163440 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:52:08.163521 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:52:08.164808 (+ 1287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:52:08.165521 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:52:08.166846 (+ 1325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:52:08.167225 (+ 379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:52:08.167317 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:52:08.171714 (+ 4397us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:52:08.171726 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:52:08.171740 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:52:08.171793 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:52:08.175790 (+ 3997us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:52:08.176744 (+ 954us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:52:08.176753 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:52:08.176756 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:52:08.176965 (+ 209us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:52:08.177444 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:52:08.177449 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:52:08.177453 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:52:08.177941 (+ 488us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:52:08.178280 (+ 339us) server_negotiation.cc:1035] Waiting for connection context
0808 14:52:08.178571 (+ 291us) server_negotiation.cc:299] Negotiation successful
0808 14:52:08.178786 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260808 14:52:08.179960 8370 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:52:08.269730 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 8221
I20260808 14:52:08.289157 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 8382
Aug 08 14:52:08 dist-test-slave-6k22 krb5kdc[7424](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200723, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.206.195@KRBTEST.COM
I20260808 14:52:08.304771 8545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:52:08.289960 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35000 (local address 127.26.206.195:38541)
0808 14:52:08.290147 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0808 14:52:08.290156 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:52:08.290185 (+ 29us) server_negotiation.cc:407] Connection header received
0808 14:52:08.290407 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:52:08.290411 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:52:08.290474 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:52:08.290580 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:52:08.291969 (+ 1389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:52:08.292715 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:52:08.293998 (+ 1283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:52:08.294406 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:52:08.294537 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:52:08.299132 (+ 4595us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:52:08.299147 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:52:08.299163 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:52:08.299200 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:52:08.301882 (+ 2682us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:52:08.302584 (+ 702us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:52:08.302592 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:52:08.302594 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:52:08.302715 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:52:08.303098 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:52:08.303104 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:52:08.303107 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:52:08.303488 (+ 381us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:52:08.303871 (+ 383us) server_negotiation.cc:1035] Waiting for connection context
0808 14:52:08.304173 (+ 302us) server_negotiation.cc:299] Negotiation successful
0808 14:52:08.304415 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260808 14:52:08.305378 8520 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:52:08.394351 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 8382
I20260808 14:52:08.415199 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 7933
I20260808 14:52:08.416464 8005 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:52:08.531368 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 7933
I20260808 14:52:08.557907 27451 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260808 14:52:08.902844 27451 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260808 14:52:08.903116 27451 mini_ranger.cc:66] Stopping Ranger...
I20260808 14:52:09.247983 27451 mini_ranger.cc:68] Stopped Ranger
2026-08-08 14:52:09.248 UTC [7459] LOG: received smart shutdown request
2026-08-08 14:52:09.252 UTC [7459] LOG: background worker "logical replication launcher" (PID 7468) exited with exit code 1
2026-08-08 14:52:09.252 UTC [7462] LOG: shutting down
2026-08-08 14:52:09.409 UTC [7459] LOG: database system is shut down
2026-08-08T14:52:09Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (49502 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:52:09 dist-test-slave-6k22 krb5kdc[8592](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:52:09 dist-test-slave-6k22 krb5kdc[8592](info): set up 2 sockets
Aug 08 14:52:09 dist-test-slave-6k22 krb5kdc[8592](info): commencing operation
krb5kdc: starting...
W20260808 14:52:10.714838 27451 mini_kdc.cc:121] Time spent starting KDC: real 1.138s user 0.009s sys 0.030s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/krb5kdc/test-user.keytab.
Aug 08 14:52:10 dist-test-slave-6k22 krb5kdc[8592](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200730, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:52:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:52:10Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.26.206.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.26.206.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.26.206.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/krb5kdc/rangeradmin_127.26.206.212@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.26.206.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/krb5kdc/rangeradmin_127.26.206.212@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.26.206.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.26.206.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.26.206.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/krb5kdc/rangerlookup_127.26.206.212@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.26.206.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/krb5kdc/rangerlookup_127.26.206.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.26.206.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.26.206.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.26.206.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/krb5kdc/HTTP_127.26.206.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.26.206.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/krb5kdc/HTTP_127.26.206.212@KRBTEST.COM.keytab.
I20260808 14:52:11.075879 27451 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskBCPck2/build/asan/bin/postgres/pg_ctl -D /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/postgres -l logfile start
2026-08-08 14:52:13.724 UTC [8623] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-08 14:52:13.724 UTC [8623] LOG: listening on IPv4 address "127.26.206.212", port 33569
2026-08-08 14:52:13.728 UTC [8623] LOG: listening on Unix socket "/tmp/.s.PGSQL.33569"
2026-08-08 14:52:13.753 UTC [8626] LOG: database system was shut down at 2026-08-08 14:52:12 UTC
2026-08-08 14:52:13.757 UTC [8623] LOG: database system is ready to accept connections
I20260808 14:52:14.799646 27451 mini_postgres.cc:96] Postgres bound to 33569
2026-08-08 14:52:14.822 UTC [8634] FATAL: database "slave" does not exist
127.26.206.212:33569 - accepting connections
I20260808 14:52:14.823705 27451 mini_ranger.cc:161] Starting Ranger...
I20260808 14:52:14.853845 27451 mini_ranger.cc:84] Created miniranger Postgres user
I20260808 14:52:15.366631 27451 mini_ranger.cc:87] Created ranger Postgres database
I20260808 14:52:15.366770 27451 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/ranger-admin
2026-08-08 14:52:15,665 [I] DB FLAVOR :POSTGRES
2026-08-08 14:52:15,665 [I] --------- Verifying Ranger DB connection ---------
2026-08-08 14:52:15,665 [I] Checking connection..
2026-08-08 14:52:15,665 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBCPck2/build/asan/bin/postgresql.jar:/tmp/dist-test-taskBCPck2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.206.212:33569/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-08 14:52:15,914 [I] Checking connection passed.
2026-08-08 14:52:15,915 [I] --------- Verifying version history table ---------
2026-08-08 14:52:15,915 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBCPck2/build/asan/bin/postgresql.jar:/tmp/dist-test-taskBCPck2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.206.212:33569/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 14:52:16,154 [I] Table x_db_version_h does not exist in database ranger
2026-08-08 14:52:16,154 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBCPck2/build/asan/bin/postgresql.jar:/tmp/dist-test-taskBCPck2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.206.212:33569/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 14:52:16,386 [I] Table x_db_version_h does not exist in database ranger
2026-08-08 14:52:16,386 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-08 14:52:16,386 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBCPck2/build/asan/bin/postgresql.jar:/tmp/dist-test-taskBCPck2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.206.212:33569/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskBCPck2/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-08 14:52:16.644 UTC [8707] WARNING: there is no transaction in progress
2026-08-08 14:52:16,651 [I] create_dbversion_catalog.sql file imported successfully
2026-08-08 14:52:16,651 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBCPck2/build/asan/bin/postgresql.jar:/tmp/dist-test-taskBCPck2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.206.212:33569/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 14:52:16,910 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-08 14:52:16,910 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-08 14:52:16,910 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBCPck2/build/asan/bin/postgresql.jar:/tmp/dist-test-taskBCPck2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.206.212:33569/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-08 14:52:17,196 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBCPck2/build/asan/bin/postgresql.jar:/tmp/dist-test-taskBCPck2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.206.212:33569/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-08 14:52:17,461 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBCPck2/build/asan/bin/postgresql.jar:/tmp/dist-test-taskBCPck2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.206.212:33569/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-6k22.c.gcp-upstream.internal','N') ;"
2026-08-08 14:52:17,695 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBCPck2/build/asan/bin/postgresql.jar:/tmp/dist-test-taskBCPck2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.206.212:33569/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-08 14:52:17,955 [I] Table x_portal_user does not exist in database ranger
2026-08-08 14:52:17,956 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBCPck2/build/asan/bin/postgresql.jar:/tmp/dist-test-taskBCPck2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.206.212:33569/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-08 14:52:18,229 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-08 14:52:18,229 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBCPck2/build/asan/bin/postgresql.jar:/tmp/dist-test-taskBCPck2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.206.212:33569/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-08 14:52:18,470 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBCPck2/build/asan/bin/postgresql.jar:/tmp/dist-test-taskBCPck2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.206.212:33569/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-08 14:52:18,735 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-08 14:52:18,735 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBCPck2/build/asan/bin/postgresql.jar:/tmp/dist-test-taskBCPck2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.206.212:33569/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskBCPck2/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-08 14:52:19.701 UTC [8828] WARNING: there is no transaction in progress
2026-08-08 14:52:19.717 UTC [8828] WARNING: there is no transaction in progress
2026-08-08 14:52:19.734 UTC [8828] WARNING: there is no transaction in progress
2026-08-08 14:52:19.750 UTC [8828] WARNING: there is no transaction in progress
2026-08-08 14:52:19.767 UTC [8828] WARNING: there is no transaction in progress
2026-08-08 14:52:19.786 UTC [8828] WARNING: there is no transaction in progress
2026-08-08 14:52:19.851 UTC [8828] WARNING: there is no transaction in progress
2026-08-08 14:52:19.858 UTC [8828] WARNING: there is no transaction in progress
2026-08-08 14:52:19.873 UTC [8828] WARNING: there is no transaction in progress
2026-08-08 14:52:19.883 UTC [8828] WARNING: there is no transaction in progress
2026-08-08 14:52:19.893 UTC [8828] WARNING: there is no transaction in progress
2026-08-08 14:52:19.907 UTC [8828] WARNING: there is no transaction in progress
2026-08-08 14:52:19.917 UTC [8828] WARNING: there is no transaction in progress
2026-08-08 14:52:19.923 UTC [8828] WARNING: there is no transaction in progress
2026-08-08 14:52:19.930 UTC [8828] WARNING: there is no transaction in progress
2026-08-08 14:52:19.937 UTC [8828] WARNING: there is no transaction in progress
2026-08-08 14:52:20,591 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-08 14:52:20,592 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBCPck2/build/asan/bin/postgresql.jar:/tmp/dist-test-taskBCPck2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.206.212:33569/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-08 14:52:20,852 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-08 14:52:20,852 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBCPck2/build/asan/bin/postgresql.jar:/tmp/dist-test-taskBCPck2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.206.212:33569/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-08 14:52:21,137 [I] Table x_portal_user already exists in database 'ranger'
2026-08-08 14:52:21,137 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBCPck2/build/asan/bin/postgresql.jar:/tmp/dist-test-taskBCPck2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.206.212:33569/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-08 14:52:21,395 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-08 14:52:21,395 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBCPck2/build/asan/bin/postgresql.jar:/tmp/dist-test-taskBCPck2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.206.212:33569/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-08 14:52:21,656 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBCPck2/build/asan/bin/postgresql.jar:/tmp/dist-test-taskBCPck2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.206.212:33569/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-08 14:52:21,913 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBCPck2/build/asan/bin/postgresql.jar:/tmp/dist-test-taskBCPck2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.206.212:33569/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-6k22.c.gcp-upstream.internal';"
2026-08-08 14:52:22,179 [I] CORE_DB_SCHEMA import status has been updated
2026-08-08 14:52:22,180 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBCPck2/build/asan/bin/postgresql.jar:/tmp/dist-test-taskBCPck2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.206.212:33569/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-08 14:52:22,436 [I] DB_PATCHES have already been applied
I20260808 14:52:22.442617 27451 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/ranger-admin:/tmp/dist-test-taskBCPck2/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskBCPck2/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskBCPck2/build/asan/bin/postgresql.jar:/tmp/dist-test-taskBCPck2/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260808 14:52:22.442728 27451 mini_ranger.cc:193] Using host: 127.26.206.212
I20260808 14:52:22.463014 27451 mini_ranger.cc:227] Ranger admin URL: http://127.26.206.212:47481
Aug 08, 2026 2:52:22 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 08, 2026 2:52:22 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 08, 2026 2:52:23 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/ranger-admin/ews/webapp
Aug 08, 2026 2:52:23 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 08, 2026 2:52:23 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 08, 2026 2:52:23 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/ranger-admin/ews/webapp].
Aug 08, 2026 2:52:23 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260808 14:52:23.736595 27451 mini_ranger.cc:160] Time spent starting Ranger: real 8.913s user 0.002s sys 0.054s
Aug 08, 2026 2:52:44 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 08, 2026 2:52:44 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.UserREST
Aug 08, 2026 2:52:44 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 08, 2026 2:52:44 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 08, 2026 2:52:44 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 08, 2026 2:52:44 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 08, 2026 2:52:44 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 08, 2026 2:52:44 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 08, 2026 2:52:44 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 08, 2026 2:52:44 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 08, 2026 2:52:44 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 08, 2026 2:52:44 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 08, 2026 2:52:44 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 08, 2026 2:52:44 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 08, 2026 2:52:44 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 08, 2026 2:52:44 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 08, 2026 2:52:44 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 08, 2026 2:52:45 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260808 14:52:45.624778 27451 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.26.206.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.26.206.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.26.206.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/krb5kdc/rangerkms_127.26.206.212@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.26.206.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/krb5kdc/rangerkms_127.26.206.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.26.206.212@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.26.206.212@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.26.206.212@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/krb5kdc/HTTP_127.26.206.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.26.206.212@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/krb5kdc/HTTP_127.26.206.212@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 08 14:52:45 dist-test-slave-6k22 krb5kdc[8592](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200765, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260808 14:52:45.837855 27451 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260808 14:52:45.866108 27451 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260808 14:52:46.707083 27451 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260808 14:52:46.707219 27451 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/ranger-kms
I20260808 14:52:46.707267 27451 mini_ranger_kms.cc:227] Using postgres at 127.26.206.212:33569
2026-08-08 14:52:47,110 [I] DB FLAVOR :POSTGRES
2026-08-08 14:52:47,110 [I] --------- Verifying Ranger DB connection ---------
2026-08-08 14:52:47,110 [I] Checking connection
2026-08-08 14:52:47,110 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBCPck2/build/asan/bin/postgresql.jar:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.206.212:33569/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-08 14:52:47,370 [I] connection success
2026-08-08 14:52:47,370 [I] --------- Verifying Ranger DB tables ---------
2026-08-08 14:52:47,371 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-08 14:52:47,371 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBCPck2/build/asan/bin/postgresql.jar:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.206.212:33569/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-08 14:52:47,601 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-08 14:52:47,602 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-08 14:52:47,602 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-08 14:52:47,602 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskBCPck2/build/asan/bin/postgresql.jar:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.206.212:33569/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-08 14:52:47,878 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260808 14:52:48.342679 27451 mini_ranger_kms.cc:310] Created kms service
I20260808 14:52:48.519842 27451 mini_ranger_kms.cc:326] Created kudu user
I20260808 14:52:48.565953 27451 mini_ranger_kms.cc:343] Created rangerkms user
Aug 08 14:52:48 dist-test-slave-6k22 krb5kdc[8592](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200765, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.26.206.212@KRBTEST.COM
I20260808 14:52:48.963718 27451 mini_ranger_kms.cc:384] Added ranger policy
I20260808 14:52:48.964035 27451 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/ranger-kms:/tmp/dist-test-taskBCPck2/build/asan/bin/postgresql.jar:/tmp/dist-test-taskBCPck2/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskBCPck2/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260808 14:52:48.964090 27451 mini_ranger_kms.cc:240] Using host: 127.26.206.212
I20260808 14:52:48.986882 27451 mini_ranger_kms.cc:276] Ranger KMS PID: 9033
I20260808 14:52:48.987015 27451 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.26.206.212:44131
Aug 08, 2026 2:52:50 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 08, 2026 2:52:50 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 08, 2026 2:52:50 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 08, 2026 2:52:50 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 08, 2026 2:52:50 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/ranger-kms/ews/webapp].
Aug 08, 2026 2:52:50 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 08 14:52:51 dist-test-slave-6k22 krb5kdc[8592](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786200771, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.26.206.212@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:52:51.439818 27451 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.602s user 0.073s sys 0.366s
I20260808 14:52:51.440101 27451 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260808 14:52:51.440305 27451 mini_ranger_kms.cc:401] 127.26.206.212:44131/kms/v1/keys
Aug 08 14:52:51 dist-test-slave-6k22 krb5kdc[8592](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200771, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.26.206.212@KRBTEST.COM for HTTP/127.26.206.212@KRBTEST.COM
Aug 08 14:52:52 dist-test-slave-6k22 krb5kdc[8592](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200771, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.26.206.212@KRBTEST.COM for HTTP/127.26.206.212@KRBTEST.COM
Aug 08 14:52:54 dist-test-slave-6k22 krb5kdc[8592](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200774, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.26.206.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.206.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.206.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.254.keytab.
Entry for principal kudu/127.26.206.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.254.keytab.
I20260808 14:52:54.367193 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.206.254:44359
--webserver_interface=127.26.206.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.254.keytab
--principal=kudu/127.26.206.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.206.212:43347
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.206.254:44359
--ranger_config_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.26.206.212:44131/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:52:54.709749 9090 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:52:54.710036 9090 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:52:54.710197 9090 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:52:54.717439 9090 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:52:54.717541 9090 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:52:54.717628 9090 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:52:54.717741 9090 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:52:54.717823 9090 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:52:54.727674 9090 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:43347
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/master-0/wal
--ranger_kms_url=127.26.206.212:44131/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.26.206.254:44359
--ranger_config_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.254.keytab
--principal=kudu/127.26.206.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.206.254:44359
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.206.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:52:54.728858 9090 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:52:54.730187 9090 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:52:54.742233 9099 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:52:54.742349 9096 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:52:54.742329 9097 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:52:54.743007 9090 server_base.cc:1034] running on GCE node
I20260808 14:52:54.743844 9090 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:52:54.745254 9090 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:52:54.746482 9090 hybrid_clock.cc:648] HybridClock initialized: now 1786200774746448 us; error 51 us; skew 500 ppm
I20260808 14:52:54.746838 9090 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:52:54 dist-test-slave-6k22 krb5kdc[8592](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200774, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:52:54.754127 9090 init.cc:377] Logged in from keytab as kudu/127.26.206.254@KRBTEST.COM (short username kudu)
I20260808 14:52:54.755703 9090 webserver.cc:460] Webserver started at http://127.26.206.254:36707/ using document root <none> and password file <none>
I20260808 14:52:54.756356 9090 fs_manager.cc:359] Metadata directory not provided
I20260808 14:52:54.756489 9090 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:52:54.756808 9090 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 14:52:54 dist-test-slave-6k22 krb5kdc[8592](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200774, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.254@KRBTEST.COM for HTTP/127.26.206.212@KRBTEST.COM
I20260808 14:52:54.814864 9090 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/master-0/data/instance:
uuid: "c79d96144e224f758e9e270b8a30c873"
format_stamp: "Formatted at 2026-08-08 14:52:54 on dist-test-slave-6k22"
server_key: "5373ee4bce0bf58952746e1b3893292d"
server_key_iv: "77f91efac4159be2530b7b536004a9e6"
server_key_version: "kuduclusterkey@0"
I20260808 14:52:54.815878 9090 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/master-0/wal/instance:
uuid: "c79d96144e224f758e9e270b8a30c873"
format_stamp: "Formatted at 2026-08-08 14:52:54 on dist-test-slave-6k22"
server_key: "5373ee4bce0bf58952746e1b3893292d"
server_key_iv: "77f91efac4159be2530b7b536004a9e6"
server_key_version: "kuduclusterkey@0"
I20260808 14:52:54.821229 9090 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260808 14:52:54.844269 9106 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:52:54.846163 9090 fs_manager.cc:725] Time spent opening block manager: real 0.007s user 0.004s sys 0.003s
I20260808 14:52:54.846361 9090 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/master-0/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/master-0/wal
uuid: "c79d96144e224f758e9e270b8a30c873"
format_stamp: "Formatted at 2026-08-08 14:52:54 on dist-test-slave-6k22"
server_key: "5373ee4bce0bf58952746e1b3893292d"
server_key_iv: "77f91efac4159be2530b7b536004a9e6"
server_key_version: "kuduclusterkey@0"
I20260808 14:52:54.846622 9090 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:52:54.873883 9090 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:52:54.878706 9090 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:52:54.879056 9090 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:52:54.905483 9159 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.254:44359 every 8 connection(s)
I20260808 14:52:54.905504 9090 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.254:44359
I20260808 14:52:54.907302 9090 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
I20260808 14:52:54.911201 9160 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:52:54.916803 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 9090
I20260808 14:52:54.917034 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/master-0/wal/instance
I20260808 14:52:54.917876 27451 external_mini_cluster.cc:1428] Setting key 7959c461e421dfa3785e443112b90307
I20260808 14:52:54.923693 9160 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c79d96144e224f758e9e270b8a30c873: Bootstrap starting.
I20260808 14:52:54.928782 9160 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c79d96144e224f758e9e270b8a30c873: Neither blocks nor log segments found. Creating new log.
I20260808 14:52:54.930557 9160 log.cc:824] T 00000000000000000000000000000000 P c79d96144e224f758e9e270b8a30c873: Log is configured to *not* fsync() on all Append() calls
I20260808 14:52:54.934876 9160 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c79d96144e224f758e9e270b8a30c873: No bootstrap required, opened a new log
Aug 08 14:52:54 dist-test-slave-6k22 krb5kdc[8592](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200774, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.206.254@KRBTEST.COM
I20260808 14:52:54.945962 9160 raft_consensus.cc:348] T 00000000000000000000000000000000 P c79d96144e224f758e9e270b8a30c873 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c79d96144e224f758e9e270b8a30c873" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 44359 } }
I20260808 14:52:54.946408 9160 raft_consensus.cc:374] T 00000000000000000000000000000000 P c79d96144e224f758e9e270b8a30c873 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:52:54.946563 9160 raft_consensus.cc:729] T 00000000000000000000000000000000 P c79d96144e224f758e9e270b8a30c873 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c79d96144e224f758e9e270b8a30c873, State: Initialized, Role: FOLLOWER
I20260808 14:52:54.947305 9160 consensus_queue.cc:260] T 00000000000000000000000000000000 P c79d96144e224f758e9e270b8a30c873 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c79d96144e224f758e9e270b8a30c873" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 44359 } }
I20260808 14:52:54.947604 9160 raft_consensus.cc:388] T 00000000000000000000000000000000 P c79d96144e224f758e9e270b8a30c873 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:52:54.947765 9160 raft_consensus.cc:482] T 00000000000000000000000000000000 P c79d96144e224f758e9e270b8a30c873 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:52:54.947969 9160 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c79d96144e224f758e9e270b8a30c873 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:52:54.951260 9160 raft_consensus.cc:504] T 00000000000000000000000000000000 P c79d96144e224f758e9e270b8a30c873 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c79d96144e224f758e9e270b8a30c873" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 44359 } }
I20260808 14:52:54.951860 9160 leader_election.cc:302] T 00000000000000000000000000000000 P c79d96144e224f758e9e270b8a30c873 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c79d96144e224f758e9e270b8a30c873; no voters:
I20260808 14:52:54.953517 9163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:52:54.920158 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48268 (local address 127.26.206.254:44359)
0808 14:52:54.932158 (+ 12000us) server_negotiation.cc:206] Beginning negotiation
0808 14:52:54.932190 (+ 32us) server_negotiation.cc:399] Waiting for connection header
0808 14:52:54.932839 (+ 649us) server_negotiation.cc:407] Connection header received
0808 14:52:54.934882 (+ 2043us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:52:54.934904 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:52:54.935346 (+ 442us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:52:54.935900 (+ 554us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:52:54.937629 (+ 1729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:52:54.939341 (+ 1712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:52:54.940752 (+ 1411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:52:54.941428 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:52:54.941635 (+ 207us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:52:54.945644 (+ 4009us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:52:54.945652 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:52:54.945665 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:52:54.945704 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:52:54.949145 (+ 3441us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:52:54.949878 (+ 733us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:52:54.949887 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:52:54.949897 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:52:54.950048 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:52:54.950444 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:52:54.950449 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:52:54.950453 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:52:54.950979 (+ 526us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:52:54.951302 (+ 323us) server_negotiation.cc:1035] Waiting for connection context
0808 14:52:54.951971 (+ 669us) server_negotiation.cc:299] Negotiation successful
0808 14:52:54.952463 (+ 492us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11719,"thread_start_us":11492,"threads_started":1}
I20260808 14:52:54.955137 9160 leader_election.cc:288] T 00000000000000000000000000000000 P c79d96144e224f758e9e270b8a30c873 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:52:54.955245 9165 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c79d96144e224f758e9e270b8a30c873 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:52:54.958658 9160 sys_catalog.cc:564] T 00000000000000000000000000000000 P c79d96144e224f758e9e270b8a30c873 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:52:54.959874 9165 raft_consensus.cc:686] T 00000000000000000000000000000000 P c79d96144e224f758e9e270b8a30c873 [term 1 LEADER]: Becoming Leader. State: Replica: c79d96144e224f758e9e270b8a30c873, State: Running, Role: LEADER
I20260808 14:52:54.960475 9165 consensus_queue.cc:237] T 00000000000000000000000000000000 P c79d96144e224f758e9e270b8a30c873 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c79d96144e224f758e9e270b8a30c873" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 44359 } }
I20260808 14:52:54.967212 9166 sys_catalog.cc:455] T 00000000000000000000000000000000 P c79d96144e224f758e9e270b8a30c873 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c79d96144e224f758e9e270b8a30c873" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c79d96144e224f758e9e270b8a30c873" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 44359 } } }
I20260808 14:52:54.967597 9166 sys_catalog.cc:458] T 00000000000000000000000000000000 P c79d96144e224f758e9e270b8a30c873 [sys.catalog]: This master's current role is: LEADER
I20260808 14:52:54.968796 9167 sys_catalog.cc:455] T 00000000000000000000000000000000 P c79d96144e224f758e9e270b8a30c873 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c79d96144e224f758e9e270b8a30c873. Latest consensus state: current_term: 1 leader_uuid: "c79d96144e224f758e9e270b8a30c873" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c79d96144e224f758e9e270b8a30c873" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 44359 } } }
I20260808 14:52:54.969161 9167 sys_catalog.cc:458] T 00000000000000000000000000000000 P c79d96144e224f758e9e270b8a30c873 [sys.catalog]: This master's current role is: LEADER
I20260808 14:52:54.977844 9171 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:52:54.985291 9171 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:52:54.986104 9160 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260808 14:52:55.005417 9171 catalog_manager.cc:1347] Generated new cluster ID: be6e556910184c1c8f6eaa6388bb350b
I20260808 14:52:55.005525 9171 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:52:55.026980 9171 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:52:55.029393 9171 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:52:55.039034 9171 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c79d96144e224f758e9e270b8a30c873: Generated new TSK 0
I20260808 14:52:55.040163 9171 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.206.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.206.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.206.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.193.keytab.
Entry for principal kudu/127.26.206.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.193.keytab.
I20260808 14:52:55.871116 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.26.206.212:44131/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.206.193:0
--local_ip_for_outbound_sockets=127.26.206.193
--webserver_interface=127.26.206.193
--webserver_port=0
--tserver_master_addrs=127.26.206.254:44359
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.193.keytab
--principal=kudu/127.26.206.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.206.212:43347
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 14:52:56 dist-test-slave-6k22 krb5kdc[8592](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786200776, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260808 14:52:56.277412 9211 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:52:56.277733 9211 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:52:56.277922 9211 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:52:56.285514 9211 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:52:56.285660 9211 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:52:56.285854 9211 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.206.193
I20260808 14:52:56.298082 9211 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:43347
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.26.206.212:44131/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.193.keytab
--principal=kudu/127.26.206.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.206.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.206.193
--webserver_port=0
--tserver_master_addrs=127.26.206.254:44359
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.206.193
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:52:56.299409 9211 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:52:56.300846 9211 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:52:56.316298 9221 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:52:56.317781 9222 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:52:56.324366 9211 server_base.cc:1034] running on GCE node
W20260808 14:52:56.325140 9226 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:52:56.325968 9211 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:52:56.327281 9211 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:52:56.335251 9211 hybrid_clock.cc:648] HybridClock initialized: now 1786200776335135 us; error 99 us; skew 500 ppm
I20260808 14:52:56.335680 9211 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:52:56 dist-test-slave-6k22 krb5kdc[8592](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200776, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:52:56.339969 9211 init.cc:377] Logged in from keytab as kudu/127.26.206.193@KRBTEST.COM (short username kudu)
I20260808 14:52:56.342036 9211 webserver.cc:460] Webserver started at http://127.26.206.193:42243/ using document root <none> and password file <none>
I20260808 14:52:56.343010 9211 fs_manager.cc:359] Metadata directory not provided
I20260808 14:52:56.343182 9211 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:52:56.343703 9211 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 14:52:56 dist-test-slave-6k22 krb5kdc[8592](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200776, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.193@KRBTEST.COM for HTTP/127.26.206.212@KRBTEST.COM
I20260808 14:52:56.366185 9211 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/ts-0/data/instance:
uuid: "27e0e7a8064a4929bad16f22b1b6e512"
format_stamp: "Formatted at 2026-08-08 14:52:56 on dist-test-slave-6k22"
server_key: "b45700ff2e4730da104d8eb2c83fc964"
server_key_iv: "00b033f1171b861b23562e6370737e3a"
server_key_version: "kuduclusterkey@0"
I20260808 14:52:56.367472 9211 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/ts-0/wal/instance:
uuid: "27e0e7a8064a4929bad16f22b1b6e512"
format_stamp: "Formatted at 2026-08-08 14:52:56 on dist-test-slave-6k22"
server_key: "b45700ff2e4730da104d8eb2c83fc964"
server_key_iv: "00b033f1171b861b23562e6370737e3a"
server_key_version: "kuduclusterkey@0"
I20260808 14:52:56.382347 9211 fs_manager.cc:691] Time spent creating directory manager: real 0.014s user 0.004s sys 0.003s
I20260808 14:52:56.413192 9233 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:52:56.415409 9211 fs_manager.cc:725] Time spent opening block manager: real 0.010s user 0.005s sys 0.004s
I20260808 14:52:56.415709 9211 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/ts-0/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/ts-0/wal
uuid: "27e0e7a8064a4929bad16f22b1b6e512"
format_stamp: "Formatted at 2026-08-08 14:52:56 on dist-test-slave-6k22"
server_key: "b45700ff2e4730da104d8eb2c83fc964"
server_key_iv: "00b033f1171b861b23562e6370737e3a"
server_key_version: "kuduclusterkey@0"
I20260808 14:52:56.416109 9211 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:52:56.445624 9211 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:52:56.463008 9211 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:52:56.463349 9211 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:52:56.464632 9211 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:52:56.466172 9211 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:52:56.466302 9211 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:52:56.466437 9211 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:52:56.466516 9211 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:52:56.523360 9211 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.193:40103
I20260808 14:52:56.523403 9356 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.193:40103 every 8 connection(s)
I20260808 14:52:56.525218 9211 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/ts-0/data/info.pb
I20260808 14:52:56.529338 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 9211
I20260808 14:52:56.529587 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/ts-0/wal/instance
I20260808 14:52:56.530611 27451 external_mini_cluster.cc:1428] Setting key 9e7d2ad5046d1af03a67a498e215e34e
Aug 08 14:52:56 dist-test-slave-6k22 krb5kdc[8592](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200776, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.193@KRBTEST.COM for kudu/127.26.206.254@KRBTEST.COM
I20260808 14:52:56.565407 9359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:52:56.528802 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:44359 (local address 127.26.206.193:50715)
0808 14:52:56.531182 (+ 2380us) negotiation.cc:107] Waiting for socket to connect
0808 14:52:56.531235 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0808 14:52:56.535909 (+ 4674us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:52:56.541570 (+ 5661us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:52:56.541583 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:52:56.542252 (+ 669us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:52:56.543091 (+ 839us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:52:56.543119 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:52:56.544705 (+ 1586us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:52:56.544711 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:52:56.546775 (+ 2064us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:52:56.546790 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:52:56.548093 (+ 1303us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:52:56.548101 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:52:56.548403 (+ 302us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:52:56.549271 (+ 868us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:52:56.549301 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:52:56.553264 (+ 3963us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:52:56.559356 (+ 6092us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:52:56.559365 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:52:56.559383 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:52:56.560076 (+ 693us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:52:56.560698 (+ 622us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:52:56.560703 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:52:56.560706 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:52:56.560967 (+ 261us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:52:56.562601 (+ 1634us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:52:56.562610 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:52:56.563044 (+ 434us) client_negotiation.cc:769] Sending connection context
0808 14:52:56.563367 (+ 323us) client_negotiation.cc:240] Negotiation successful
0808 14:52:56.563939 (+ 572us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2085,"thread_start_us":1841,"threads_started":1}
I20260808 14:52:56.566547 9360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:52:56.529483 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.193:50715 (local address 127.26.206.254:44359)
0808 14:52:56.540728 (+ 11245us) server_negotiation.cc:206] Beginning negotiation
0808 14:52:56.540735 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:52:56.540756 (+ 21us) server_negotiation.cc:407] Connection header received
0808 14:52:56.540819 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:52:56.540824 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:52:56.540899 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:52:56.541029 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:52:56.543328 (+ 2299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:52:56.544504 (+ 1176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:52:56.546966 (+ 2462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:52:56.547637 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:52:56.547783 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:52:56.553833 (+ 6050us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:52:56.553839 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:52:56.553844 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:52:56.553882 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:52:56.559165 (+ 5283us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:52:56.560265 (+ 1100us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:52:56.560270 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:52:56.560273 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:52:56.560420 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:52:56.561111 (+ 691us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:52:56.561116 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:52:56.561120 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:52:56.561503 (+ 383us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:52:56.561632 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0808 14:52:56.565932 (+ 4300us) server_negotiation.cc:299] Negotiation successful
0808 14:52:56.566160 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11099,"thread_start_us":11654,"threads_started":1}
I20260808 14:52:56.570991 9357 heartbeater.cc:347] Connected to a master server at 127.26.206.254:44359
I20260808 14:52:56.571318 9357 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.26.206.194@KRBTEST.COM; defaulting to no policy
I20260808 14:52:56.572206 9357 heartbeater.cc:511] Master 127.26.206.254:44359 requested a full tablet report, sending...
I20260808 14:52:56.574987 9123 ts_manager.cc:194] Registered new tserver with Master: 27e0e7a8064a4929bad16f22b1b6e512 (127.26.206.193:40103)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.206.194@KRBTEST.COM" created.
I20260808 14:52:56.577044 9123 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.206.193@KRBTEST.COM'} at 127.26.206.193:50715
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.206.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.194.keytab.
Entry for principal kudu/127.26.206.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.194.keytab.
I20260808 14:52:56.615746 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.26.206.212:44131/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.206.194:0
--local_ip_for_outbound_sockets=127.26.206.194
--webserver_interface=127.26.206.194
--webserver_port=0
--tserver_master_addrs=127.26.206.254:44359
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.194.keytab
--principal=kudu/127.26.206.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.206.212:43347
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 14:52:56 dist-test-slave-6k22 krb5kdc[8592](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200776, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.254@KRBTEST.COM for HTTP/127.26.206.212@KRBTEST.COM
Aug 08 14:52:56 dist-test-slave-6k22 krb5kdc[8592](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200776, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.254@KRBTEST.COM for HTTP/127.26.206.212@KRBTEST.COM
W20260808 14:52:57.135823 9364 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:52:57.136298 9364 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:52:57.136514 9364 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:52:57.148066 9364 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:52:57.148265 9364 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:52:57.148470 9364 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.206.194
I20260808 14:52:57.158778 9364 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:43347
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.26.206.212:44131/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.194.keytab
--principal=kudu/127.26.206.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.206.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.206.194
--webserver_port=0
--tserver_master_addrs=127.26.206.254:44359
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.206.194
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:52:57.160238 9364 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:52:57.161604 9364 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:52:57.180176 9371 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:52:57.180197 9372 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:52:57.185400 9364 server_base.cc:1034] running on GCE node
W20260808 14:52:57.185825 9375 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:52:57.186749 9364 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:52:57.188434 9364 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:52:57.189721 9364 hybrid_clock.cc:648] HybridClock initialized: now 1786200777189649 us; error 59 us; skew 500 ppm
I20260808 14:52:57.190156 9364 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:52:57 dist-test-slave-6k22 krb5kdc[8592](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200777, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:52:57.194414 9364 init.cc:377] Logged in from keytab as kudu/127.26.206.194@KRBTEST.COM (short username kudu)
I20260808 14:52:57.204898 9364 webserver.cc:460] Webserver started at http://127.26.206.194:40563/ using document root <none> and password file <none>
I20260808 14:52:57.205948 9364 fs_manager.cc:359] Metadata directory not provided
I20260808 14:52:57.206151 9364 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:52:57.206598 9364 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 14:52:57 dist-test-slave-6k22 krb5kdc[8592](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200777, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.194@KRBTEST.COM for HTTP/127.26.206.212@KRBTEST.COM
I20260808 14:52:57.226959 9364 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/ts-1/data/instance:
uuid: "bad26448d0d94c61a6ec360f788ba945"
format_stamp: "Formatted at 2026-08-08 14:52:57 on dist-test-slave-6k22"
server_key: "6f38b342e3bda65d2041c987d9b2d33f"
server_key_iv: "6f8f99adc7846294967928a1dddfc9dc"
server_key_version: "kuduclusterkey@0"
I20260808 14:52:57.228092 9364 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/ts-1/wal/instance:
uuid: "bad26448d0d94c61a6ec360f788ba945"
format_stamp: "Formatted at 2026-08-08 14:52:57 on dist-test-slave-6k22"
server_key: "6f38b342e3bda65d2041c987d9b2d33f"
server_key_iv: "6f8f99adc7846294967928a1dddfc9dc"
server_key_version: "kuduclusterkey@0"
I20260808 14:52:57.235329 9364 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.005s sys 0.001s
I20260808 14:52:57.251099 9392 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:52:57.252784 9364 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260808 14:52:57.252987 9364 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/ts-1/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/ts-1/wal
uuid: "bad26448d0d94c61a6ec360f788ba945"
format_stamp: "Formatted at 2026-08-08 14:52:57 on dist-test-slave-6k22"
server_key: "6f38b342e3bda65d2041c987d9b2d33f"
server_key_iv: "6f8f99adc7846294967928a1dddfc9dc"
server_key_version: "kuduclusterkey@0"
I20260808 14:52:57.253212 9364 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:52:57.269889 9364 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:52:57.273851 9364 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:52:57.274151 9364 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:52:57.275193 9364 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:52:57.276767 9364 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:52:57.276839 9364 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:52:57.276975 9364 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:52:57.277024 9364 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:52:57.317618 9364 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.194:38953
I20260808 14:52:57.317637 9523 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.194:38953 every 8 connection(s)
I20260808 14:52:57.319084 9364 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/ts-1/data/info.pb
I20260808 14:52:57.319516 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 9364
I20260808 14:52:57.319727 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/ts-1/wal/instance
I20260808 14:52:57.320295 27451 external_mini_cluster.cc:1428] Setting key 45129968c9978c770a6be3adf398f915
Aug 08 14:52:57 dist-test-slave-6k22 krb5kdc[8592](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200777, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.194@KRBTEST.COM for kudu/127.26.206.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.26.206.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.206.195@KRBTEST.COM" created.
I20260808 14:52:57.360194 9528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:52:57.323913 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.194:33213 (local address 127.26.206.254:44359)
0808 14:52:57.336093 (+ 12180us) server_negotiation.cc:206] Beginning negotiation
0808 14:52:57.336104 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 14:52:57.338328 (+ 2224us) server_negotiation.cc:407] Connection header received
0808 14:52:57.340098 (+ 1770us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:52:57.340104 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:52:57.340201 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:52:57.340331 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:52:57.342550 (+ 2219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:52:57.343714 (+ 1164us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:52:57.346495 (+ 2781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:52:57.347222 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:52:57.347399 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:52:57.352528 (+ 5129us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:52:57.352537 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:52:57.352543 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:52:57.352591 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:52:57.356343 (+ 3752us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:52:57.357299 (+ 956us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:52:57.357304 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:52:57.357307 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:52:57.357456 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:52:57.358029 (+ 573us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:52:57.358032 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:52:57.358035 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:52:57.358421 (+ 386us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:52:57.358590 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0808 14:52:57.359474 (+ 884us) server_negotiation.cc:299] Negotiation successful
0808 14:52:57.359825 (+ 351us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12001,"thread_start_us":11882,"threads_started":1}
I20260808 14:52:57.361276 9527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:52:57.323161 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:44359 (local address 127.26.206.194:33213)
0808 14:52:57.336738 (+ 13577us) negotiation.cc:107] Waiting for socket to connect
0808 14:52:57.336790 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0808 14:52:57.339740 (+ 2950us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:52:57.340661 (+ 921us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:52:57.340673 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:52:57.341374 (+ 701us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:52:57.342313 (+ 939us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:52:57.342342 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:52:57.343914 (+ 1572us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:52:57.343922 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:52:57.346292 (+ 2370us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:52:57.346322 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:52:57.347524 (+ 1202us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:52:57.347534 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:52:57.347951 (+ 417us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:52:57.348884 (+ 933us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:52:57.348924 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:52:57.352206 (+ 3282us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:52:57.356540 (+ 4334us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:52:57.356555 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:52:57.356570 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:52:57.357059 (+ 489us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:52:57.357609 (+ 550us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:52:57.357614 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:52:57.357617 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:52:57.357884 (+ 267us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:52:57.358679 (+ 795us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:52:57.358690 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:52:57.359072 (+ 382us) client_negotiation.cc:769] Sending connection context
0808 14:52:57.359386 (+ 314us) client_negotiation.cc:240] Negotiation successful
0808 14:52:57.359960 (+ 574us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13261,"thread_start_us":13016,"threads_started":1}
I20260808 14:52:57.362915 9525 heartbeater.cc:347] Connected to a master server at 127.26.206.254:44359
I20260808 14:52:57.363248 9525 heartbeater.cc:464] Registering TS with master...
I20260808 14:52:57.364061 9525 heartbeater.cc:511] Master 127.26.206.254:44359 requested a full tablet report, sending...
I20260808 14:52:57.365536 9123 ts_manager.cc:194] Registered new tserver with Master: bad26448d0d94c61a6ec360f788ba945 (127.26.206.194:38953)
I20260808 14:52:57.366580 9123 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.206.194@KRBTEST.COM'} at 127.26.206.194:33213
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.206.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.195.keytab.
Entry for principal kudu/127.26.206.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.195.keytab.
I20260808 14:52:57.399219 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.26.206.212:44131/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.206.195:0
--local_ip_for_outbound_sockets=127.26.206.195
--webserver_interface=127.26.206.195
--webserver_port=0
--tserver_master_addrs=127.26.206.254:44359
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.195.keytab
--principal=kudu/127.26.206.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.206.212:43347
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 14:52:57.587764 9357 heartbeater.cc:503] Master 127.26.206.254:44359 was elected leader, sending a full tablet report...
W20260808 14:52:57.748508 9532 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:52:57.748813 9532 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:52:57.748978 9532 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:52:57.756458 9532 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:52:57.756608 9532 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:52:57.756737 9532 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.206.195
I20260808 14:52:57.766687 9532 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:43347
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.26.206.212:44131/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.195.keytab
--principal=kudu/127.26.206.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.206.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.206.195
--webserver_port=0
--tserver_master_addrs=127.26.206.254:44359
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.206.195
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:52:57.767911 9532 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:52:57.769186 9532 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:52:57.782125 9537 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:52:57.782228 9538 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:52:57.782251 9540 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:52:57.783345 9532 server_base.cc:1034] running on GCE node
I20260808 14:52:57.783972 9532 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:52:57.784967 9532 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:52:57.786192 9532 hybrid_clock.cc:648] HybridClock initialized: now 1786200777786150 us; error 56 us; skew 500 ppm
I20260808 14:52:57.786506 9532 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:52:57 dist-test-slave-6k22 krb5kdc[8592](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200777, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:52:57.789824 9532 init.cc:377] Logged in from keytab as kudu/127.26.206.195@KRBTEST.COM (short username kudu)
I20260808 14:52:57.791249 9532 webserver.cc:460] Webserver started at http://127.26.206.195:37551/ using document root <none> and password file <none>
I20260808 14:52:57.791968 9532 fs_manager.cc:359] Metadata directory not provided
I20260808 14:52:57.792114 9532 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:52:57.792419 9532 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 14:52:57 dist-test-slave-6k22 krb5kdc[8592](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200777, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.195@KRBTEST.COM for HTTP/127.26.206.212@KRBTEST.COM
I20260808 14:52:57.807818 9532 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/ts-2/data/instance:
uuid: "4c8609562f79496385b4a84dfa9beb0a"
format_stamp: "Formatted at 2026-08-08 14:52:57 on dist-test-slave-6k22"
server_key: "b234118cc9eaf69455aacacfa3ef0076"
server_key_iv: "bbeb30e011610ce8d0bc257cadf04c88"
server_key_version: "kuduclusterkey@0"
I20260808 14:52:57.808874 9532 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/ts-2/wal/instance:
uuid: "4c8609562f79496385b4a84dfa9beb0a"
format_stamp: "Formatted at 2026-08-08 14:52:57 on dist-test-slave-6k22"
server_key: "b234118cc9eaf69455aacacfa3ef0076"
server_key_iv: "bbeb30e011610ce8d0bc257cadf04c88"
server_key_version: "kuduclusterkey@0"
I20260808 14:52:57.814435 9532 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260808 14:52:57.830008 9548 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:52:57.831465 9532 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.001s
I20260808 14:52:57.831660 9532 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/ts-2/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/ts-2/wal
uuid: "4c8609562f79496385b4a84dfa9beb0a"
format_stamp: "Formatted at 2026-08-08 14:52:57 on dist-test-slave-6k22"
server_key: "b234118cc9eaf69455aacacfa3ef0076"
server_key_iv: "bbeb30e011610ce8d0bc257cadf04c88"
server_key_version: "kuduclusterkey@0"
I20260808 14:52:57.831853 9532 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:52:57.862303 9532 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:52:57.866339 9532 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:52:57.866640 9532 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:52:57.867657 9532 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:52:57.868999 9532 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:52:57.869076 9532 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:52:57.869252 9532 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:52:57.869313 9532 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:52:57.903761 9532 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.195:34917
I20260808 14:52:57.903795 9674 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.195:34917 every 8 connection(s)
I20260808 14:52:57.905102 9532 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/ts-2/data/info.pb
I20260808 14:52:57.912465 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 9532
I20260808 14:52:57.912676 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/ts-2/wal/instance
I20260808 14:52:57.913194 27451 external_mini_cluster.cc:1428] Setting key 981e3ba6e3c0dcbe7f80e0e589c52a5c
Aug 08 14:52:57 dist-test-slave-6k22 krb5kdc[8592](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200777, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.195@KRBTEST.COM for kudu/127.26.206.254@KRBTEST.COM
I20260808 14:52:57.925856 9678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:52:57.907847 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.195:56849 (local address 127.26.206.254:44359)
0808 14:52:57.908409 (+ 562us) server_negotiation.cc:206] Beginning negotiation
0808 14:52:57.908416 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:52:57.909492 (+ 1076us) server_negotiation.cc:407] Connection header received
0808 14:52:57.912054 (+ 2562us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:52:57.912061 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:52:57.912188 (+ 127us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:52:57.912319 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:52:57.913949 (+ 1630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:52:57.915004 (+ 1055us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:52:57.916961 (+ 1957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:52:57.917354 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:52:57.917446 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:52:57.920607 (+ 3161us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:52:57.920611 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:52:57.920614 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:52:57.920642 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:52:57.923355 (+ 2713us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:52:57.924085 (+ 730us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:52:57.924089 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:52:57.924092 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:52:57.924209 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:52:57.924572 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:52:57.924575 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:52:57.924577 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:52:57.924817 (+ 240us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:52:57.924932 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0808 14:52:57.925478 (+ 546us) server_negotiation.cc:299] Negotiation successful
0808 14:52:57.925631 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":421,"thread_start_us":258,"threads_started":1}
I20260808 14:52:57.926725 9679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:52:57.908529 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:44359 (local address 127.26.206.195:56849)
0808 14:52:57.909314 (+ 785us) negotiation.cc:107] Waiting for socket to connect
0808 14:52:57.909376 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0808 14:52:57.911746 (+ 2370us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:52:57.912540 (+ 794us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:52:57.912550 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:52:57.913079 (+ 529us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:52:57.913776 (+ 697us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:52:57.913798 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:52:57.915175 (+ 1377us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:52:57.915179 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:52:57.916832 (+ 1653us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:52:57.916854 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:52:57.917531 (+ 677us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:52:57.917536 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:52:57.917712 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:52:57.918354 (+ 642us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:52:57.918375 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:52:57.920404 (+ 2029us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:52:57.923470 (+ 3066us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:52:57.923476 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:52:57.923486 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:52:57.923985 (+ 499us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:52:57.924300 (+ 315us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:52:57.924303 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:52:57.924305 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:52:57.924481 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:52:57.924923 (+ 442us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:52:57.924927 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:52:57.925180 (+ 253us) client_negotiation.cc:769] Sending connection context
0808 14:52:57.925385 (+ 205us) client_negotiation.cc:240] Negotiation successful
0808 14:52:57.925715 (+ 330us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":508,"thread_start_us":313,"threads_started":1}
I20260808 14:52:57.928246 9675 heartbeater.cc:347] Connected to a master server at 127.26.206.254:44359
I20260808 14:52:57.928539 9675 heartbeater.cc:464] Registering TS with master...
I20260808 14:52:57.929203 9675 heartbeater.cc:511] Master 127.26.206.254:44359 requested a full tablet report, sending...
I20260808 14:52:57.930572 9123 ts_manager.cc:194] Registered new tserver with Master: 4c8609562f79496385b4a84dfa9beb0a (127.26.206.195:34917)
I20260808 14:52:57.931356 9123 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.206.195@KRBTEST.COM'} at 127.26.206.195:56849
I20260808 14:52:57.940752 27451 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 14:52:57.942517 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 9211
Aug 08 14:52:57 dist-test-slave-6k22 krb5kdc[8592](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200774, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.206.193@KRBTEST.COM
I20260808 14:52:57.958417 9682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:52:57.943356 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36634 (local address 127.26.206.193:40103)
0808 14:52:57.944007 (+ 651us) server_negotiation.cc:206] Beginning negotiation
0808 14:52:57.944012 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:52:57.944036 (+ 24us) server_negotiation.cc:407] Connection header received
0808 14:52:57.944097 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:52:57.944103 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:52:57.944267 (+ 164us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:52:57.944393 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:52:57.945806 (+ 1413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:52:57.946737 (+ 931us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:52:57.948377 (+ 1640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:52:57.948892 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:52:57.948987 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:52:57.953103 (+ 4116us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:52:57.953114 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:52:57.953124 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:52:57.953153 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:52:57.955963 (+ 2810us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:52:57.956547 (+ 584us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:52:57.956552 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:52:57.956555 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:52:57.956723 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:52:57.957120 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:52:57.957124 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:52:57.957126 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:52:57.957430 (+ 304us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:52:57.957651 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0808 14:52:57.957939 (+ 288us) server_negotiation.cc:299] Negotiation successful
0808 14:52:57.958129 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":508,"thread_start_us":371,"threads_started":1}
I20260808 14:52:57.959656 9352 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:52:58.042192 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 9211
I20260808 14:52:58.061939 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 9364
Aug 08 14:52:58 dist-test-slave-6k22 krb5kdc[8592](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200774, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.206.194@KRBTEST.COM
I20260808 14:52:58.079002 9684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:52:58.062817 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46544 (local address 127.26.206.194:38953)
0808 14:52:58.063389 (+ 572us) server_negotiation.cc:206] Beginning negotiation
0808 14:52:58.063398 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:52:58.063423 (+ 25us) server_negotiation.cc:407] Connection header received
0808 14:52:58.063486 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:52:58.063492 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:52:58.063788 (+ 296us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:52:58.063960 (+ 172us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:52:58.065280 (+ 1320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:52:58.066242 (+ 962us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:52:58.067798 (+ 1556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:52:58.068362 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:52:58.068504 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:52:58.073083 (+ 4579us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:52:58.073094 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:52:58.073106 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:52:58.073144 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:52:58.075999 (+ 2855us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:52:58.076746 (+ 747us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:52:58.076754 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:52:58.076756 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:52:58.076896 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:52:58.077344 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:52:58.077350 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:52:58.077355 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:52:58.077677 (+ 322us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:52:58.078016 (+ 339us) server_negotiation.cc:1035] Waiting for connection context
0808 14:52:58.078340 (+ 324us) server_negotiation.cc:299] Negotiation successful
0808 14:52:58.078636 (+ 296us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":399,"thread_start_us":272,"threads_started":1}
I20260808 14:52:58.080332 9518 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:52:58.161571 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 9364
I20260808 14:52:58.182822 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 9532
Aug 08 14:52:58 dist-test-slave-6k22 krb5kdc[8592](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200774, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.206.195@KRBTEST.COM
I20260808 14:52:58.199386 9686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:52:58.183967 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48770 (local address 127.26.206.195:34917)
0808 14:52:58.184581 (+ 614us) server_negotiation.cc:206] Beginning negotiation
0808 14:52:58.184588 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:52:58.184616 (+ 28us) server_negotiation.cc:407] Connection header received
0808 14:52:58.184674 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:52:58.184680 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:52:58.184895 (+ 215us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:52:58.185065 (+ 170us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:52:58.186366 (+ 1301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:52:58.187343 (+ 977us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:52:58.188823 (+ 1480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:52:58.189373 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:52:58.189514 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:52:58.193835 (+ 4321us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:52:58.193845 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:52:58.193858 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:52:58.193892 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:52:58.196591 (+ 2699us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:52:58.197268 (+ 677us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:52:58.197274 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:52:58.197277 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:52:58.197398 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:52:58.197783 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:52:58.197787 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:52:58.197788 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:52:58.198121 (+ 333us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:52:58.198468 (+ 347us) server_negotiation.cc:1035] Waiting for connection context
0808 14:52:58.198791 (+ 323us) server_negotiation.cc:299] Negotiation successful
0808 14:52:58.199055 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":473,"thread_start_us":306,"threads_started":1}
I20260808 14:52:58.200624 9670 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:52:58.283700 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 9532
I20260808 14:52:58.302486 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 9090
I20260808 14:52:58.303854 9154 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:52:58.410683 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 9090
I20260808 14:52:58.439967 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.206.254:44359
--webserver_interface=127.26.206.254
--webserver_port=36707
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.254.keytab
--principal=kudu/127.26.206.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.206.212:43347
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.206.254:44359
--ranger_config_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.26.206.212:44131/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.26.206.212:44131/kms with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:52:58.771265 9689 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:52:58.771631 9689 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:52:58.771811 9689 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:52:58.779222 9689 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:52:58.779377 9689 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:52:58.779500 9689 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:52:58.779635 9689 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:52:58.779747 9689 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:52:58.789563 9689 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:43347
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.26.206.212:44131/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.26.206.254:44359
--ranger_config_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.254.keytab
--principal=kudu/127.26.206.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.206.254:44359
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.206.254
--webserver_port=36707
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:52:58.790798 9689 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:52:58.792246 9689 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:52:58.804733 9698 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:52:58.804879 9695 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:52:58.804852 9696 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:52:58.805804 9689 server_base.cc:1034] running on GCE node
I20260808 14:52:58.806630 9689 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:52:58.808061 9689 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:52:58.809320 9689 hybrid_clock.cc:648] HybridClock initialized: now 1786200778809293 us; error 36 us; skew 500 ppm
I20260808 14:52:58.809751 9689 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:52:58 dist-test-slave-6k22 krb5kdc[8592](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200778, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:52:58.813023 9689 init.cc:377] Logged in from keytab as kudu/127.26.206.254@KRBTEST.COM (short username kudu)
I20260808 14:52:58.814457 9689 webserver.cc:460] Webserver started at http://127.26.206.254:36707/ using document root <none> and password file <none>
I20260808 14:52:58.815112 9689 fs_manager.cc:359] Metadata directory not provided
I20260808 14:52:58.815220 9689 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 08 14:52:58 dist-test-slave-6k22 krb5kdc[8592](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200778, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.254@KRBTEST.COM for HTTP/127.26.206.212@KRBTEST.COM
I20260808 14:52:58.870285 9689 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.004s sys 0.000s
I20260808 14:52:58.873701 9707 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:52:58.875177 9689 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 14:52:58.875415 9689 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/master-0/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/master-0/wal
uuid: "c79d96144e224f758e9e270b8a30c873"
format_stamp: "Formatted at 2026-08-08 14:52:54 on dist-test-slave-6k22"
server_key: "5373ee4bce0bf58952746e1b3893292d"
server_key_iv: "77f91efac4159be2530b7b536004a9e6"
server_key_version: "kuduclusterkey@0"
I20260808 14:52:58.876483 9689 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:52:58.896417 9689 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:52:58.901505 9689 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:52:58.901835 9689 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:52:58.921802 9689 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.254:44359
I20260808 14:52:58.921834 9766 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.254:44359 every 8 connection(s)
I20260808 14:52:58.923390 9689 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
I20260808 14:52:58.926653 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 9689
I20260808 14:52:58.927731 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.26.206.212:44131/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.206.193:40103
--local_ip_for_outbound_sockets=127.26.206.193
--tserver_master_addrs=127.26.206.254:44359
--webserver_port=42243
--webserver_interface=127.26.206.193
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.193.keytab
--principal=kudu/127.26.206.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.206.212:43347
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.26.206.212:44131/kms with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 14:52:58.931593 9767 sys_catalog.cc:263] Verifying existing consensus state
I20260808 14:52:58.936631 9767 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c79d96144e224f758e9e270b8a30c873: Bootstrap starting.
I20260808 14:52:58.956090 9767 log.cc:824] T 00000000000000000000000000000000 P c79d96144e224f758e9e270b8a30c873: Log is configured to *not* fsync() on all Append() calls
I20260808 14:52:58.964847 9767 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c79d96144e224f758e9e270b8a30c873: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 14:52:58.965420 9767 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c79d96144e224f758e9e270b8a30c873: Bootstrap complete.
I20260808 14:52:58.974253 9767 raft_consensus.cc:348] T 00000000000000000000000000000000 P c79d96144e224f758e9e270b8a30c873 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c79d96144e224f758e9e270b8a30c873" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 44359 } }
I20260808 14:52:58.975121 9767 raft_consensus.cc:729] T 00000000000000000000000000000000 P c79d96144e224f758e9e270b8a30c873 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c79d96144e224f758e9e270b8a30c873, State: Initialized, Role: FOLLOWER
I20260808 14:52:58.975842 9767 consensus_queue.cc:260] T 00000000000000000000000000000000 P c79d96144e224f758e9e270b8a30c873 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c79d96144e224f758e9e270b8a30c873" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 44359 } }
I20260808 14:52:58.976068 9767 raft_consensus.cc:388] T 00000000000000000000000000000000 P c79d96144e224f758e9e270b8a30c873 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:52:58.976183 9767 raft_consensus.cc:482] T 00000000000000000000000000000000 P c79d96144e224f758e9e270b8a30c873 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:52:58.976378 9767 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c79d96144e224f758e9e270b8a30c873 [term 1 FOLLOWER]: Advancing to term 2
I20260808 14:52:58.980512 9767 raft_consensus.cc:504] T 00000000000000000000000000000000 P c79d96144e224f758e9e270b8a30c873 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c79d96144e224f758e9e270b8a30c873" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 44359 } }
I20260808 14:52:58.981072 9767 leader_election.cc:302] T 00000000000000000000000000000000 P c79d96144e224f758e9e270b8a30c873 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c79d96144e224f758e9e270b8a30c873; no voters:
I20260808 14:52:58.981702 9767 leader_election.cc:288] T 00000000000000000000000000000000 P c79d96144e224f758e9e270b8a30c873 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260808 14:52:58.981837 9771 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c79d96144e224f758e9e270b8a30c873 [term 2 FOLLOWER]: Leader election won for term 2
I20260808 14:52:58.984124 9767 sys_catalog.cc:564] T 00000000000000000000000000000000 P c79d96144e224f758e9e270b8a30c873 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:52:58.988822 9771 raft_consensus.cc:686] T 00000000000000000000000000000000 P c79d96144e224f758e9e270b8a30c873 [term 2 LEADER]: Becoming Leader. State: Replica: c79d96144e224f758e9e270b8a30c873, State: Running, Role: LEADER
I20260808 14:52:58.989588 9771 consensus_queue.cc:237] T 00000000000000000000000000000000 P c79d96144e224f758e9e270b8a30c873 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c79d96144e224f758e9e270b8a30c873" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 44359 } }
I20260808 14:52:58.992688 9772 sys_catalog.cc:455] T 00000000000000000000000000000000 P c79d96144e224f758e9e270b8a30c873 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "c79d96144e224f758e9e270b8a30c873" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c79d96144e224f758e9e270b8a30c873" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 44359 } } }
I20260808 14:52:58.993093 9772 sys_catalog.cc:458] T 00000000000000000000000000000000 P c79d96144e224f758e9e270b8a30c873 [sys.catalog]: This master's current role is: LEADER
I20260808 14:52:58.993687 9767 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260808 14:52:58.993637 9773 sys_catalog.cc:455] T 00000000000000000000000000000000 P c79d96144e224f758e9e270b8a30c873 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c79d96144e224f758e9e270b8a30c873. Latest consensus state: current_term: 2 leader_uuid: "c79d96144e224f758e9e270b8a30c873" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c79d96144e224f758e9e270b8a30c873" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 44359 } } }
I20260808 14:52:58.993916 9773 sys_catalog.cc:458] T 00000000000000000000000000000000 P c79d96144e224f758e9e270b8a30c873 [sys.catalog]: This master's current role is: LEADER
I20260808 14:52:59.006240 9791 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:52:59.013705 9791 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:52:59.015522 9791 catalog_manager.cc:1259] Loaded cluster ID: be6e556910184c1c8f6eaa6388bb350b
I20260808 14:52:59.015688 9791 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:52:59.021395 9791 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:52:59.023380 9791 catalog_manager.cc:5879] T 00000000000000000000000000000000 P c79d96144e224f758e9e270b8a30c873: Loaded TSK: 0
I20260808 14:52:59.025106 9791 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 14:52:59.381853 9769 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:52:59.382241 9769 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:52:59.382486 9769 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:52:59.394621 9769 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:52:59.394781 9769 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:52:59.395012 9769 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.206.193
I20260808 14:52:59.411425 9769 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:43347
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.26.206.212:44131/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.193.keytab
--principal=kudu/127.26.206.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.206.193:40103
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.206.193
--webserver_port=42243
--tserver_master_addrs=127.26.206.254:44359
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.206.193
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:52:59.413271 9769 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:52:59.415064 9769 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:52:59.449185 9812 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:52:59.453485 9769 server_base.cc:1034] running on GCE node
W20260808 14:52:59.454021 9811 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:52:59.454993 9814 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:52:59.455992 9769 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:52:59.461236 9769 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:52:59.462551 9769 hybrid_clock.cc:648] HybridClock initialized: now 1786200779462471 us; error 69 us; skew 500 ppm
I20260808 14:52:59.463001 9769 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:52:59 dist-test-slave-6k22 krb5kdc[8592](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200779, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:52:59.468194 9769 init.cc:377] Logged in from keytab as kudu/127.26.206.193@KRBTEST.COM (short username kudu)
I20260808 14:52:59.492062 9769 webserver.cc:460] Webserver started at http://127.26.206.193:42243/ using document root <none> and password file <none>
I20260808 14:52:59.493156 9769 fs_manager.cc:359] Metadata directory not provided
I20260808 14:52:59.493404 9769 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 08 14:52:59 dist-test-slave-6k22 krb5kdc[8592](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200779, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.193@KRBTEST.COM for HTTP/127.26.206.212@KRBTEST.COM
I20260808 14:52:59.536355 9769 fs_manager.cc:709] Time spent opening directory manager: real 0.010s user 0.004s sys 0.004s
I20260808 14:52:59.545043 9824 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:52:59.546882 9769 fs_manager.cc:725] Time spent opening block manager: real 0.009s user 0.002s sys 0.006s
I20260808 14:52:59.547147 9769 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/ts-0/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/ts-0/wal
uuid: "27e0e7a8064a4929bad16f22b1b6e512"
format_stamp: "Formatted at 2026-08-08 14:52:56 on dist-test-slave-6k22"
server_key: "b45700ff2e4730da104d8eb2c83fc964"
server_key_iv: "00b033f1171b861b23562e6370737e3a"
server_key_version: "kuduclusterkey@0"
I20260808 14:52:59.548653 9769 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:52:59.597713 9769 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:52:59.604130 9769 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:52:59.604521 9769 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:52:59.612030 9769 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:52:59.620388 9769 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:52:59.620579 9769 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:52:59.620785 9769 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:52:59.620939 9769 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:52:59.721220 9769 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.193:40103
I20260808 14:52:59.721274 9957 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.193:40103 every 8 connection(s)
I20260808 14:52:59.722683 9769 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/ts-0/data/info.pb
I20260808 14:52:59.724434 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 9769
I20260808 14:52:59.725330 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.26.206.212:44131/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.206.194:38953
--local_ip_for_outbound_sockets=127.26.206.194
--tserver_master_addrs=127.26.206.254:44359
--webserver_port=40563
--webserver_interface=127.26.206.194
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.194.keytab
--principal=kudu/127.26.206.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.206.212:43347
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.26.206.212:44131/kms with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 14:52:59 dist-test-slave-6k22 krb5kdc[8592](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200779, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.193@KRBTEST.COM for kudu/127.26.206.254@KRBTEST.COM
I20260808 14:52:59.769470 9961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:52:59.726998 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:44359 (local address 127.26.206.193:48767)
0808 14:52:59.736955 (+ 9957us) negotiation.cc:107] Waiting for socket to connect
0808 14:52:59.737022 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0808 14:52:59.740511 (+ 3489us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:52:59.743523 (+ 3012us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:52:59.743538 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:52:59.744249 (+ 711us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:52:59.745073 (+ 824us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:52:59.745106 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:52:59.747674 (+ 2568us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:52:59.747682 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:52:59.749867 (+ 2185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:52:59.749885 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:52:59.751489 (+ 1604us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:52:59.751501 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:52:59.751849 (+ 348us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:52:59.755880 (+ 4031us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:52:59.755928 (+ 48us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:52:59.759107 (+ 3179us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:52:59.764253 (+ 5146us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:52:59.764265 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:52:59.764283 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:52:59.764951 (+ 668us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:52:59.765465 (+ 514us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:52:59.765471 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:52:59.765474 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:52:59.765781 (+ 307us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:52:59.766803 (+ 1022us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:52:59.766810 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:52:59.767189 (+ 379us) client_negotiation.cc:769] Sending connection context
0808 14:52:59.767512 (+ 323us) client_negotiation.cc:240] Negotiation successful
0808 14:52:59.768080 (+ 568us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9512,"thread_start_us":11705,"threads_started":1}
I20260808 14:52:59.772040 9960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:52:59.726927 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.193:48767 (local address 127.26.206.254:44359)
0808 14:52:59.741774 (+ 14847us) server_negotiation.cc:206] Beginning negotiation
0808 14:52:59.741795 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0808 14:52:59.741846 (+ 51us) server_negotiation.cc:407] Connection header received
0808 14:52:59.742311 (+ 465us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:52:59.742332 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:52:59.742867 (+ 535us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:52:59.743332 (+ 465us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:52:59.745349 (+ 2017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:52:59.747445 (+ 2096us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:52:59.750042 (+ 2597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:52:59.751193 (+ 1151us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:52:59.751841 (+ 648us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:52:59.759498 (+ 7657us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:52:59.759511 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:52:59.759536 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:52:59.759623 (+ 87us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:52:59.764082 (+ 4459us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:52:59.765118 (+ 1036us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:52:59.765127 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:52:59.765135 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:52:59.765317 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:52:59.765915 (+ 598us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:52:59.765920 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:52:59.765923 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:52:59.766545 (+ 622us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:52:59.766733 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0808 14:52:59.770271 (+ 3538us) server_negotiation.cc:299] Negotiation successful
0808 14:52:59.770668 (+ 397us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14549,"thread_start_us":14311,"threads_started":1}
I20260808 14:52:59.775552 9958 heartbeater.cc:347] Connected to a master server at 127.26.206.254:44359
I20260808 14:52:59.775894 9958 heartbeater.cc:464] Registering TS with master...
I20260808 14:52:59.776719 9958 heartbeater.cc:511] Master 127.26.206.254:44359 requested a full tablet report, sending...
W20260808 14:52:59.779870 9958 heartbeater.cc:644] Failed to heartbeat to 127.26.206.254:44359 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260808 14:52:59.780110 9958 heartbeater.cc:464] Registering TS with master...
I20260808 14:52:59.780354 9958 heartbeater.cc:511] Master 127.26.206.254:44359 requested a full tablet report, sending...
I20260808 14:52:59.782068 9958 heartbeater.cc:464] Registering TS with master...
I20260808 14:52:59.782378 9958 heartbeater.cc:511] Master 127.26.206.254:44359 requested a full tablet report, sending...
W20260808 14:52:59.783413 9958 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 14:53:00.167167 9962 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:53:00.167541 9962 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:53:00.167798 9962 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:53:00.180832 9962 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:53:00.181043 9962 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:53:00.181279 9962 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.206.194
I20260808 14:53:00.198698 9962 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:43347
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.26.206.212:44131/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.194.keytab
--principal=kudu/127.26.206.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.206.194:38953
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.206.194
--webserver_port=40563
--tserver_master_addrs=127.26.206.254:44359
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.206.194
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:53:00.200460 9962 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:53:00.202349 9962 file_cache.cc:493] Constructed file cache file cache with capacity 419430
Aug 08 14:53:00 dist-test-slave-6k22 krb5kdc[8592](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786200780, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260808 14:53:00.222759 9979 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:53:00.224649 9980 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:53:00.241772 9982 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:53:00.246907 9962 server_base.cc:1034] running on GCE node
I20260808 14:53:00.247752 9962 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:53:00.259876 9962 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:53:00.261233 9962 hybrid_clock.cc:648] HybridClock initialized: now 1786200780261142 us; error 75 us; skew 500 ppm
I20260808 14:53:00.261687 9962 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:53:00 dist-test-slave-6k22 krb5kdc[8592](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200780, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:53:00.265506 9962 init.cc:377] Logged in from keytab as kudu/127.26.206.194@KRBTEST.COM (short username kudu)
I20260808 14:53:00.269014 9962 webserver.cc:460] Webserver started at http://127.26.206.194:40563/ using document root <none> and password file <none>
I20260808 14:53:00.269824 9962 fs_manager.cc:359] Metadata directory not provided
I20260808 14:53:00.270008 9962 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 08 14:53:00 dist-test-slave-6k22 krb5kdc[8592](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200780, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.194@KRBTEST.COM for HTTP/127.26.206.212@KRBTEST.COM
I20260808 14:53:00.305817 9962 fs_manager.cc:709] Time spent opening directory manager: real 0.016s user 0.007s sys 0.007s
I20260808 14:53:00.309902 9992 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:53:00.311671 9962 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260808 14:53:00.311847 9962 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/ts-1/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/ts-1/wal
uuid: "bad26448d0d94c61a6ec360f788ba945"
format_stamp: "Formatted at 2026-08-08 14:52:57 on dist-test-slave-6k22"
server_key: "6f38b342e3bda65d2041c987d9b2d33f"
server_key_iv: "6f8f99adc7846294967928a1dddfc9dc"
server_key_version: "kuduclusterkey@0"
I20260808 14:53:00.313040 9962 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:53:00.331715 9962 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:53:00.336618 9962 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:53:00.336957 9962 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:53:00.338150 9962 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:53:00.339890 9962 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:53:00.340018 9962 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:53:00.340166 9962 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:53:00.340276 9962 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:53:00.391407 9962 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.194:38953
I20260808 14:53:00.391500 10120 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.194:38953 every 8 connection(s)
I20260808 14:53:00.393482 9962 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/ts-1/data/info.pb
I20260808 14:53:00.401115 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 9962
I20260808 14:53:00.402290 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.26.206.212:44131/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.206.195:34917
--local_ip_for_outbound_sockets=127.26.206.195
--tserver_master_addrs=127.26.206.254:44359
--webserver_port=37551
--webserver_interface=127.26.206.195
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.195.keytab
--principal=kudu/127.26.206.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.206.212:43347
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.26.206.212:44131/kms with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 14:53:00 dist-test-slave-6k22 krb5kdc[8592](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200780, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.194@KRBTEST.COM for kudu/127.26.206.254@KRBTEST.COM
I20260808 14:53:00.461683 10125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:00.403072 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:44359 (local address 127.26.206.194:56869)
0808 14:53:00.434311 (+ 31239us) negotiation.cc:107] Waiting for socket to connect
0808 14:53:00.434372 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0808 14:53:00.437609 (+ 3237us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:53:00.440385 (+ 2776us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:53:00.440400 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:53:00.441201 (+ 801us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:53:00.442124 (+ 923us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:53:00.442165 (+ 41us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:53:00.444467 (+ 2302us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:53:00.444473 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:53:00.446554 (+ 2081us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:53:00.446580 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:53:00.447964 (+ 1384us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:53:00.447971 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:53:00.448309 (+ 338us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:53:00.449219 (+ 910us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:53:00.449270 (+ 51us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:53:00.452283 (+ 3013us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:53:00.456632 (+ 4349us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:53:00.456641 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:53:00.456659 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:53:00.457269 (+ 610us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:53:00.457772 (+ 503us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:53:00.457777 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:53:00.457781 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:53:00.458048 (+ 267us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:53:00.458864 (+ 816us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:53:00.458872 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:53:00.459298 (+ 426us) client_negotiation.cc:769] Sending connection context
0808 14:53:00.459683 (+ 385us) client_negotiation.cc:240] Negotiation successful
0808 14:53:00.460248 (+ 565us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30844,"thread_start_us":34848,"threads_started":1}
I20260808 14:53:00.462860 10126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:00.404252 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.194:56869 (local address 127.26.206.254:44359)
0808 14:53:00.439310 (+ 35058us) server_negotiation.cc:206] Beginning negotiation
0808 14:53:00.439319 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:53:00.439346 (+ 27us) server_negotiation.cc:407] Connection header received
0808 14:53:00.439420 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:53:00.439428 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:53:00.439528 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:53:00.439692 (+ 164us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:53:00.443009 (+ 3317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:00.444252 (+ 1243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:00.446788 (+ 2536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:00.447466 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:00.447609 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:53:00.452545 (+ 4936us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:53:00.452553 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:53:00.452558 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:53:00.452602 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:53:00.456461 (+ 3859us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:53:00.457421 (+ 960us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:53:00.457427 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:53:00.457431 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:53:00.457612 (+ 181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:53:00.458196 (+ 584us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:53:00.458202 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:53:00.458206 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:53:00.458598 (+ 392us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:53:00.458757 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0808 14:53:00.462198 (+ 3441us) server_negotiation.cc:299] Negotiation successful
0808 14:53:00.462438 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34872,"thread_start_us":35602,"threads_started":1}
I20260808 14:53:00.465167 10121 heartbeater.cc:347] Connected to a master server at 127.26.206.254:44359
I20260808 14:53:00.465555 10121 heartbeater.cc:464] Registering TS with master...
I20260808 14:53:00.466545 10121 heartbeater.cc:511] Master 127.26.206.254:44359 requested a full tablet report, sending...
I20260808 14:53:00.468981 9726 ts_manager.cc:194] Registered new tserver with Master: bad26448d0d94c61a6ec360f788ba945 (127.26.206.194:38953)
I20260808 14:53:00.470813 9726 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.206.194@KRBTEST.COM'} at 127.26.206.194:56869
Aug 08 14:53:00 dist-test-slave-6k22 krb5kdc[8592](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200780, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.254@KRBTEST.COM for HTTP/127.26.206.212@KRBTEST.COM
I20260808 14:53:00.783638 9958 heartbeater.cc:464] Registering TS with master...
I20260808 14:53:00.784150 9958 heartbeater.cc:511] Master 127.26.206.254:44359 requested a full tablet report, sending...
I20260808 14:53:00.785705 9726 ts_manager.cc:194] Registered new tserver with Master: 27e0e7a8064a4929bad16f22b1b6e512 (127.26.206.193:40103)
I20260808 14:53:00.787061 9726 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.206.193@KRBTEST.COM'} at 127.26.206.193:48767
W20260808 14:53:00.881522 10127 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:53:00.881850 10127 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:53:00.882025 10127 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:53:00.892824 10127 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:53:00.893002 10127 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:53:00.893250 10127 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.206.195
I20260808 14:53:00.909116 10127 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:43347
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.26.206.212:44131/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.195.keytab
--principal=kudu/127.26.206.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.206.195:34917
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.206.195
--webserver_port=37551
--tserver_master_addrs=127.26.206.254:44359
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.206.195
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:53:00.910928 10127 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:53:00.912724 10127 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:53:00.940919 10132 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:53:00.947960 10133 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:53:00.954535 10136 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:53:00.955374 10127 server_base.cc:1034] running on GCE node
I20260808 14:53:00.956131 10127 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:53:00.957274 10127 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:53:00.958568 10127 hybrid_clock.cc:648] HybridClock initialized: now 1786200780958504 us; error 56 us; skew 500 ppm
I20260808 14:53:00.958941 10127 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:53:00 dist-test-slave-6k22 krb5kdc[8592](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200780, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:53:00.962558 10127 init.cc:377] Logged in from keytab as kudu/127.26.206.195@KRBTEST.COM (short username kudu)
I20260808 14:53:00.969151 10127 webserver.cc:460] Webserver started at http://127.26.206.195:37551/ using document root <none> and password file <none>
I20260808 14:53:00.969946 10127 fs_manager.cc:359] Metadata directory not provided
I20260808 14:53:00.970129 10127 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 08 14:53:00 dist-test-slave-6k22 krb5kdc[8592](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200780, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.195@KRBTEST.COM for HTTP/127.26.206.212@KRBTEST.COM
I20260808 14:53:01.011605 10127 fs_manager.cc:709] Time spent opening directory manager: real 0.025s user 0.011s sys 0.011s
I20260808 14:53:01.015698 10146 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:53:01.017583 10127 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.000s sys 0.003s
I20260808 14:53:01.017763 10127 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/ts-2/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/ts-2/wal
uuid: "4c8609562f79496385b4a84dfa9beb0a"
format_stamp: "Formatted at 2026-08-08 14:52:57 on dist-test-slave-6k22"
server_key: "b234118cc9eaf69455aacacfa3ef0076"
server_key_iv: "bbeb30e011610ce8d0bc257cadf04c88"
server_key_version: "kuduclusterkey@0"
I20260808 14:53:01.019265 10127 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:53:01.047254 10127 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:53:01.057161 10127 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:53:01.057578 10127 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:53:01.059697 10127 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:53:01.064440 10127 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:53:01.064626 10127 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260808 14:53:01.064812 10127 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:53:01.064940 10127 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 14:53:01 dist-test-slave-6k22 krb5kdc[8592](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200780, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.254@KRBTEST.COM for HTTP/127.26.206.212@KRBTEST.COM
I20260808 14:53:01.155835 10127 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.195:34917
I20260808 14:53:01.155884 10272 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.195:34917 every 8 connection(s)
I20260808 14:53:01.157467 10127 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/ts-2/data/info.pb
I20260808 14:53:01.158536 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 10127
Aug 08 14:53:01 dist-test-slave-6k22 krb5kdc[8592](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200780, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.195@KRBTEST.COM for kudu/127.26.206.254@KRBTEST.COM
I20260808 14:53:01.221556 10276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:01.159794 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56198 (local address 127.26.206.254:44359)
0808 14:53:01.188454 (+ 28660us) server_negotiation.cc:206] Beginning negotiation
0808 14:53:01.188459 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:53:01.198730 (+ 10271us) server_negotiation.cc:407] Connection header received
0808 14:53:01.201491 (+ 2761us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:53:01.201496 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:53:01.201574 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:53:01.201683 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:53:01.204267 (+ 2584us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:01.205475 (+ 1208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:01.207633 (+ 2158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:01.208367 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:01.208467 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:53:01.213053 (+ 4586us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:53:01.213060 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:53:01.213065 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:53:01.213139 (+ 74us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:53:01.217202 (+ 4063us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:53:01.218775 (+ 1573us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:53:01.218781 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:53:01.218785 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:53:01.218967 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:53:01.219505 (+ 538us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:53:01.219511 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:53:01.219515 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:53:01.219925 (+ 410us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:53:01.220200 (+ 275us) server_negotiation.cc:1035] Waiting for connection context
0808 14:53:01.220852 (+ 652us) server_negotiation.cc:299] Negotiation successful
0808 14:53:01.221127 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28535,"thread_start_us":39758,"threads_started":1}
I20260808 14:53:01.230315 10277 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:01.167305 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:44359 (local address 127.26.206.195:59901)
0808 14:53:01.187099 (+ 19794us) negotiation.cc:107] Waiting for socket to connect
0808 14:53:01.187163 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0808 14:53:01.190079 (+ 2916us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:53:01.200315 (+ 10236us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:53:01.200330 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:53:01.201123 (+ 793us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:53:01.202062 (+ 939us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:53:01.202091 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:53:01.203822 (+ 1731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:53:01.203829 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:53:01.206110 (+ 2281us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:53:01.206137 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:53:01.207770 (+ 1633us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:53:01.207780 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:53:01.208118 (+ 338us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:53:01.208990 (+ 872us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:53:01.209027 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:53:01.212014 (+ 2987us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:53:01.225199 (+ 13185us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:53:01.225209 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:53:01.225227 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:53:01.225923 (+ 696us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:53:01.226386 (+ 463us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:53:01.226391 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:53:01.226394 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:53:01.226676 (+ 282us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:53:01.227385 (+ 709us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:53:01.227394 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:53:01.227911 (+ 517us) client_negotiation.cc:769] Sending connection context
0808 14:53:01.228252 (+ 341us) client_negotiation.cc:240] Negotiation successful
0808 14:53:01.228847 (+ 595us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":19462,"thread_start_us":19262,"threads_started":1}
I20260808 14:53:01.231501 10274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:01.167842 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.195:59901 (local address 127.26.206.254:44359)
0808 14:53:01.199159 (+ 31317us) server_negotiation.cc:206] Beginning negotiation
0808 14:53:01.199166 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:53:01.199198 (+ 32us) server_negotiation.cc:407] Connection header received
0808 14:53:01.199288 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:53:01.199293 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:53:01.199407 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:53:01.201058 (+ 1651us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:53:01.202308 (+ 1250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:01.203615 (+ 1307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:01.206698 (+ 3083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:01.207459 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:01.208599 (+ 1140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:53:01.212337 (+ 3738us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:53:01.212345 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:53:01.212349 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:53:01.212398 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:53:01.225019 (+ 12621us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:53:01.226103 (+ 1084us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:53:01.226109 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:53:01.226112 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:53:01.226246 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:53:01.226860 (+ 614us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:53:01.226865 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:53:01.226869 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:53:01.227211 (+ 342us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:53:01.230667 (+ 3456us) server_negotiation.cc:1035] Waiting for connection context
0808 14:53:01.230845 (+ 178us) server_negotiation.cc:299] Negotiation successful
0808 14:53:01.231084 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31191,"thread_start_us":20390,"threads_started":1}
I20260808 14:53:01.233062 10273 heartbeater.cc:347] Connected to a master server at 127.26.206.254:44359
I20260808 14:53:01.233476 10273 heartbeater.cc:464] Registering TS with master...
I20260808 14:53:01.234462 10273 heartbeater.cc:511] Master 127.26.206.254:44359 requested a full tablet report, sending...
I20260808 14:53:01.236251 9726 ts_manager.cc:194] Registered new tserver with Master: 4c8609562f79496385b4a84dfa9beb0a (127.26.206.195:34917)
I20260808 14:53:01.237532 9726 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.206.195@KRBTEST.COM'} at 127.26.206.195:59901
I20260808 14:53:01.240847 27451 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 14:53:01.296631 10274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:01.267936 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56202 (local address 127.26.206.254:44359)
0808 14:53:01.268143 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0808 14:53:01.268152 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:53:01.276258 (+ 8106us) server_negotiation.cc:407] Connection header received
0808 14:53:01.276587 (+ 329us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:53:01.276594 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:53:01.276713 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:53:01.276799 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:53:01.279352 (+ 2553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:01.280614 (+ 1262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:01.282931 (+ 2317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:01.283709 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:01.283812 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:53:01.288366 (+ 4554us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:53:01.288374 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:53:01.288379 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:53:01.288428 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:53:01.292682 (+ 4254us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:53:01.293692 (+ 1010us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:53:01.293698 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:53:01.293702 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:53:01.293885 (+ 183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:53:01.294550 (+ 665us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:53:01.294556 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:53:01.294560 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:53:01.295003 (+ 443us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:53:01.295237 (+ 234us) server_negotiation.cc:1035] Waiting for connection context
0808 14:53:01.295959 (+ 722us) server_negotiation.cc:299] Negotiation successful
0808 14:53:01.296246 (+ 287us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260808 14:53:01.304514 9726 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56202:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:53:01.316004 9726 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:53:01.370155 10294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:01.336806 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.194:38953 (local address 127.0.0.1:44926)
0808 14:53:01.361399 (+ 24593us) negotiation.cc:107] Waiting for socket to connect
0808 14:53:01.361419 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 14:53:01.361577 (+ 158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:53:01.362595 (+ 1018us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:53:01.362603 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:53:01.362637 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:53:01.363036 (+ 399us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:53:01.363055 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:53:01.365135 (+ 2080us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:53:01.365141 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:53:01.367157 (+ 2016us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:53:01.367170 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:53:01.369115 (+ 1945us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:53:01.369123 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:53:01.369359 (+ 236us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:53:01.369436 (+ 77us) client_negotiation.cc:769] Sending connection context
0808 14:53:01.369588 (+ 152us) client_negotiation.cc:240] Negotiation successful
0808 14:53:01.369799 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":24455,"thread_start_us":30919,"threads_started":1}
I20260808 14:53:01.371341 10293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:01.336966 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44926 (local address 127.26.206.194:38953)
0808 14:53:01.344973 (+ 8007us) server_negotiation.cc:206] Beginning negotiation
0808 14:53:01.344983 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 14:53:01.361564 (+ 16581us) server_negotiation.cc:407] Connection header received
0808 14:53:01.361774 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:53:01.361783 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:53:01.362065 (+ 282us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:53:01.362298 (+ 233us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:53:01.363294 (+ 996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:01.364953 (+ 1659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:01.367328 (+ 2375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:01.368845 (+ 1517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:01.370494 (+ 1649us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:53:01.370695 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0808 14:53:01.370787 (+ 92us) server_negotiation.cc:299] Negotiation successful
0808 14:53:01.370969 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7831,"thread_start_us":7944,"threads_started":1}
I20260808 14:53:01.378525 10045 tablet_service.cc:1467] Processing CreateTablet for tablet 9866e5f5496c45d8a9520e32acb23df7 (DEFAULT_TABLE table=test-table [id=70bce76c190a431bb764ecf48c94a31d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:53:01.380204 10045 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9866e5f5496c45d8a9520e32acb23df7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:53:01.380432 10295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:01.347112 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54424 (local address 127.26.206.195:34917)
0808 14:53:01.364139 (+ 17027us) server_negotiation.cc:206] Beginning negotiation
0808 14:53:01.364152 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 14:53:01.370324 (+ 6172us) server_negotiation.cc:407] Connection header received
0808 14:53:01.370439 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:53:01.370447 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:53:01.370719 (+ 272us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:53:01.370922 (+ 203us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:53:01.372228 (+ 1306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:01.373945 (+ 1717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:01.377473 (+ 3528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:01.379011 (+ 1538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:01.379188 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:53:01.379472 (+ 284us) server_negotiation.cc:1035] Waiting for connection context
0808 14:53:01.379945 (+ 473us) server_negotiation.cc:299] Negotiation successful
0808 14:53:01.380073 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16814,"thread_start_us":17053,"threads_started":1}
I20260808 14:53:01.381150 10291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:01.346771 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.195:34917 (local address 127.0.0.1:54424)
0808 14:53:01.369102 (+ 22331us) negotiation.cc:107] Waiting for socket to connect
0808 14:53:01.369121 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 14:53:01.369241 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:53:01.370935 (+ 1694us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:53:01.370940 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:53:01.370969 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:53:01.371343 (+ 374us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:53:01.371355 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:53:01.374144 (+ 2789us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:53:01.374149 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:53:01.377288 (+ 3139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:53:01.377303 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:53:01.379384 (+ 2081us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:53:01.379390 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:53:01.379626 (+ 236us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:53:01.379669 (+ 43us) client_negotiation.cc:769] Sending connection context
0808 14:53:01.380739 (+ 1070us) client_negotiation.cc:240] Negotiation successful
0808 14:53:01.380855 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":22185,"thread_start_us":14348,"threads_started":1}
I20260808 14:53:01.385183 10202 tablet_service.cc:1467] Processing CreateTablet for tablet 9866e5f5496c45d8a9520e32acb23df7 (DEFAULT_TABLE table=test-table [id=70bce76c190a431bb764ecf48c94a31d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:53:01.387058 10202 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9866e5f5496c45d8a9520e32acb23df7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:53:01.392530 10289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:01.332977 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.193:40103 (local address 127.0.0.1:58668)
0808 14:53:01.348626 (+ 15649us) negotiation.cc:107] Waiting for socket to connect
0808 14:53:01.348671 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 14:53:01.348866 (+ 195us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:53:01.371334 (+ 22468us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:53:01.371340 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:53:01.371372 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:53:01.371905 (+ 533us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:53:01.371968 (+ 63us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:53:01.387215 (+ 15247us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:53:01.387220 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:53:01.389503 (+ 2283us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:53:01.389520 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:53:01.391761 (+ 2241us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:53:01.391768 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:53:01.391943 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:53:01.391979 (+ 36us) client_negotiation.cc:769] Sending connection context
0808 14:53:01.392052 (+ 73us) client_negotiation.cc:240] Negotiation successful
0808 14:53:01.392190 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15358,"thread_start_us":16063,"threads_started":1}
I20260808 14:53:01.393384 10290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:01.333182 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58668 (local address 127.26.206.193:40103)
0808 14:53:01.368289 (+ 35107us) server_negotiation.cc:206] Beginning negotiation
0808 14:53:01.368299 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 14:53:01.368334 (+ 35us) server_negotiation.cc:407] Connection header received
0808 14:53:01.368438 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:53:01.368447 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:53:01.368704 (+ 257us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:53:01.371638 (+ 2934us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:53:01.381628 (+ 9990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:01.383362 (+ 1734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:01.389754 (+ 6392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:01.391219 (+ 1465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:01.391440 (+ 221us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:53:01.392803 (+ 1363us) server_negotiation.cc:1035] Waiting for connection context
0808 14:53:01.392894 (+ 91us) server_negotiation.cc:299] Negotiation successful
0808 14:53:01.393063 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34894,"thread_start_us":35935,"threads_started":1}
I20260808 14:53:01.397315 9880 tablet_service.cc:1467] Processing CreateTablet for tablet 9866e5f5496c45d8a9520e32acb23df7 (DEFAULT_TABLE table=test-table [id=70bce76c190a431bb764ecf48c94a31d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:53:01.398820 9880 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9866e5f5496c45d8a9520e32acb23df7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:53:01.403529 10305 tablet_bootstrap.cc:492] T 9866e5f5496c45d8a9520e32acb23df7 P bad26448d0d94c61a6ec360f788ba945: Bootstrap starting.
I20260808 14:53:01.407321 10305 tablet_bootstrap.cc:654] T 9866e5f5496c45d8a9520e32acb23df7 P bad26448d0d94c61a6ec360f788ba945: Neither blocks nor log segments found. Creating new log.
I20260808 14:53:01.408742 10305 log.cc:824] T 9866e5f5496c45d8a9520e32acb23df7 P bad26448d0d94c61a6ec360f788ba945: Log is configured to *not* fsync() on all Append() calls
I20260808 14:53:01.409250 10308 tablet_bootstrap.cc:492] T 9866e5f5496c45d8a9520e32acb23df7 P 4c8609562f79496385b4a84dfa9beb0a: Bootstrap starting.
I20260808 14:53:01.413107 10308 tablet_bootstrap.cc:654] T 9866e5f5496c45d8a9520e32acb23df7 P 4c8609562f79496385b4a84dfa9beb0a: Neither blocks nor log segments found. Creating new log.
I20260808 14:53:01.414062 10308 log.cc:824] T 9866e5f5496c45d8a9520e32acb23df7 P 4c8609562f79496385b4a84dfa9beb0a: Log is configured to *not* fsync() on all Append() calls
I20260808 14:53:01.414295 10305 tablet_bootstrap.cc:492] T 9866e5f5496c45d8a9520e32acb23df7 P bad26448d0d94c61a6ec360f788ba945: No bootstrap required, opened a new log
I20260808 14:53:01.414706 10305 ts_tablet_manager.cc:1397] T 9866e5f5496c45d8a9520e32acb23df7 P bad26448d0d94c61a6ec360f788ba945: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.007s
I20260808 14:53:01.415714 10311 tablet_bootstrap.cc:492] T 9866e5f5496c45d8a9520e32acb23df7 P 27e0e7a8064a4929bad16f22b1b6e512: Bootstrap starting.
I20260808 14:53:01.418416 10308 tablet_bootstrap.cc:492] T 9866e5f5496c45d8a9520e32acb23df7 P 4c8609562f79496385b4a84dfa9beb0a: No bootstrap required, opened a new log
I20260808 14:53:01.418704 10308 ts_tablet_manager.cc:1397] T 9866e5f5496c45d8a9520e32acb23df7 P 4c8609562f79496385b4a84dfa9beb0a: Time spent bootstrapping tablet: real 0.010s user 0.009s sys 0.000s
I20260808 14:53:01.419166 10311 tablet_bootstrap.cc:654] T 9866e5f5496c45d8a9520e32acb23df7 P 27e0e7a8064a4929bad16f22b1b6e512: Neither blocks nor log segments found. Creating new log.
I20260808 14:53:01.420445 10311 log.cc:824] T 9866e5f5496c45d8a9520e32acb23df7 P 27e0e7a8064a4929bad16f22b1b6e512: Log is configured to *not* fsync() on all Append() calls
I20260808 14:53:01.423365 10311 tablet_bootstrap.cc:492] T 9866e5f5496c45d8a9520e32acb23df7 P 27e0e7a8064a4929bad16f22b1b6e512: No bootstrap required, opened a new log
I20260808 14:53:01.423080 10305 raft_consensus.cc:348] T 9866e5f5496c45d8a9520e32acb23df7 P bad26448d0d94c61a6ec360f788ba945 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e0e7a8064a4929bad16f22b1b6e512" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 40103 } } peers { permanent_uuid: "bad26448d0d94c61a6ec360f788ba945" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 38953 } } peers { permanent_uuid: "4c8609562f79496385b4a84dfa9beb0a" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 34917 } }
I20260808 14:53:01.423514 10305 raft_consensus.cc:374] T 9866e5f5496c45d8a9520e32acb23df7 P bad26448d0d94c61a6ec360f788ba945 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:53:01.423693 10311 ts_tablet_manager.cc:1397] T 9866e5f5496c45d8a9520e32acb23df7 P 27e0e7a8064a4929bad16f22b1b6e512: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.003s
I20260808 14:53:01.423671 10305 raft_consensus.cc:729] T 9866e5f5496c45d8a9520e32acb23df7 P bad26448d0d94c61a6ec360f788ba945 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bad26448d0d94c61a6ec360f788ba945, State: Initialized, Role: FOLLOWER
I20260808 14:53:01.424293 10305 consensus_queue.cc:260] T 9866e5f5496c45d8a9520e32acb23df7 P bad26448d0d94c61a6ec360f788ba945 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e0e7a8064a4929bad16f22b1b6e512" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 40103 } } peers { permanent_uuid: "bad26448d0d94c61a6ec360f788ba945" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 38953 } } peers { permanent_uuid: "4c8609562f79496385b4a84dfa9beb0a" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 34917 } }
I20260808 14:53:01.425536 10121 heartbeater.cc:503] Master 127.26.206.254:44359 was elected leader, sending a full tablet report...
I20260808 14:53:01.426215 10305 ts_tablet_manager.cc:1428] T 9866e5f5496c45d8a9520e32acb23df7 P bad26448d0d94c61a6ec360f788ba945: Time spent starting tablet: real 0.011s user 0.010s sys 0.000s
I20260808 14:53:01.429010 10308 raft_consensus.cc:348] T 9866e5f5496c45d8a9520e32acb23df7 P 4c8609562f79496385b4a84dfa9beb0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e0e7a8064a4929bad16f22b1b6e512" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 40103 } } peers { permanent_uuid: "bad26448d0d94c61a6ec360f788ba945" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 38953 } } peers { permanent_uuid: "4c8609562f79496385b4a84dfa9beb0a" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 34917 } }
I20260808 14:53:01.429490 10308 raft_consensus.cc:374] T 9866e5f5496c45d8a9520e32acb23df7 P 4c8609562f79496385b4a84dfa9beb0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:53:01.429587 10308 raft_consensus.cc:729] T 9866e5f5496c45d8a9520e32acb23df7 P 4c8609562f79496385b4a84dfa9beb0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c8609562f79496385b4a84dfa9beb0a, State: Initialized, Role: FOLLOWER
I20260808 14:53:01.430238 10308 consensus_queue.cc:260] T 9866e5f5496c45d8a9520e32acb23df7 P 4c8609562f79496385b4a84dfa9beb0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e0e7a8064a4929bad16f22b1b6e512" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 40103 } } peers { permanent_uuid: "bad26448d0d94c61a6ec360f788ba945" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 38953 } } peers { permanent_uuid: "4c8609562f79496385b4a84dfa9beb0a" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 34917 } }
I20260808 14:53:01.431295 10273 heartbeater.cc:503] Master 127.26.206.254:44359 was elected leader, sending a full tablet report...
I20260808 14:53:01.433139 10308 ts_tablet_manager.cc:1428] T 9866e5f5496c45d8a9520e32acb23df7 P 4c8609562f79496385b4a84dfa9beb0a: Time spent starting tablet: real 0.014s user 0.012s sys 0.000s
I20260808 14:53:01.434243 10311 raft_consensus.cc:348] T 9866e5f5496c45d8a9520e32acb23df7 P 27e0e7a8064a4929bad16f22b1b6e512 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e0e7a8064a4929bad16f22b1b6e512" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 40103 } } peers { permanent_uuid: "bad26448d0d94c61a6ec360f788ba945" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 38953 } } peers { permanent_uuid: "4c8609562f79496385b4a84dfa9beb0a" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 34917 } }
I20260808 14:53:01.434604 10311 raft_consensus.cc:374] T 9866e5f5496c45d8a9520e32acb23df7 P 27e0e7a8064a4929bad16f22b1b6e512 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:53:01.434722 10311 raft_consensus.cc:729] T 9866e5f5496c45d8a9520e32acb23df7 P 27e0e7a8064a4929bad16f22b1b6e512 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27e0e7a8064a4929bad16f22b1b6e512, State: Initialized, Role: FOLLOWER
I20260808 14:53:01.435295 10311 consensus_queue.cc:260] T 9866e5f5496c45d8a9520e32acb23df7 P 27e0e7a8064a4929bad16f22b1b6e512 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e0e7a8064a4929bad16f22b1b6e512" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 40103 } } peers { permanent_uuid: "bad26448d0d94c61a6ec360f788ba945" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 38953 } } peers { permanent_uuid: "4c8609562f79496385b4a84dfa9beb0a" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 34917 } }
I20260808 14:53:01.436319 9958 heartbeater.cc:503] Master 127.26.206.254:44359 was elected leader, sending a full tablet report...
W20260808 14:53:01.436741 10278 tablet.cc:2369] T 9866e5f5496c45d8a9520e32acb23df7 P 4c8609562f79496385b4a84dfa9beb0a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:53:01.436883 10311 ts_tablet_manager.cc:1428] T 9866e5f5496c45d8a9520e32acb23df7 P 27e0e7a8064a4929bad16f22b1b6e512: Time spent starting tablet: real 0.013s user 0.012s sys 0.000s
W20260808 14:53:01.443796 10122 tablet.cc:2369] T 9866e5f5496c45d8a9520e32acb23df7 P bad26448d0d94c61a6ec360f788ba945: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 14:53:01.476312 9959 tablet.cc:2369] T 9866e5f5496c45d8a9520e32acb23df7 P 27e0e7a8064a4929bad16f22b1b6e512: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:53:01.609091 10314 raft_consensus.cc:482] T 9866e5f5496c45d8a9520e32acb23df7 P bad26448d0d94c61a6ec360f788ba945 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:53:01.609397 10314 raft_consensus.cc:504] T 9866e5f5496c45d8a9520e32acb23df7 P bad26448d0d94c61a6ec360f788ba945 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e0e7a8064a4929bad16f22b1b6e512" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 40103 } } peers { permanent_uuid: "bad26448d0d94c61a6ec360f788ba945" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 38953 } } peers { permanent_uuid: "4c8609562f79496385b4a84dfa9beb0a" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 34917 } }
I20260808 14:53:01.611159 10314 leader_election.cc:288] T 9866e5f5496c45d8a9520e32acb23df7 P bad26448d0d94c61a6ec360f788ba945 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 27e0e7a8064a4929bad16f22b1b6e512 (127.26.206.193:40103), 4c8609562f79496385b4a84dfa9beb0a (127.26.206.195:34917)
I20260808 14:53:01.618034 10295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:01.611790 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.194:34797 (local address 127.26.206.195:34917)
0808 14:53:01.611964 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0808 14:53:01.611971 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:53:01.612427 (+ 456us) server_negotiation.cc:407] Connection header received
0808 14:53:01.612649 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:53:01.612661 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:53:01.612730 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:53:01.612859 (+ 129us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:53:01.613448 (+ 589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:01.614180 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:01.616238 (+ 2058us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:01.617010 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:01.617178 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:53:01.617253 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0808 14:53:01.617617 (+ 364us) server_negotiation.cc:299] Negotiation successful
0808 14:53:01.617752 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260808 14:53:01.618115 10317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:01.611480 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.195:34917 (local address 127.26.206.194:34797)
0808 14:53:01.612307 (+ 827us) negotiation.cc:107] Waiting for socket to connect
0808 14:53:01.612323 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 14:53:01.612502 (+ 179us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:53:01.612873 (+ 371us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:53:01.612877 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:53:01.612912 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:53:01.613294 (+ 382us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:53:01.613307 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:53:01.614316 (+ 1009us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:53:01.614321 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:53:01.616078 (+ 1757us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:53:01.616091 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:53:01.617215 (+ 1124us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:53:01.617221 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:53:01.617406 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:53:01.617429 (+ 23us) client_negotiation.cc:769] Sending connection context
0808 14:53:01.617545 (+ 116us) client_negotiation.cc:240] Negotiation successful
0808 14:53:01.617691 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":702,"mutex_wait_us":72,"thread_start_us":802,"threads_started":1}
I20260808 14:53:01.618286 10290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:01.611646 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.194:51975 (local address 127.26.206.193:40103)
0808 14:53:01.611919 (+ 273us) server_negotiation.cc:206] Beginning negotiation
0808 14:53:01.611926 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:53:01.612653 (+ 727us) server_negotiation.cc:407] Connection header received
0808 14:53:01.612889 (+ 236us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:53:01.612892 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:53:01.612960 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:53:01.613055 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:53:01.613627 (+ 572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:01.614340 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:01.616393 (+ 2053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:01.617215 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:01.617386 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:53:01.617459 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 14:53:01.617905 (+ 446us) server_negotiation.cc:299] Negotiation successful
0808 14:53:01.618041 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260808 14:53:01.618716 10318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:01.611516 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.193:40103 (local address 127.26.206.194:51975)
0808 14:53:01.612531 (+ 1015us) negotiation.cc:107] Waiting for socket to connect
0808 14:53:01.612545 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 14:53:01.612727 (+ 182us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:53:01.613077 (+ 350us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:53:01.613086 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:53:01.613110 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:53:01.613477 (+ 367us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:53:01.613486 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:53:01.614480 (+ 994us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:53:01.614485 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:53:01.616237 (+ 1752us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:53:01.616249 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:53:01.617428 (+ 1179us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:53:01.617434 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:53:01.617711 (+ 277us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:53:01.617743 (+ 32us) client_negotiation.cc:769] Sending connection context
0808 14:53:01.617842 (+ 99us) client_negotiation.cc:240] Negotiation successful
0808 14:53:01.617981 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":912,"mutex_wait_us":3,"thread_start_us":420,"threads_started":1}
I20260808 14:53:01.619235 10222 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9866e5f5496c45d8a9520e32acb23df7" candidate_uuid: "bad26448d0d94c61a6ec360f788ba945" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c8609562f79496385b4a84dfa9beb0a" is_pre_election: true
I20260808 14:53:01.619762 10222 raft_consensus.cc:2454] T 9866e5f5496c45d8a9520e32acb23df7 P 4c8609562f79496385b4a84dfa9beb0a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bad26448d0d94c61a6ec360f788ba945 in term 0.
I20260808 14:53:01.619689 9904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9866e5f5496c45d8a9520e32acb23df7" candidate_uuid: "bad26448d0d94c61a6ec360f788ba945" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27e0e7a8064a4929bad16f22b1b6e512" is_pre_election: true
I20260808 14:53:01.620209 9904 raft_consensus.cc:2454] T 9866e5f5496c45d8a9520e32acb23df7 P 27e0e7a8064a4929bad16f22b1b6e512 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bad26448d0d94c61a6ec360f788ba945 in term 0.
I20260808 14:53:01.620447 9994 leader_election.cc:302] T 9866e5f5496c45d8a9520e32acb23df7 P bad26448d0d94c61a6ec360f788ba945 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c8609562f79496385b4a84dfa9beb0a, bad26448d0d94c61a6ec360f788ba945; no voters:
I20260808 14:53:01.620854 10314 raft_consensus.cc:2781] T 9866e5f5496c45d8a9520e32acb23df7 P bad26448d0d94c61a6ec360f788ba945 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:53:01.621007 10314 raft_consensus.cc:482] T 9866e5f5496c45d8a9520e32acb23df7 P bad26448d0d94c61a6ec360f788ba945 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:53:01.621120 10314 raft_consensus.cc:3037] T 9866e5f5496c45d8a9520e32acb23df7 P bad26448d0d94c61a6ec360f788ba945 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:53:01.623262 10314 raft_consensus.cc:504] T 9866e5f5496c45d8a9520e32acb23df7 P bad26448d0d94c61a6ec360f788ba945 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e0e7a8064a4929bad16f22b1b6e512" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 40103 } } peers { permanent_uuid: "bad26448d0d94c61a6ec360f788ba945" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 38953 } } peers { permanent_uuid: "4c8609562f79496385b4a84dfa9beb0a" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 34917 } }
I20260808 14:53:01.623899 10314 leader_election.cc:288] T 9866e5f5496c45d8a9520e32acb23df7 P bad26448d0d94c61a6ec360f788ba945 [CANDIDATE]: Term 1 election: Requested vote from peers 27e0e7a8064a4929bad16f22b1b6e512 (127.26.206.193:40103), 4c8609562f79496385b4a84dfa9beb0a (127.26.206.195:34917)
I20260808 14:53:01.624301 9904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9866e5f5496c45d8a9520e32acb23df7" candidate_uuid: "bad26448d0d94c61a6ec360f788ba945" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27e0e7a8064a4929bad16f22b1b6e512"
I20260808 14:53:01.624539 9904 raft_consensus.cc:3037] T 9866e5f5496c45d8a9520e32acb23df7 P 27e0e7a8064a4929bad16f22b1b6e512 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:53:01.624481 10222 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9866e5f5496c45d8a9520e32acb23df7" candidate_uuid: "bad26448d0d94c61a6ec360f788ba945" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c8609562f79496385b4a84dfa9beb0a"
I20260808 14:53:01.624717 10222 raft_consensus.cc:3037] T 9866e5f5496c45d8a9520e32acb23df7 P 4c8609562f79496385b4a84dfa9beb0a [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:53:01.626859 9904 raft_consensus.cc:2454] T 9866e5f5496c45d8a9520e32acb23df7 P 27e0e7a8064a4929bad16f22b1b6e512 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bad26448d0d94c61a6ec360f788ba945 in term 1.
I20260808 14:53:01.626971 10222 raft_consensus.cc:2454] T 9866e5f5496c45d8a9520e32acb23df7 P 4c8609562f79496385b4a84dfa9beb0a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bad26448d0d94c61a6ec360f788ba945 in term 1.
I20260808 14:53:01.627260 9993 leader_election.cc:302] T 9866e5f5496c45d8a9520e32acb23df7 P bad26448d0d94c61a6ec360f788ba945 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27e0e7a8064a4929bad16f22b1b6e512, bad26448d0d94c61a6ec360f788ba945; no voters:
I20260808 14:53:01.627539 10314 raft_consensus.cc:2781] T 9866e5f5496c45d8a9520e32acb23df7 P bad26448d0d94c61a6ec360f788ba945 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:53:01.627978 10314 raft_consensus.cc:686] T 9866e5f5496c45d8a9520e32acb23df7 P bad26448d0d94c61a6ec360f788ba945 [term 1 LEADER]: Becoming Leader. State: Replica: bad26448d0d94c61a6ec360f788ba945, State: Running, Role: LEADER
I20260808 14:53:01.628515 10314 consensus_queue.cc:237] T 9866e5f5496c45d8a9520e32acb23df7 P bad26448d0d94c61a6ec360f788ba945 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e0e7a8064a4929bad16f22b1b6e512" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 40103 } } peers { permanent_uuid: "bad26448d0d94c61a6ec360f788ba945" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 38953 } } peers { permanent_uuid: "4c8609562f79496385b4a84dfa9beb0a" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 34917 } }
I20260808 14:53:01.632874 9726 catalog_manager.cc:5495] T 9866e5f5496c45d8a9520e32acb23df7 P bad26448d0d94c61a6ec360f788ba945 reported cstate change: term changed from 0 to 1, leader changed from <none> to bad26448d0d94c61a6ec360f788ba945 (127.26.206.194). New cstate: current_term: 1 leader_uuid: "bad26448d0d94c61a6ec360f788ba945" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e0e7a8064a4929bad16f22b1b6e512" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 40103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bad26448d0d94c61a6ec360f788ba945" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 38953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4c8609562f79496385b4a84dfa9beb0a" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 34917 } health_report { overall_health: UNKNOWN } } }
I20260808 14:53:01.666075 10293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:01.661026 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44928 (local address 127.26.206.194:38953)
0808 14:53:01.661211 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0808 14:53:01.661215 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:53:01.661234 (+ 19us) server_negotiation.cc:407] Connection header received
0808 14:53:01.661356 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:53:01.661360 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:53:01.661444 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:53:01.661566 (+ 122us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:53:01.661966 (+ 400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:01.662703 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:01.664135 (+ 1432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:01.664537 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:01.664623 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:53:01.665042 (+ 419us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:53:01.665522 (+ 480us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:53:01.665624 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0808 14:53:01.665717 (+ 93us) server_negotiation.cc:299] Negotiation successful
0808 14:53:01.665777 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260808 14:53:01.674268 10222 raft_consensus.cc:1261] T 9866e5f5496c45d8a9520e32acb23df7 P 4c8609562f79496385b4a84dfa9beb0a [term 1 FOLLOWER]: Refusing update from remote peer bad26448d0d94c61a6ec360f788ba945: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:53:01.674315 9904 raft_consensus.cc:1261] T 9866e5f5496c45d8a9520e32acb23df7 P 27e0e7a8064a4929bad16f22b1b6e512 [term 1 FOLLOWER]: Refusing update from remote peer bad26448d0d94c61a6ec360f788ba945: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:53:01.675261 10319 consensus_queue.cc:1035] T 9866e5f5496c45d8a9520e32acb23df7 P bad26448d0d94c61a6ec360f788ba945 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c8609562f79496385b4a84dfa9beb0a" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:53:01.675606 10314 consensus_queue.cc:1035] T 9866e5f5496c45d8a9520e32acb23df7 P bad26448d0d94c61a6ec360f788ba945 [LEADER]: Connected to new peer: Peer: permanent_uuid: "27e0e7a8064a4929bad16f22b1b6e512" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 40103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:53:01.689270 10325 mvcc.cc:205] Tried to move back new op lower bound from 7316278401727340544 to 7316278401553965056. Current Snapshot: MvccSnapshot[applied={T|T < 7316278401727340544}]
I20260808 14:53:01.699847 9725 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56202:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:53:01.700193 9725 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56202:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:53:01.703987 9725 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c79d96144e224f758e9e270b8a30c873: Sending DeleteTablet for 3 replicas of tablet 9866e5f5496c45d8a9520e32acb23df7
I20260808 14:53:01.705083 9880 tablet_service.cc:1514] Processing DeleteTablet for tablet 9866e5f5496c45d8a9520e32acb23df7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:53:01 UTC) from {username='kudu', principal='kudu/127.26.206.254@KRBTEST.COM'} at 127.0.0.1:58668
I20260808 14:53:01.705127 10202 tablet_service.cc:1514] Processing DeleteTablet for tablet 9866e5f5496c45d8a9520e32acb23df7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:53:01 UTC) from {username='kudu', principal='kudu/127.26.206.254@KRBTEST.COM'} at 127.0.0.1:54424
I20260808 14:53:01.705158 10045 tablet_service.cc:1514] Processing DeleteTablet for tablet 9866e5f5496c45d8a9520e32acb23df7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:53:01 UTC) from {username='kudu', principal='kudu/127.26.206.254@KRBTEST.COM'} at 127.0.0.1:44926
I20260808 14:53:01.712472 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 9769
I20260808 14:53:01.718025 10336 tablet_replica.cc:330] T 9866e5f5496c45d8a9520e32acb23df7 P 27e0e7a8064a4929bad16f22b1b6e512: stopping tablet replica
I20260808 14:53:01.718639 10336 raft_consensus.cc:2229] T 9866e5f5496c45d8a9520e32acb23df7 P 27e0e7a8064a4929bad16f22b1b6e512 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:53:01.719300 10336 raft_consensus.cc:2258] T 9866e5f5496c45d8a9520e32acb23df7 P 27e0e7a8064a4929bad16f22b1b6e512 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:53:01.722380 10337 tablet_replica.cc:330] T 9866e5f5496c45d8a9520e32acb23df7 P bad26448d0d94c61a6ec360f788ba945: stopping tablet replica
I20260808 14:53:01.722923 10337 raft_consensus.cc:2229] T 9866e5f5496c45d8a9520e32acb23df7 P bad26448d0d94c61a6ec360f788ba945 [term 1 LEADER]: Raft consensus shutting down.
I20260808 14:53:01.723588 10337 raft_consensus.cc:2258] T 9866e5f5496c45d8a9520e32acb23df7 P bad26448d0d94c61a6ec360f788ba945 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:53:01.727463 10337 ts_tablet_manager.cc:1905] T 9866e5f5496c45d8a9520e32acb23df7 P bad26448d0d94c61a6ec360f788ba945: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:53:01.729598 10335 tablet_replica.cc:330] T 9866e5f5496c45d8a9520e32acb23df7 P 4c8609562f79496385b4a84dfa9beb0a: stopping tablet replica
I20260808 14:53:01.730099 10335 raft_consensus.cc:2229] T 9866e5f5496c45d8a9520e32acb23df7 P 4c8609562f79496385b4a84dfa9beb0a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:53:01.730636 10335 raft_consensus.cc:2258] T 9866e5f5496c45d8a9520e32acb23df7 P 4c8609562f79496385b4a84dfa9beb0a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:53:01.738220 10336 ts_tablet_manager.cc:1905] T 9866e5f5496c45d8a9520e32acb23df7 P 27e0e7a8064a4929bad16f22b1b6e512: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:53:01.739081 10335 ts_tablet_manager.cc:1905] T 9866e5f5496c45d8a9520e32acb23df7 P 4c8609562f79496385b4a84dfa9beb0a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:53:01.744365 10290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:01.713476 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58670 (local address 127.26.206.193:40103)
0808 14:53:01.713906 (+ 430us) server_negotiation.cc:206] Beginning negotiation
0808 14:53:01.713914 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:53:01.713936 (+ 22us) server_negotiation.cc:407] Connection header received
0808 14:53:01.713994 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:53:01.714000 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:53:01.714081 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:53:01.714179 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:53:01.726053 (+ 11874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:01.727188 (+ 1135us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:01.732835 (+ 5647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:01.733493 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:01.733643 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:53:01.736929 (+ 3286us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:53:01.736943 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:53:01.736963 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:53:01.737019 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:53:01.741223 (+ 4204us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:53:01.742068 (+ 845us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:53:01.742077 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:53:01.742081 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:53:01.742247 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:53:01.742627 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:53:01.742633 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:53:01.742636 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:53:01.743103 (+ 467us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:53:01.743415 (+ 312us) server_negotiation.cc:1035] Waiting for connection context
0808 14:53:01.743692 (+ 277us) server_negotiation.cc:299] Negotiation successful
0808 14:53:01.743945 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":301}
I20260808 14:53:01.745002 9953 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:53:01.750591 10335 ts_tablet_manager.cc:1918] T 9866e5f5496c45d8a9520e32acb23df7 P 4c8609562f79496385b4a84dfa9beb0a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:53:01.750777 10335 log.cc:1196] T 9866e5f5496c45d8a9520e32acb23df7 P 4c8609562f79496385b4a84dfa9beb0a: Deleting WAL directory at /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/ts-2/wal/wals/9866e5f5496c45d8a9520e32acb23df7
I20260808 14:53:01.751343 10335 ts_tablet_manager.cc:1939] T 9866e5f5496c45d8a9520e32acb23df7 P 4c8609562f79496385b4a84dfa9beb0a: Deleting consensus metadata
I20260808 14:53:01.752856 10337 ts_tablet_manager.cc:1918] T 9866e5f5496c45d8a9520e32acb23df7 P bad26448d0d94c61a6ec360f788ba945: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:53:01.753172 10337 log.cc:1196] T 9866e5f5496c45d8a9520e32acb23df7 P bad26448d0d94c61a6ec360f788ba945: Deleting WAL directory at /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/ts-1/wal/wals/9866e5f5496c45d8a9520e32acb23df7
I20260808 14:53:01.753415 9709 catalog_manager.cc:4841] TS 4c8609562f79496385b4a84dfa9beb0a (127.26.206.195:34917): tablet 9866e5f5496c45d8a9520e32acb23df7 (table test-table [id=70bce76c190a431bb764ecf48c94a31d]) successfully deleted
I20260808 14:53:01.754163 10337 ts_tablet_manager.cc:1939] T 9866e5f5496c45d8a9520e32acb23df7 P bad26448d0d94c61a6ec360f788ba945: Deleting consensus metadata
I20260808 14:53:01.756629 9710 catalog_manager.cc:4841] TS bad26448d0d94c61a6ec360f788ba945 (127.26.206.194:38953): tablet 9866e5f5496c45d8a9520e32acb23df7 (table test-table [id=70bce76c190a431bb764ecf48c94a31d]) successfully deleted
I20260808 14:53:01.908939 10336 ts_tablet_manager.cc:1918] T 9866e5f5496c45d8a9520e32acb23df7 P 27e0e7a8064a4929bad16f22b1b6e512: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:53:01.909121 10336 log.cc:1196] T 9866e5f5496c45d8a9520e32acb23df7 P 27e0e7a8064a4929bad16f22b1b6e512: Deleting WAL directory at /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200577490656-27451-0/minicluster-data/ts-0/wal/wals/9866e5f5496c45d8a9520e32acb23df7
I20260808 14:53:01.909726 10336 ts_tablet_manager.cc:1939] T 9866e5f5496c45d8a9520e32acb23df7 P 27e0e7a8064a4929bad16f22b1b6e512: Deleting consensus metadata
I20260808 14:53:01.911707 9708 catalog_manager.cc:4841] TS 27e0e7a8064a4929bad16f22b1b6e512 (127.26.206.193:40103): tablet 9866e5f5496c45d8a9520e32acb23df7 (table test-table [id=70bce76c190a431bb764ecf48c94a31d]) successfully deleted
I20260808 14:53:01.912274 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 9769
I20260808 14:53:01.937067 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 9962
I20260808 14:53:01.955626 10293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:01.938093 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44930 (local address 127.26.206.194:38953)
0808 14:53:01.938269 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0808 14:53:01.938275 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:53:01.938294 (+ 19us) server_negotiation.cc:407] Connection header received
0808 14:53:01.938362 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:53:01.938367 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:53:01.938480 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:53:01.938604 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:53:01.940572 (+ 1968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:01.941870 (+ 1298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:01.943931 (+ 2061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:01.944623 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:01.944761 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:53:01.948244 (+ 3483us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:53:01.948259 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:53:01.948279 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:53:01.948330 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:53:01.952473 (+ 4143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:53:01.953316 (+ 843us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:53:01.953326 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:53:01.953329 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:53:01.953499 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:53:01.953976 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:53:01.953981 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:53:01.953984 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:53:01.954432 (+ 448us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:53:01.954776 (+ 344us) server_negotiation.cc:1035] Waiting for connection context
0808 14:53:01.954945 (+ 169us) server_negotiation.cc:299] Negotiation successful
0808 14:53:01.955177 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260808 14:53:01.956380 10116 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:53:02.076131 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 9962
I20260808 14:53:02.099891 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 10127
I20260808 14:53:02.113464 10295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:02.100631 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54438 (local address 127.26.206.195:34917)
0808 14:53:02.100834 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0808 14:53:02.100841 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:53:02.100865 (+ 24us) server_negotiation.cc:407] Connection header received
0808 14:53:02.101084 (+ 219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:53:02.101088 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:53:02.101152 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:53:02.101257 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:53:02.102653 (+ 1396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:02.103390 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:02.104754 (+ 1364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:02.105146 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:02.105278 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:53:02.107981 (+ 2703us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:53:02.107994 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:53:02.108010 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:53:02.108060 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:53:02.110648 (+ 2588us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:53:02.111340 (+ 692us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:53:02.111348 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:53:02.111350 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:53:02.111479 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:53:02.111898 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:53:02.111903 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:53:02.111906 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:53:02.112261 (+ 355us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:53:02.112581 (+ 320us) server_negotiation.cc:1035] Waiting for connection context
0808 14:53:02.112888 (+ 307us) server_negotiation.cc:299] Negotiation successful
0808 14:53:02.113106 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260808 14:53:02.114147 10267 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:53:02.204828 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 10127
I20260808 14:53:02.225075 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 9689
I20260808 14:53:02.226331 9762 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:53:02.338210 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 9689
I20260808 14:53:02.364230 27451 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260808 14:53:02.703650 27451 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260808 14:53:02.703852 27451 mini_ranger.cc:66] Stopping Ranger...
I20260808 14:53:03.048662 27451 mini_ranger.cc:68] Stopped Ranger
2026-08-08 14:53:03.048 UTC [8623] LOG: received smart shutdown request
2026-08-08 14:53:03.052 UTC [8623] LOG: background worker "logical replication launcher" (PID 8632) exited with exit code 1
2026-08-08 14:53:03.053 UTC [8627] LOG: shutting down
2026-08-08 14:53:03.217 UTC [8623] LOG: database system is shut down
2026-08-08T14:53:03Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (53811 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200577490656-27451-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:53:03 dist-test-slave-6k22 krb5kdc[10350](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:53:03 dist-test-slave-6k22 krb5kdc[10350](info): set up 2 sockets
Aug 08 14:53:03 dist-test-slave-6k22 krb5kdc[10350](info): commencing operation
krb5kdc: starting...
W20260808 14:53:04.582599 27451 mini_kdc.cc:121] Time spent starting KDC: real 1.194s user 0.003s sys 0.035s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200577490656-27451-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200577490656-27451-0/krb5kdc/test-user.keytab.
Aug 08 14:53:04 dist-test-slave-6k22 krb5kdc[10350](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200784, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:53:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:53:04Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.206.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.206.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.206.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.254.keytab.
Entry for principal kudu/127.26.206.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.254.keytab.
I20260808 14:53:04.847151 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200577490656-27451-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200577490656-27451-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200577490656-27451-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.206.254:37933
--webserver_interface=127.26.206.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.254.keytab
--principal=kudu/127.26.206.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.206.212:44341
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.206.254:37933,127.26.206.253:42017,127.26.206.252:40859
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:53:05.187053 10364 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:53:05.187322 10364 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:53:05.187498 10364 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:53:05.194665 10364 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:53:05.194768 10364 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:53:05.194932 10364 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:53:05.195058 10364 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:53:05.195142 10364 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:53:05.204896 10364 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:44341
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200577490656-27451-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200577490656-27451-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.206.254:37933,127.26.206.253:42017,127.26.206.252:40859
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.254.keytab
--principal=kudu/127.26.206.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.206.254:37933
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.206.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200577490656-27451-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:53:05.206132 10364 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:53:05.207453 10364 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:53:05.219192 10369 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:53:05.219251 10370 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:53:05.219296 10372 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:53:05.220281 10364 server_base.cc:1034] running on GCE node
I20260808 14:53:05.221081 10364 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:53:05.222299 10364 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:53:05.223523 10364 hybrid_clock.cc:648] HybridClock initialized: now 1786200785223475 us; error 44 us; skew 500 ppm
I20260808 14:53:05.223863 10364 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:53:05 dist-test-slave-6k22 krb5kdc[10350](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200785, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:53:05.232106 10364 init.cc:377] Logged in from keytab as kudu/127.26.206.254@KRBTEST.COM (short username kudu)
I20260808 14:53:05.233788 10364 webserver.cc:460] Webserver started at http://127.26.206.254:41845/ using document root <none> and password file <none>
I20260808 14:53:05.234489 10364 fs_manager.cc:359] Metadata directory not provided
I20260808 14:53:05.234647 10364 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:53:05.234978 10364 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:53:05.238123 10364 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200577490656-27451-0/minicluster-data/master-0/data/instance:
uuid: "7e54b44f60274a6483c40f1507af9bcd"
format_stamp: "Formatted at 2026-08-08 14:53:05 on dist-test-slave-6k22"
server_key: "48377ae610d53c05e144fcdef5733e04"
server_key_iv: "bc1c130539b51f4fa3fc278fb4d993b2"
server_key_version: "encryptionkey@0"
I20260808 14:53:05.239032 10364 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200577490656-27451-0/minicluster-data/master-0/wal/instance:
uuid: "7e54b44f60274a6483c40f1507af9bcd"
format_stamp: "Formatted at 2026-08-08 14:53:05 on dist-test-slave-6k22"
server_key: "48377ae610d53c05e144fcdef5733e04"
server_key_iv: "bc1c130539b51f4fa3fc278fb4d993b2"
server_key_version: "encryptionkey@0"
I20260808 14:53:05.244517 10364 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.002s
I20260808 14:53:05.247890 10387 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:53:05.249151 10364 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260808 14:53:05.249364 10364 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200577490656-27451-0/minicluster-data/master-0/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200577490656-27451-0/minicluster-data/master-0/wal
uuid: "7e54b44f60274a6483c40f1507af9bcd"
format_stamp: "Formatted at 2026-08-08 14:53:05 on dist-test-slave-6k22"
server_key: "48377ae610d53c05e144fcdef5733e04"
server_key_iv: "bc1c130539b51f4fa3fc278fb4d993b2"
server_key_version: "encryptionkey@0"
I20260808 14:53:05.249583 10364 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200577490656-27451-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200577490656-27451-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200577490656-27451-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:53:05.269428 10364 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:53:05.273234 10364 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:53:05.273518 10364 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:53:05.291770 10364 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.254:37933
I20260808 14:53:05.291815 10440 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.254:37933 every 8 connection(s)
I20260808 14:53:05.293036 10364 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
I20260808 14:53:05.296634 10441 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:53:05.301561 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 10364
I20260808 14:53:05.301826 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200577490656-27451-0/minicluster-data/master-0/wal/instance
I20260808 14:53:05.302512 27451 external_mini_cluster.cc:1428] Setting key 621d50cc3aff162fcb6ed6f4df59142e
I20260808 14:53:05.303213 10441 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.206.254" port: 37933 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 14:53:05 dist-test-slave-6k22 krb5kdc[10350](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200785, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.254@KRBTEST.COM for kudu/127.26.206.254@KRBTEST.COM
I20260808 14:53:05.324550 10444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:05.306279 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:37933 (local address 127.0.0.1:33024)
0808 14:53:05.307402 (+ 1123us) negotiation.cc:107] Waiting for socket to connect
0808 14:53:05.307442 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 14:53:05.309160 (+ 1718us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:53:05.309960 (+ 800us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:53:05.309966 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:53:05.310787 (+ 821us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:53:05.311104 (+ 317us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:53:05.311119 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:53:05.312700 (+ 1581us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:53:05.312704 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:53:05.313795 (+ 1091us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:53:05.313806 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:53:05.314752 (+ 946us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:53:05.314758 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:53:05.315007 (+ 249us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:53:05.315697 (+ 690us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:53:05.315718 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:53:05.317704 (+ 1986us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:53:05.320954 (+ 3250us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:53:05.320966 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:53:05.320976 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:53:05.321332 (+ 356us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:53:05.321735 (+ 403us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:53:05.321741 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:53:05.321745 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:53:05.321885 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:53:05.322706 (+ 821us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:53:05.322711 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:53:05.322884 (+ 173us) client_negotiation.cc:769] Sending connection context
0808 14:53:05.323075 (+ 191us) client_negotiation.cc:240] Negotiation successful
0808 14:53:05.323456 (+ 381us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":934,"mutex_wait_us":45,"thread_start_us":719,"threads_started":1}
I20260808 14:53:05.324642 10443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:05.306248 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33024 (local address 127.26.206.254:37933)
0808 14:53:05.307125 (+ 877us) server_negotiation.cc:206] Beginning negotiation
0808 14:53:05.307145 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0808 14:53:05.307585 (+ 440us) server_negotiation.cc:407] Connection header received
0808 14:53:05.309530 (+ 1945us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:53:05.309535 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:53:05.309734 (+ 199us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:53:05.309948 (+ 214us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:53:05.311297 (+ 1349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:05.312538 (+ 1241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:05.313931 (+ 1393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:05.314484 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:05.314706 (+ 222us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:53:05.317948 (+ 3242us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:53:05.317957 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:53:05.317967 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:53:05.317998 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:53:05.320822 (+ 2824us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:53:05.321482 (+ 660us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:53:05.321488 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:53:05.321490 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:53:05.321630 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:53:05.322007 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:53:05.322018 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:53:05.322021 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:53:05.322448 (+ 427us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:53:05.322662 (+ 214us) server_negotiation.cc:1035] Waiting for connection context
0808 14:53:05.323270 (+ 608us) server_negotiation.cc:299] Negotiation successful
0808 14:53:05.323630 (+ 360us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":634,"thread_start_us":411,"threads_started":1}
I20260808 14:53:05.327607 10441 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.206.253" port: 42017 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.26.206.253@KRBTEST.COM; defaulting to no policy
I20260808 14:53:05.328661 10444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:05.328162 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.253:42017 (local address 127.0.0.1:47616)
0808 14:53:05.328382 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0808 14:53:05.328506 (+ 124us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.253:42017: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
W20260808 14:53:05.328900 10392 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.206.253:42017: connect: Connection refused (error 111)
I20260808 14:53:05.330328 10444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:05.330025 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.253:42017 (local address 127.0.0.1:47630)
0808 14:53:05.330147 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0808 14:53:05.330210 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.253:42017: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260808 14:53:05.330613 10441 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.206.253:42017: Network error: Client connection negotiation failed: client connection to 127.26.206.253:42017: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.206.253@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.206.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.253.keytab.
Entry for principal kudu/127.26.206.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.253.keytab.
I20260808 14:53:05.360690 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200577490656-27451-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200577490656-27451-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200577490656-27451-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200577490656-27451-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.206.253:42017
--webserver_interface=127.26.206.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.253.keytab
--principal=kudu/127.26.206.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.206.212:44341
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.206.254:37933,127.26.206.253:42017,127.26.206.252:40859
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 14:53:05.380003 10441 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.206.253" port: 42017 } attempt: 1
I20260808 14:53:05.381213 10444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:05.380754 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.253:42017 (local address 127.0.0.1:47636)
0808 14:53:05.380953 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0808 14:53:05.381081 (+ 128us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.253:42017: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76}
I20260808 14:53:05.382194 10444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:05.381860 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.253:42017 (local address 127.0.0.1:47642)
0808 14:53:05.382006 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0808 14:53:05.382077 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.253:42017: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260808 14:53:05.382404 10441 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.206.253:42017: Network error: Client connection negotiation failed: client connection to 127.26.206.253:42017: connect: Connection refused (error 111)
I20260808 14:53:05.450660 10441 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.206.253" port: 42017 } attempt: 2
I20260808 14:53:05.451901 10444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:05.451383 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.253:42017 (local address 127.0.0.1:47656)
0808 14:53:05.451666 (+ 283us) negotiation.cc:107] Waiting for socket to connect
0808 14:53:05.451755 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.253:42017: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
I20260808 14:53:05.452965 10444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:05.452555 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.253:42017 (local address 127.0.0.1:47668)
0808 14:53:05.452728 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0808 14:53:05.452792 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.253:42017: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260808 14:53:05.453189 10441 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.206.253:42017: Network error: Client connection negotiation failed: client connection to 127.26.206.253:42017: connect: Connection refused (error 111)
I20260808 14:53:05.544428 10441 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.206.253" port: 42017 } attempt: 3
I20260808 14:53:05.545576 10444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:05.545126 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.253:42017 (local address 127.0.0.1:47674)
0808 14:53:05.545341 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0808 14:53:05.545451 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.253:42017: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
I20260808 14:53:05.546576 10444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:05.546233 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.253:42017 (local address 127.0.0.1:47686)
0808 14:53:05.546390 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0808 14:53:05.546454 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.253:42017: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260808 14:53:05.546772 10441 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.206.253:42017: Network error: Client connection negotiation failed: client connection to 127.26.206.253:42017: connect: Connection refused (error 111)
I20260808 14:53:05.690014 10441 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.206.253" port: 42017 } attempt: 4
W20260808 14:53:05.690635 10448 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:53:05.690943 10448 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:53:05.691099 10448 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260808 14:53:05.691241 10444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:05.690654 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.253:42017 (local address 127.0.0.1:47690)
0808 14:53:05.690939 (+ 285us) negotiation.cc:107] Waiting for socket to connect
0808 14:53:05.691053 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.253:42017: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":139}
I20260808 14:53:05.692322 10444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:05.691943 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.253:42017 (local address 127.0.0.1:47706)
0808 14:53:05.692093 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0808 14:53:05.692183 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.253:42017: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260808 14:53:05.692499 10441 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.206.253:42017: Network error: Client connection negotiation failed: client connection to 127.26.206.253:42017: connect: Connection refused (error 111)
W20260808 14:53:05.698540 10448 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:53:05.698657 10448 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:53:05.698770 10448 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:53:05.698863 10448 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:53:05.698927 10448 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:53:05.708716 10448 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:44341
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200577490656-27451-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200577490656-27451-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.26.206.254:37933,127.26.206.253:42017,127.26.206.252:40859
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.253.keytab
--principal=kudu/127.26.206.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.206.253:42017
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200577490656-27451-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.26.206.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200577490656-27451-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:53:05.710053 10448 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:53:05.711323 10448 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:53:05.723452 10453 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:53:05.723383 10454 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:53:05.723479 10456 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:53:05.724318 10448 server_base.cc:1034] running on GCE node
I20260808 14:53:05.725040 10448 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:53:05.726387 10448 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:53:05.727660 10448 hybrid_clock.cc:648] HybridClock initialized: now 1786200785727620 us; error 52 us; skew 500 ppm
I20260808 14:53:05.727993 10448 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:53:05 dist-test-slave-6k22 krb5kdc[10350](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200785, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:53:05.731117 10448 init.cc:377] Logged in from keytab as kudu/127.26.206.253@KRBTEST.COM (short username kudu)
I20260808 14:53:05.732648 10448 webserver.cc:460] Webserver started at http://127.26.206.253:44315/ using document root <none> and password file <none>
I20260808 14:53:05.733349 10448 fs_manager.cc:359] Metadata directory not provided
I20260808 14:53:05.733510 10448 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:53:05.733841 10448 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:53:05.736894 10448 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200577490656-27451-0/minicluster-data/master-1/data/instance:
uuid: "aea8d26ac8894a2dbc3e8f6bfbca0232"
format_stamp: "Formatted at 2026-08-08 14:53:05 on dist-test-slave-6k22"
server_key: "9de607e0a85b22d17be21f80a3a517c7"
server_key_iv: "07174cf4dfbefc2e62194154bee334b3"
server_key_version: "encryptionkey@0"
I20260808 14:53:05.737684 10448 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200577490656-27451-0/minicluster-data/master-1/wal/instance:
uuid: "aea8d26ac8894a2dbc3e8f6bfbca0232"
format_stamp: "Formatted at 2026-08-08 14:53:05 on dist-test-slave-6k22"
server_key: "9de607e0a85b22d17be21f80a3a517c7"
server_key_iv: "07174cf4dfbefc2e62194154bee334b3"
server_key_version: "encryptionkey@0"
I20260808 14:53:05.742635 10448 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.003s
I20260808 14:53:05.746196 10465 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:53:05.747685 10448 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 14:53:05.747872 10448 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200577490656-27451-0/minicluster-data/master-1/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200577490656-27451-0/minicluster-data/master-1/wal
uuid: "aea8d26ac8894a2dbc3e8f6bfbca0232"
format_stamp: "Formatted at 2026-08-08 14:53:05 on dist-test-slave-6k22"
server_key: "9de607e0a85b22d17be21f80a3a517c7"
server_key_iv: "07174cf4dfbefc2e62194154bee334b3"
server_key_version: "encryptionkey@0"
I20260808 14:53:05.748077 10448 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200577490656-27451-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200577490656-27451-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200577490656-27451-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:53:05.761824 10448 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:53:05.765866 10448 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:53:05.766137 10448 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:53:05.783906 10448 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.253:42017
I20260808 14:53:05.783929 10527 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.253:42017 every 8 connection(s)
I20260808 14:53:05.785270 10448 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200577490656-27451-0/minicluster-data/master-1/data/info.pb
I20260808 14:53:05.789076 10528 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:53:05.794561 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 10448
I20260808 14:53:05.794737 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200577490656-27451-0/minicluster-data/master-1/wal/instance
I20260808 14:53:05.795223 27451 external_mini_cluster.cc:1428] Setting key b7cc2dca827108fb51c835aa898f3ded
I20260808 14:53:05.795315 10528 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.206.254" port: 37933 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 14:53:05 dist-test-slave-6k22 krb5kdc[10350](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200785, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.253@KRBTEST.COM for kudu/127.26.206.254@KRBTEST.COM
I20260808 14:53:05.815435 10443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:05.797926 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33030 (local address 127.26.206.254:37933)
0808 14:53:05.798098 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0808 14:53:05.798102 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:53:05.799302 (+ 1200us) server_negotiation.cc:407] Connection header received
0808 14:53:05.801209 (+ 1907us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:53:05.801215 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:53:05.801307 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:53:05.801420 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:53:05.802848 (+ 1428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:05.803531 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:05.805065 (+ 1534us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:05.805500 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:05.805632 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:53:05.809397 (+ 3765us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:53:05.809401 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:53:05.809404 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:53:05.809436 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:53:05.812147 (+ 2711us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:53:05.813146 (+ 999us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:53:05.813150 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:53:05.813152 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:53:05.813306 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:53:05.813751 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:53:05.813754 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:53:05.813756 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:53:05.814024 (+ 268us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:53:05.814174 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0808 14:53:05.815041 (+ 867us) server_negotiation.cc:299] Negotiation successful
0808 14:53:05.815205 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260808 14:53:05.816877 10531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:05.798437 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:37933 (local address 127.0.0.1:33030)
0808 14:53:05.799141 (+ 704us) negotiation.cc:107] Waiting for socket to connect
0808 14:53:05.799177 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0808 14:53:05.800948 (+ 1771us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:53:05.801644 (+ 696us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:53:05.801652 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:53:05.802130 (+ 478us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:53:05.802655 (+ 525us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:53:05.802671 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:53:05.803742 (+ 1071us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:53:05.803746 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:53:05.804919 (+ 1173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:53:05.804931 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:53:05.805710 (+ 779us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:53:05.805716 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:53:05.805928 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:53:05.806564 (+ 636us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:53:05.806586 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:53:05.809175 (+ 2589us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:53:05.812303 (+ 3128us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:53:05.812313 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:53:05.812330 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:53:05.813027 (+ 697us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:53:05.813413 (+ 386us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:53:05.813420 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:53:05.813426 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:53:05.813643 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:53:05.814172 (+ 529us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:53:05.814185 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:53:05.814653 (+ 468us) client_negotiation.cc:769] Sending connection context
0808 14:53:05.814964 (+ 311us) client_negotiation.cc:240] Negotiation successful
0808 14:53:05.815456 (+ 492us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":496,"thread_start_us":313,"threads_started":1}
I20260808 14:53:05.818604 10528 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.206.253" port: 42017 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.26.206.252@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.206.252@KRBTEST.COM" created.
Aug 08 14:53:05 dist-test-slave-6k22 krb5kdc[10350](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200785, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.253@KRBTEST.COM for kudu/127.26.206.253@KRBTEST.COM
I20260808 14:53:05.833192 10531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:05.819263 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.253:42017 (local address 127.0.0.1:47718)
0808 14:53:05.819458 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0808 14:53:05.819475 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 14:53:05.819605 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:53:05.820732 (+ 1127us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:53:05.820739 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:53:05.821238 (+ 499us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:53:05.821439 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:53:05.821453 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:53:05.822917 (+ 1464us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:53:05.822921 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:53:05.823876 (+ 955us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:53:05.823888 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:53:05.824673 (+ 785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:53:05.824684 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:53:05.824863 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:53:05.825475 (+ 612us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:53:05.825490 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:53:05.827652 (+ 2162us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:53:05.830705 (+ 3053us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:53:05.830710 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:53:05.830714 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:53:05.831070 (+ 356us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:53:05.831442 (+ 372us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:53:05.831449 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:53:05.831455 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:53:05.831663 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:53:05.832212 (+ 549us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:53:05.832219 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:53:05.832373 (+ 154us) client_negotiation.cc:769] Sending connection context
0808 14:53:05.832522 (+ 149us) client_negotiation.cc:240] Negotiation successful
0808 14:53:05.832814 (+ 292us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":64}
I20260808 14:53:05.833338 10534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:05.819524 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47718 (local address 127.26.206.253:42017)
0808 14:53:05.820299 (+ 775us) server_negotiation.cc:206] Beginning negotiation
0808 14:53:05.820304 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:53:05.820327 (+ 23us) server_negotiation.cc:407] Connection header received
0808 14:53:05.820366 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:53:05.820371 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:53:05.820555 (+ 184us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:53:05.820665 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:53:05.821665 (+ 1000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:05.822788 (+ 1123us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:05.823994 (+ 1206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:05.824474 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:05.824603 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:53:05.827849 (+ 3246us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:53:05.827859 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:53:05.827870 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:53:05.827896 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:53:05.830568 (+ 2672us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:53:05.831218 (+ 650us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:53:05.831224 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:53:05.831226 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:53:05.831338 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:53:05.831771 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:53:05.831776 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:53:05.831778 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:53:05.832091 (+ 313us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:53:05.832313 (+ 222us) server_negotiation.cc:1035] Waiting for connection context
0808 14:53:05.832679 (+ 366us) server_negotiation.cc:299] Negotiation successful
0808 14:53:05.832929 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":31,"server-negotiator.queue_time_us":623,"thread_start_us":469,"threads_started":1}
I20260808 14:53:05.835369 10528 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.206.252" port: 40859 } has no permanent_uuid. Determining permanent_uuid...
I20260808 14:53:05.836431 10531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:05.836020 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.252:40859 (local address 127.0.0.1:60944)
0808 14:53:05.836168 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0808 14:53:05.836294 (+ 126us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.252:40859: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260808 14:53:05.836743 10469 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.206.252:40859: connect: Connection refused (error 111)
I20260808 14:53:05.838303 10531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:05.837962 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.252:40859 (local address 127.0.0.1:60954)
0808 14:53:05.838132 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0808 14:53:05.838204 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.252:40859: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
W20260808 14:53:05.838609 10528 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.206.252:40859: Network error: Client connection negotiation failed: client connection to 127.26.206.252:40859: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.206.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.252.keytab.
Entry for principal kudu/127.26.206.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.252.keytab.
I20260808 14:53:05.858577 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200577490656-27451-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200577490656-27451-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200577490656-27451-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200577490656-27451-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.206.252:40859
--webserver_interface=127.26.206.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.252.keytab
--principal=kudu/127.26.206.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.206.212:44341
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.206.254:37933,127.26.206.253:42017,127.26.206.252:40859
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 14:53:05.887916 10528 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.206.252" port: 40859 } attempt: 1
I20260808 14:53:05.889122 10531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:05.888675 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.252:40859 (local address 127.0.0.1:60968)
0808 14:53:05.888867 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0808 14:53:05.888974 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.252:40859: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
I20260808 14:53:05.890113 10531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:05.889759 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.252:40859 (local address 127.0.0.1:60970)
0808 14:53:05.889936 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0808 14:53:05.890004 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.252:40859: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
W20260808 14:53:05.890331 10528 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.206.252:40859: Network error: Client connection negotiation failed: client connection to 127.26.206.252:40859: connect: Connection refused (error 111)
I20260808 14:53:05.958581 10528 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.206.252" port: 40859 } attempt: 2
I20260808 14:53:05.959822 10531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:05.959262 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.252:40859 (local address 127.0.0.1:60972)
0808 14:53:05.959474 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0808 14:53:05.959630 (+ 156us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.252:40859: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":85}
I20260808 14:53:05.960803 10531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:05.960469 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.252:40859 (local address 127.0.0.1:60982)
0808 14:53:05.960609 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0808 14:53:05.960685 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.252:40859: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260808 14:53:05.961042 10528 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.206.252:40859: Network error: Client connection negotiation failed: client connection to 127.26.206.252:40859: connect: Connection refused (error 111)
I20260808 14:53:05.991708 10441 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.206.253" port: 42017 } attempt: 5
Aug 08 14:53:05 dist-test-slave-6k22 krb5kdc[10350](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200785, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.254@KRBTEST.COM for kudu/127.26.206.253@KRBTEST.COM
I20260808 14:53:06.006242 10444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:05.992416 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.253:42017 (local address 127.0.0.1:47728)
0808 14:53:05.992662 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0808 14:53:05.992686 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0808 14:53:05.992849 (+ 163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:53:05.993218 (+ 369us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:53:05.993226 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:53:05.993811 (+ 585us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:53:05.994064 (+ 253us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:53:05.994076 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:53:05.995050 (+ 974us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:53:05.995056 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:53:05.996513 (+ 1457us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:53:05.996529 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:53:05.997223 (+ 694us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:53:05.997228 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:53:05.997451 (+ 223us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:53:05.998131 (+ 680us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:53:05.998153 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:53:06.000684 (+ 2531us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:53:06.003859 (+ 3175us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:53:06.003864 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:53:06.003869 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:53:06.004238 (+ 369us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:53:06.004609 (+ 371us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:53:06.004615 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:53:06.004618 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:53:06.004757 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:53:06.005273 (+ 516us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:53:06.005278 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:53:06.005436 (+ 158us) client_negotiation.cc:769] Sending connection context
0808 14:53:06.005579 (+ 143us) client_negotiation.cc:240] Negotiation successful
0808 14:53:06.005897 (+ 318us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":89}
I20260808 14:53:06.006238 10534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:05.992535 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47728 (local address 127.26.206.253:42017)
0808 14:53:05.992705 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0808 14:53:05.992709 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:53:05.992793 (+ 84us) server_negotiation.cc:407] Connection header received
0808 14:53:05.992993 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:53:05.992997 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:53:05.993057 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:53:05.993141 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:53:05.994227 (+ 1086us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:05.994908 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:05.996651 (+ 1743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:05.997063 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:05.997169 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:53:06.000892 (+ 3723us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:53:06.000915 (+ 23us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:53:06.000918 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:53:06.000947 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:53:06.003715 (+ 2768us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:53:06.004360 (+ 645us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:53:06.004367 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:53:06.004370 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:53:06.004496 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:53:06.004874 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:53:06.004879 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:53:06.004883 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:53:06.005154 (+ 271us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:53:06.005316 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0808 14:53:06.005689 (+ 373us) server_negotiation.cc:299] Negotiation successful
0808 14:53:06.005898 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260808 14:53:06.007273 10441 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.206.252" port: 40859 } has no permanent_uuid. Determining permanent_uuid...
I20260808 14:53:06.008348 10444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:06.007986 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.252:40859 (local address 127.0.0.1:60992)
0808 14:53:06.008141 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0808 14:53:06.008214 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.252:40859: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
I20260808 14:53:06.009245 10444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:06.008932 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.252:40859 (local address 127.0.0.1:32772)
0808 14:53:06.009065 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0808 14:53:06.009155 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.252:40859: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260808 14:53:06.009447 10441 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.206.252:40859: Network error: Client connection negotiation failed: client connection to 127.26.206.252:40859: connect: Connection refused (error 111)
I20260808 14:53:06.052263 10528 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.206.252" port: 40859 } attempt: 3
I20260808 14:53:06.053562 10531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:06.053004 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.252:40859 (local address 127.0.0.1:32784)
0808 14:53:06.053234 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0808 14:53:06.053340 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.252:40859: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76}
I20260808 14:53:06.054626 10531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:06.054200 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.252:40859 (local address 127.0.0.1:32788)
0808 14:53:06.054407 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0808 14:53:06.054514 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.252:40859: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114}
W20260808 14:53:06.054862 10528 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.206.252:40859: Network error: Client connection negotiation failed: client connection to 127.26.206.252:40859: connect: Connection refused (error 111)
I20260808 14:53:06.060668 10441 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.206.252" port: 40859 } attempt: 1
I20260808 14:53:06.061616 10444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:06.061211 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.252:40859 (local address 127.0.0.1:32796)
0808 14:53:06.061380 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0808 14:53:06.061480 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.252:40859: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
I20260808 14:53:06.062548 10444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:06.062226 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.252:40859 (local address 127.0.0.1:32806)
0808 14:53:06.062380 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0808 14:53:06.062453 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.252:40859: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260808 14:53:06.062747 10441 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.206.252:40859: Network error: Client connection negotiation failed: client connection to 127.26.206.252:40859: connect: Connection refused (error 111)
I20260808 14:53:06.130951 10441 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.206.252" port: 40859 } attempt: 2
I20260808 14:53:06.132200 10444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:06.131691 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.252:40859 (local address 127.0.0.1:32818)
0808 14:53:06.131938 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0808 14:53:06.132032 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.252:40859: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
I20260808 14:53:06.133184 10444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:06.132859 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.252:40859 (local address 127.0.0.1:32824)
0808 14:53:06.132999 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0808 14:53:06.133089 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.252:40859: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260808 14:53:06.133383 10441 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.206.252:40859: Network error: Client connection negotiation failed: client connection to 127.26.206.252:40859: connect: Connection refused (error 111)
W20260808 14:53:06.195545 10537 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:53:06.195963 10537 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:53:06.196117 10537 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260808 14:53:06.198160 10528 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.206.252" port: 40859 } attempt: 4
I20260808 14:53:06.199393 10531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:06.198820 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.252:40859 (local address 127.0.0.1:32838)
0808 14:53:06.199083 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0808 14:53:06.199192 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.252:40859: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":78}
I20260808 14:53:06.200429 10531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:06.200055 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.252:40859 (local address 127.0.0.1:32854)
0808 14:53:06.200215 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0808 14:53:06.200306 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.252:40859: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260808 14:53:06.200656 10528 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.206.252:40859: Network error: Client connection negotiation failed: client connection to 127.26.206.252:40859: connect: Connection refused (error 111)
W20260808 14:53:06.204128 10537 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:53:06.204242 10537 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:53:06.204344 10537 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:53:06.204440 10537 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:53:06.204524 10537 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:53:06.214208 10537 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:44341
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200577490656-27451-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200577490656-27451-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.26.206.254:37933,127.26.206.253:42017,127.26.206.252:40859
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.252.keytab
--principal=kudu/127.26.206.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.206.252:40859
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200577490656-27451-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.26.206.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200577490656-27451-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:53:06.215516 10537 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:53:06.216866 10537 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:53:06.228615 10545 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:53:06.228689 10543 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:53:06.228718 10542 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:53:06.229719 10537 server_base.cc:1034] running on GCE node
I20260808 14:53:06.230466 10537 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:53:06.231791 10537 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:53:06.233019 10537 hybrid_clock.cc:648] HybridClock initialized: now 1786200786232978 us; error 51 us; skew 500 ppm
I20260808 14:53:06.233351 10537 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:53:06 dist-test-slave-6k22 krb5kdc[10350](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200786, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:53:06.236372 10537 init.cc:377] Logged in from keytab as kudu/127.26.206.252@KRBTEST.COM (short username kudu)
I20260808 14:53:06.237691 10537 webserver.cc:460] Webserver started at http://127.26.206.252:38643/ using document root <none> and password file <none>
I20260808 14:53:06.238348 10537 fs_manager.cc:359] Metadata directory not provided
I20260808 14:53:06.238511 10537 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:53:06.238821 10537 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:53:06.239614 10441 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.206.252" port: 40859 } attempt: 3
I20260808 14:53:06.240644 10444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:06.240212 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.252:40859 (local address 127.0.0.1:32862)
0808 14:53:06.240418 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0808 14:53:06.240498 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.252:40859: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":93}
I20260808 14:53:06.241608 10444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:06.241252 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.252:40859 (local address 127.0.0.1:32866)
0808 14:53:06.241405 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0808 14:53:06.241471 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.252:40859: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260808 14:53:06.241854 10441 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.206.252:40859: Network error: Client connection negotiation failed: client connection to 127.26.206.252:40859: connect: Connection refused (error 111)
I20260808 14:53:06.242167 10537 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200577490656-27451-0/minicluster-data/master-2/data/instance:
uuid: "b4674be89c1a45b7bad9ec653182b48f"
format_stamp: "Formatted at 2026-08-08 14:53:06 on dist-test-slave-6k22"
server_key: "54681e4db08910ed560b1ed1c11091a3"
server_key_iv: "1ed4340845c67ef1d83c7cffbb93e846"
server_key_version: "encryptionkey@0"
I20260808 14:53:06.242956 10537 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200577490656-27451-0/minicluster-data/master-2/wal/instance:
uuid: "b4674be89c1a45b7bad9ec653182b48f"
format_stamp: "Formatted at 2026-08-08 14:53:06 on dist-test-slave-6k22"
server_key: "54681e4db08910ed560b1ed1c11091a3"
server_key_iv: "1ed4340845c67ef1d83c7cffbb93e846"
server_key_version: "encryptionkey@0"
I20260808 14:53:06.247905 10537 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260808 14:53:06.251119 10553 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:53:06.252516 10537 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 14:53:06.252687 10537 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200577490656-27451-0/minicluster-data/master-2/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200577490656-27451-0/minicluster-data/master-2/wal
uuid: "b4674be89c1a45b7bad9ec653182b48f"
format_stamp: "Formatted at 2026-08-08 14:53:06 on dist-test-slave-6k22"
server_key: "54681e4db08910ed560b1ed1c11091a3"
server_key_iv: "1ed4340845c67ef1d83c7cffbb93e846"
server_key_version: "encryptionkey@0"
I20260808 14:53:06.252960 10537 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200577490656-27451-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200577490656-27451-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200577490656-27451-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:53:06.271687 10537 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:53:06.275417 10537 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:53:06.275729 10537 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:53:06.294231 10537 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.252:40859
I20260808 14:53:06.294260 10605 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.252:40859 every 8 connection(s)
I20260808 14:53:06.295526 10537 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200577490656-27451-0/minicluster-data/master-2/data/info.pb
I20260808 14:53:06.299165 10606 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:53:06.304513 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 10537
I20260808 14:53:06.304702 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200577490656-27451-0/minicluster-data/master-2/wal/instance
I20260808 14:53:06.305162 27451 external_mini_cluster.cc:1428] Setting key 7e4234679aa33ac77c2134fbeb3abb89
I20260808 14:53:06.305496 10606 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.206.254" port: 37933 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 14:53:06 dist-test-slave-6k22 krb5kdc[10350](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200786, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.252@KRBTEST.COM for kudu/127.26.206.254@KRBTEST.COM
Aug 08 14:53:06 dist-test-slave-6k22 krb5kdc[10350](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200784, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.206.252@KRBTEST.COM
I20260808 14:53:06.325515 10443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:06.308314 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33044 (local address 127.26.206.254:37933)
0808 14:53:06.308492 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0808 14:53:06.308496 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:53:06.309312 (+ 816us) server_negotiation.cc:407] Connection header received
0808 14:53:06.310345 (+ 1033us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:53:06.310351 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:53:06.310429 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:53:06.310550 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:53:06.311936 (+ 1386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:06.312742 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:06.314511 (+ 1769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:06.315170 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:06.315309 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:53:06.319184 (+ 3875us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:53:06.319194 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:53:06.319202 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:53:06.319247 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:53:06.322119 (+ 2872us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:53:06.323082 (+ 963us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:53:06.323086 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:53:06.323088 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:53:06.323215 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:53:06.323706 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:53:06.323709 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:53:06.323711 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:53:06.323952 (+ 241us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:53:06.324063 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0808 14:53:06.324913 (+ 850us) server_negotiation.cc:299] Negotiation successful
0808 14:53:06.325170 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260808 14:53:06.326426 10610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:06.308416 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:37933 (local address 127.0.0.1:33044)
0808 14:53:06.309155 (+ 739us) negotiation.cc:107] Waiting for socket to connect
0808 14:53:06.309198 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 14:53:06.310101 (+ 903us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:53:06.310662 (+ 561us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:53:06.310668 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:53:06.311341 (+ 673us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:53:06.311762 (+ 421us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:53:06.311780 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:53:06.312908 (+ 1128us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:53:06.312913 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:53:06.314373 (+ 1460us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:53:06.314384 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:53:06.315407 (+ 1023us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:53:06.315414 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:53:06.315673 (+ 259us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:53:06.316441 (+ 768us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:53:06.316463 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:53:06.318969 (+ 2506us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:53:06.322274 (+ 3305us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:53:06.322288 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:53:06.322305 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:53:06.322969 (+ 664us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:53:06.323330 (+ 361us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:53:06.323337 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:53:06.323346 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:53:06.323588 (+ 242us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:53:06.324081 (+ 493us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:53:06.324089 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:53:06.324482 (+ 393us) client_negotiation.cc:769] Sending connection context
0808 14:53:06.324741 (+ 259us) client_negotiation.cc:240] Negotiation successful
0808 14:53:06.325090 (+ 349us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":550,"thread_start_us":399,"threads_started":1}
I20260808 14:53:06.328202 10609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:06.306953 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32868 (local address 127.26.206.252:40859)
0808 14:53:06.307728 (+ 775us) server_negotiation.cc:206] Beginning negotiation
0808 14:53:06.307737 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:53:06.307811 (+ 74us) server_negotiation.cc:407] Connection header received
0808 14:53:06.310092 (+ 2281us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:53:06.310111 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:53:06.310341 (+ 230us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:53:06.310494 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:53:06.312175 (+ 1681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:06.313664 (+ 1489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:06.315280 (+ 1616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:06.316103 (+ 823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:06.316248 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:53:06.321020 (+ 4772us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:53:06.321033 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:53:06.321048 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:53:06.321094 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:53:06.324392 (+ 3298us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:53:06.325313 (+ 921us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:53:06.325322 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:53:06.325327 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:53:06.325488 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:53:06.325962 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:53:06.325967 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:53:06.325970 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:53:06.326417 (+ 447us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:53:06.326704 (+ 287us) server_negotiation.cc:1035] Waiting for connection context
0808 14:53:06.327516 (+ 812us) server_negotiation.cc:299] Negotiation successful
0808 14:53:06.327800 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":574,"thread_start_us":382,"threads_started":1}
I20260808 14:53:06.328229 10606 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.206.253" port: 42017 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 14:53:06 dist-test-slave-6k22 krb5kdc[10350](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200786, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.252@KRBTEST.COM for kudu/127.26.206.253@KRBTEST.COM
Aug 08 14:53:06 dist-test-slave-6k22 krb5kdc[10350](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200784, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.206.254@KRBTEST.COM
I20260808 14:53:06.341254 10610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:06.328891 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.253:42017 (local address 127.0.0.1:47734)
0808 14:53:06.329044 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0808 14:53:06.329068 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0808 14:53:06.329173 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:53:06.329557 (+ 384us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:53:06.329561 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:53:06.329976 (+ 415us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:53:06.330196 (+ 220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:53:06.330205 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:53:06.331328 (+ 1123us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:53:06.331334 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:53:06.332245 (+ 911us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:53:06.332266 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:53:06.332962 (+ 696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:53:06.332967 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:53:06.333176 (+ 209us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:53:06.333713 (+ 537us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:53:06.333729 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:53:06.335810 (+ 2081us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:53:06.338836 (+ 3026us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:53:06.338841 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:53:06.338844 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:53:06.339242 (+ 398us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:53:06.339677 (+ 435us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:53:06.339682 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:53:06.339685 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:53:06.339852 (+ 167us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:53:06.340362 (+ 510us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:53:06.340367 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:53:06.340511 (+ 144us) client_negotiation.cc:769] Sending connection context
0808 14:53:06.340658 (+ 147us) client_negotiation.cc:240] Negotiation successful
0808 14:53:06.340909 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":51}
I20260808 14:53:06.341315 10534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:06.329110 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47734 (local address 127.26.206.253:42017)
0808 14:53:06.329298 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0808 14:53:06.329301 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:53:06.329317 (+ 16us) server_negotiation.cc:407] Connection header received
0808 14:53:06.329369 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:53:06.329373 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:53:06.329429 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:53:06.329506 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:53:06.330358 (+ 852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:06.331207 (+ 849us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:06.332395 (+ 1188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:06.332824 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:06.332955 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:53:06.336019 (+ 3064us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:53:06.336024 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:53:06.336027 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:53:06.336056 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:53:06.338696 (+ 2640us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:53:06.339356 (+ 660us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:53:06.339362 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:53:06.339366 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:53:06.339529 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:53:06.339961 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:53:06.339966 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:53:06.339969 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:53:06.340244 (+ 275us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:53:06.340406 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0808 14:53:06.340760 (+ 354us) server_negotiation.cc:299] Negotiation successful
0808 14:53:06.340967 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260808 14:53:06.342150 10606 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.206.252" port: 40859 } has no permanent_uuid. Determining permanent_uuid...
I20260808 14:53:06.344650 10443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:06.331068 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33056 (local address 127.26.206.254:37933)
0808 14:53:06.331213 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0808 14:53:06.331217 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:53:06.331231 (+ 14us) server_negotiation.cc:407] Connection header received
0808 14:53:06.331267 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:53:06.331270 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:53:06.331323 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:53:06.331429 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:53:06.332642 (+ 1213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:06.333341 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:06.334669 (+ 1328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:06.335042 (+ 373us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:06.335170 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:53:06.339046 (+ 3876us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:53:06.339050 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:53:06.339053 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:53:06.339080 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:53:06.341994 (+ 2914us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:53:06.342719 (+ 725us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:53:06.342731 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:53:06.342733 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:53:06.342850 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:53:06.343270 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:53:06.343273 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:53:06.343275 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:53:06.343694 (+ 419us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:53:06.343977 (+ 283us) server_negotiation.cc:1035] Waiting for connection context
0808 14:53:06.344136 (+ 159us) server_negotiation.cc:299] Negotiation successful
0808 14:53:06.344361 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
Aug 08 14:53:06 dist-test-slave-6k22 krb5kdc[10350](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200786, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.252@KRBTEST.COM for kudu/127.26.206.252@KRBTEST.COM
Aug 08 14:53:06 dist-test-slave-6k22 krb5kdc[10350](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200784, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.206.253@KRBTEST.COM
I20260808 14:53:06.354980 10610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:06.342801 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.252:40859 (local address 127.0.0.1:32882)
0808 14:53:06.342958 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0808 14:53:06.342975 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 14:53:06.343059 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:53:06.343470 (+ 411us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:53:06.343475 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:53:06.343965 (+ 490us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:53:06.344135 (+ 170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:53:06.344146 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:53:06.345208 (+ 1062us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:53:06.345212 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:53:06.346156 (+ 944us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:53:06.346171 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:53:06.346830 (+ 659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:53:06.346834 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:53:06.346971 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:53:06.347464 (+ 493us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:53:06.347488 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:53:06.349428 (+ 1940us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:53:06.352491 (+ 3063us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:53:06.352498 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:53:06.352501 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:53:06.352937 (+ 436us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:53:06.353308 (+ 371us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:53:06.353313 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:53:06.353317 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:53:06.353443 (+ 126us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:53:06.353985 (+ 542us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:53:06.353989 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:53:06.354145 (+ 156us) client_negotiation.cc:769] Sending connection context
0808 14:53:06.354320 (+ 175us) client_negotiation.cc:240] Negotiation successful
0808 14:53:06.354618 (+ 298us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":52}
I20260808 14:53:06.355059 10609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:06.343016 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32882 (local address 127.26.206.252:40859)
0808 14:53:06.343176 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0808 14:53:06.343184 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:53:06.343201 (+ 17us) server_negotiation.cc:407] Connection header received
0808 14:53:06.343248 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:53:06.343264 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:53:06.343325 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:53:06.343410 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:53:06.344297 (+ 887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:06.345054 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:06.346302 (+ 1248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:06.346694 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:06.346786 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:53:06.349602 (+ 2816us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:53:06.349606 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:53:06.349609 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:53:06.349647 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:53:06.352372 (+ 2725us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:53:06.353046 (+ 674us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:53:06.353053 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:53:06.353056 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:53:06.353205 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:53:06.353540 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:53:06.353547 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:53:06.353550 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:53:06.353882 (+ 332us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:53:06.354036 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0808 14:53:06.354405 (+ 369us) server_negotiation.cc:299] Negotiation successful
0808 14:53:06.354739 (+ 334us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":151,"server-negotiator.queue_time_us":55}
I20260808 14:53:06.359972 10606 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b4674be89c1a45b7bad9ec653182b48f: Bootstrap starting.
I20260808 14:53:06.360984 10534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:06.346270 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47738 (local address 127.26.206.253:42017)
0808 14:53:06.346408 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0808 14:53:06.346411 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:53:06.347072 (+ 661us) server_negotiation.cc:407] Connection header received
0808 14:53:06.347171 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:53:06.347178 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:53:06.347247 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:53:06.347358 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:53:06.348643 (+ 1285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:06.349376 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:06.350786 (+ 1410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:06.351273 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:06.351422 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:53:06.355781 (+ 4359us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:53:06.355787 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:53:06.355791 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:53:06.355828 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:53:06.358367 (+ 2539us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:53:06.359056 (+ 689us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:53:06.359063 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:53:06.359066 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:53:06.359202 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:53:06.359633 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:53:06.359643 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:53:06.359647 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:53:06.359886 (+ 239us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:53:06.360194 (+ 308us) server_negotiation.cc:1035] Waiting for connection context
0808 14:53:06.360470 (+ 276us) server_negotiation.cc:299] Negotiation successful
0808 14:53:06.360680 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260808 14:53:06.363612 10606 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b4674be89c1a45b7bad9ec653182b48f: Neither blocks nor log segments found. Creating new log.
I20260808 14:53:06.364923 10606 log.cc:824] T 00000000000000000000000000000000 P b4674be89c1a45b7bad9ec653182b48f: Log is configured to *not* fsync() on all Append() calls
I20260808 14:53:06.365671 27451 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:53:06.367700 10606 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b4674be89c1a45b7bad9ec653182b48f: No bootstrap required, opened a new log
I20260808 14:53:06.377936 10606 raft_consensus.cc:348] T 00000000000000000000000000000000 P b4674be89c1a45b7bad9ec653182b48f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e54b44f60274a6483c40f1507af9bcd" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 37933 } } peers { permanent_uuid: "aea8d26ac8894a2dbc3e8f6bfbca0232" member_type: VOTER last_known_addr { host: "127.26.206.253" port: 42017 } } peers { permanent_uuid: "b4674be89c1a45b7bad9ec653182b48f" member_type: VOTER last_known_addr { host: "127.26.206.252" port: 40859 } }
I20260808 14:53:06.378515 10606 raft_consensus.cc:374] T 00000000000000000000000000000000 P b4674be89c1a45b7bad9ec653182b48f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:53:06.378690 10606 raft_consensus.cc:729] T 00000000000000000000000000000000 P b4674be89c1a45b7bad9ec653182b48f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4674be89c1a45b7bad9ec653182b48f, State: Initialized, Role: FOLLOWER
I20260808 14:53:06.379909 10606 consensus_queue.cc:260] T 00000000000000000000000000000000 P b4674be89c1a45b7bad9ec653182b48f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e54b44f60274a6483c40f1507af9bcd" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 37933 } } peers { permanent_uuid: "aea8d26ac8894a2dbc3e8f6bfbca0232" member_type: VOTER last_known_addr { host: "127.26.206.253" port: 42017 } } peers { permanent_uuid: "b4674be89c1a45b7bad9ec653182b48f" member_type: VOTER last_known_addr { host: "127.26.206.252" port: 40859 } }
I20260808 14:53:06.387217 10621 sys_catalog.cc:455] T 00000000000000000000000000000000 P b4674be89c1a45b7bad9ec653182b48f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e54b44f60274a6483c40f1507af9bcd" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 37933 } } peers { permanent_uuid: "aea8d26ac8894a2dbc3e8f6bfbca0232" member_type: VOTER last_known_addr { host: "127.26.206.253" port: 42017 } } peers { permanent_uuid: "b4674be89c1a45b7bad9ec653182b48f" member_type: VOTER last_known_addr { host: "127.26.206.252" port: 40859 } } }
I20260808 14:53:06.387815 10621 sys_catalog.cc:458] T 00000000000000000000000000000000 P b4674be89c1a45b7bad9ec653182b48f [sys.catalog]: This master's current role is: FOLLOWER
I20260808 14:53:06.388731 10606 sys_catalog.cc:564] T 00000000000000000000000000000000 P b4674be89c1a45b7bad9ec653182b48f [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:53:06.391306 10534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:06.371280 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47748 (local address 127.26.206.253:42017)
0808 14:53:06.371434 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0808 14:53:06.371439 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:53:06.372149 (+ 710us) server_negotiation.cc:407] Connection header received
0808 14:53:06.372432 (+ 283us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:53:06.372437 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:53:06.372509 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:53:06.372569 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:53:06.374705 (+ 2136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:06.375890 (+ 1185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:06.378091 (+ 2201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:06.378776 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:06.378880 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:53:06.383614 (+ 4734us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:53:06.383623 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:53:06.383630 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:53:06.383676 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:53:06.387791 (+ 4115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:53:06.388837 (+ 1046us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:53:06.388842 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:53:06.388846 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:53:06.389013 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:53:06.389442 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:53:06.389450 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:53:06.389455 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:53:06.389862 (+ 407us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:53:06.390107 (+ 245us) server_negotiation.cc:1035] Waiting for connection context
0808 14:53:06.390681 (+ 574us) server_negotiation.cc:299] Negotiation successful
0808 14:53:06.390919 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260808 14:53:06.393498 10443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:06.370503 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33072 (local address 127.26.206.254:37933)
0808 14:53:06.370686 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0808 14:53:06.370693 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:53:06.371392 (+ 699us) server_negotiation.cc:407] Connection header received
0808 14:53:06.371475 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:53:06.371483 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:53:06.371618 (+ 135us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:53:06.371724 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:53:06.374438 (+ 2714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:06.375999 (+ 1561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:06.378923 (+ 2924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:06.379645 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:06.379757 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:53:06.383485 (+ 3728us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:53:06.383491 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:53:06.383495 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:53:06.383532 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:53:06.390344 (+ 6812us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:53:06.391383 (+ 1039us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:53:06.391390 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:53:06.391395 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:53:06.391568 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:53:06.392000 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:53:06.392005 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:53:06.392007 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:53:06.392271 (+ 264us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:53:06.392427 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0808 14:53:06.392877 (+ 450us) server_negotiation.cc:299] Negotiation successful
0808 14:53:06.393126 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260808 14:53:06.396544 10609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:06.372157 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32888 (local address 127.26.206.252:40859)
0808 14:53:06.372331 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0808 14:53:06.372338 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:53:06.378981 (+ 6643us) server_negotiation.cc:407] Connection header received
0808 14:53:06.379124 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:53:06.379129 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:53:06.379203 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:53:06.379329 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:53:06.381897 (+ 2568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:06.382994 (+ 1097us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:06.385015 (+ 2021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:06.385815 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:06.385912 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:53:06.389101 (+ 3189us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:53:06.389107 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:53:06.389111 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:53:06.389146 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:53:06.393233 (+ 4087us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:53:06.394476 (+ 1243us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:53:06.394481 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:53:06.394484 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:53:06.394677 (+ 193us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:53:06.395063 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:53:06.395067 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:53:06.395071 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:53:06.395474 (+ 403us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:53:06.395773 (+ 299us) server_negotiation.cc:1035] Waiting for connection context
0808 14:53:06.396130 (+ 357us) server_negotiation.cc:299] Negotiation successful
0808 14:53:06.396300 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
W20260808 14:53:06.404857 10635 catalog_manager.cc:1558] T 00000000000000000000000000000000 P b4674be89c1a45b7bad9ec653182b48f: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 14:53:06.405052 10635 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 14:53:06.403211 10537 master_runner.cc:186] Error getting master registration for 127.26.206.254:37933: OK, instance_id { permanent_uuid: "7e54b44f60274a6483c40f1507af9bcd" instance_seqno: 1786200785286496 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 14:53:06.411968 10537 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 14:53:06.419054 10441 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.206.252" port: 40859 } attempt: 4
Aug 08 14:53:06 dist-test-slave-6k22 krb5kdc[10350](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200785, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.254@KRBTEST.COM for kudu/127.26.206.252@KRBTEST.COM
I20260808 14:53:06.434664 10444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:06.419627 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.252:40859 (local address 127.0.0.1:32900)
0808 14:53:06.419826 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0808 14:53:06.419847 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 14:53:06.419951 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:53:06.420255 (+ 304us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:53:06.420260 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:53:06.420756 (+ 496us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:53:06.420968 (+ 212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:53:06.420980 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:53:06.422310 (+ 1330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:53:06.422316 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:53:06.423899 (+ 1583us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:53:06.423914 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:53:06.424987 (+ 1073us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:53:06.424994 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:53:06.425139 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:53:06.425775 (+ 636us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:53:06.425791 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:53:06.428113 (+ 2322us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:53:06.432365 (+ 4252us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:53:06.432369 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:53:06.432378 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:53:06.432734 (+ 356us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:53:06.433155 (+ 421us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:53:06.433158 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:53:06.433160 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:53:06.433305 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:53:06.433936 (+ 631us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:53:06.433939 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:53:06.434082 (+ 143us) client_negotiation.cc:769] Sending connection context
0808 14:53:06.434198 (+ 116us) client_negotiation.cc:240] Negotiation successful
0808 14:53:06.434390 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":66}
I20260808 14:53:06.434950 10609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:06.419724 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32900 (local address 127.26.206.252:40859)
0808 14:53:06.419885 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0808 14:53:06.419890 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:53:06.419916 (+ 26us) server_negotiation.cc:407] Connection header received
0808 14:53:06.420059 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:53:06.420063 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:53:06.420113 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:53:06.420186 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:53:06.421243 (+ 1057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:06.422152 (+ 909us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:06.424071 (+ 1919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:06.424808 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:06.424942 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:53:06.428317 (+ 3375us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:53:06.428323 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:53:06.428330 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:53:06.428367 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:53:06.432228 (+ 3861us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:53:06.432868 (+ 640us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:53:06.432874 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:53:06.432878 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:53:06.433048 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:53:06.433422 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:53:06.433427 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:53:06.433431 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:53:06.433814 (+ 383us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:53:06.433963 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0808 14:53:06.434340 (+ 377us) server_negotiation.cc:299] Negotiation successful
0808 14:53:06.434576 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260808 14:53:06.439338 10441 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7e54b44f60274a6483c40f1507af9bcd: Bootstrap starting.
I20260808 14:53:06.442646 10441 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7e54b44f60274a6483c40f1507af9bcd: Neither blocks nor log segments found. Creating new log.
I20260808 14:53:06.444052 10441 log.cc:824] T 00000000000000000000000000000000 P 7e54b44f60274a6483c40f1507af9bcd: Log is configured to *not* fsync() on all Append() calls
I20260808 14:53:06.447046 10441 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7e54b44f60274a6483c40f1507af9bcd: No bootstrap required, opened a new log
I20260808 14:53:06.454653 10441 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7e54b44f60274a6483c40f1507af9bcd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e54b44f60274a6483c40f1507af9bcd" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 37933 } } peers { permanent_uuid: "aea8d26ac8894a2dbc3e8f6bfbca0232" member_type: VOTER last_known_addr { host: "127.26.206.253" port: 42017 } } peers { permanent_uuid: "b4674be89c1a45b7bad9ec653182b48f" member_type: VOTER last_known_addr { host: "127.26.206.252" port: 40859 } }
I20260808 14:53:06.455155 10441 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7e54b44f60274a6483c40f1507af9bcd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:53:06.455341 10441 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7e54b44f60274a6483c40f1507af9bcd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e54b44f60274a6483c40f1507af9bcd, State: Initialized, Role: FOLLOWER
I20260808 14:53:06.456244 10441 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7e54b44f60274a6483c40f1507af9bcd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e54b44f60274a6483c40f1507af9bcd" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 37933 } } peers { permanent_uuid: "aea8d26ac8894a2dbc3e8f6bfbca0232" member_type: VOTER last_known_addr { host: "127.26.206.253" port: 42017 } } peers { permanent_uuid: "b4674be89c1a45b7bad9ec653182b48f" member_type: VOTER last_known_addr { host: "127.26.206.252" port: 40859 } }
I20260808 14:53:06.457237 10639 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7e54b44f60274a6483c40f1507af9bcd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e54b44f60274a6483c40f1507af9bcd" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 37933 } } peers { permanent_uuid: "aea8d26ac8894a2dbc3e8f6bfbca0232" member_type: VOTER last_known_addr { host: "127.26.206.253" port: 42017 } } peers { permanent_uuid: "b4674be89c1a45b7bad9ec653182b48f" member_type: VOTER last_known_addr { host: "127.26.206.252" port: 40859 } } }
I20260808 14:53:06.457628 10639 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7e54b44f60274a6483c40f1507af9bcd [sys.catalog]: This master's current role is: FOLLOWER
I20260808 14:53:06.458457 10441 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7e54b44f60274a6483c40f1507af9bcd [sys.catalog]: configured and running, proceeding with master startup.
W20260808 14:53:06.472496 10654 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 7e54b44f60274a6483c40f1507af9bcd: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 14:53:06.472705 10654 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 14:53:06.468250 10364 master_runner.cc:186] Error getting master registration for 127.26.206.253:42017: OK, instance_id { permanent_uuid: "aea8d26ac8894a2dbc3e8f6bfbca0232" instance_seqno: 1786200785778413 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 14:53:06.477128 10364 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 14:53:06.499889 10528 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.206.252" port: 40859 } attempt: 5
Aug 08 14:53:06 dist-test-slave-6k22 krb5kdc[10350](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200785, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.253@KRBTEST.COM for kudu/127.26.206.252@KRBTEST.COM
I20260808 14:53:06.516078 10531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:06.500486 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.252:40859 (local address 127.0.0.1:32906)
0808 14:53:06.500709 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0808 14:53:06.500729 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 14:53:06.500888 (+ 159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:53:06.501218 (+ 330us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:53:06.501222 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:53:06.501678 (+ 456us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:53:06.501850 (+ 172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:53:06.501858 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:53:06.502905 (+ 1047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:53:06.502912 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:53:06.503874 (+ 962us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:53:06.503886 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:53:06.504634 (+ 748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:53:06.504639 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:53:06.504846 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:53:06.505471 (+ 625us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:53:06.505489 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:53:06.507458 (+ 1969us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:53:06.513565 (+ 6107us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:53:06.513571 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:53:06.513575 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:53:06.513953 (+ 378us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:53:06.514331 (+ 378us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:53:06.514336 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:53:06.514339 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:53:06.514499 (+ 160us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:53:06.515046 (+ 547us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:53:06.515050 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:53:06.515194 (+ 144us) client_negotiation.cc:769] Sending connection context
0808 14:53:06.515341 (+ 147us) client_negotiation.cc:240] Negotiation successful
0808 14:53:06.515659 (+ 318us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124}
I20260808 14:53:06.516134 10609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:06.500535 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32906 (local address 127.26.206.252:40859)
0808 14:53:06.500704 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0808 14:53:06.500710 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:53:06.500817 (+ 107us) server_negotiation.cc:407] Connection header received
0808 14:53:06.501005 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:53:06.501010 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:53:06.501079 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:53:06.501193 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:53:06.501998 (+ 805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:06.502755 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:06.504024 (+ 1269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:06.504493 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:06.504627 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:53:06.507671 (+ 3044us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:53:06.507676 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:53:06.507679 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:53:06.507773 (+ 94us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:53:06.513411 (+ 5638us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:53:06.514078 (+ 667us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:53:06.514083 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:53:06.514086 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:53:06.514207 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:53:06.514614 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:53:06.514618 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:53:06.514622 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:53:06.514929 (+ 307us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:53:06.515082 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0808 14:53:06.515444 (+ 362us) server_negotiation.cc:299] Negotiation successful
0808 14:53:06.515744 (+ 300us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260808 14:53:06.521207 10528 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aea8d26ac8894a2dbc3e8f6bfbca0232: Bootstrap starting.
I20260808 14:53:06.524483 10528 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P aea8d26ac8894a2dbc3e8f6bfbca0232: Neither blocks nor log segments found. Creating new log.
I20260808 14:53:06.525589 10528 log.cc:824] T 00000000000000000000000000000000 P aea8d26ac8894a2dbc3e8f6bfbca0232: Log is configured to *not* fsync() on all Append() calls
W20260808 14:53:06.526276 10394 tablet.cc:2369] T 00000000000000000000000000000000 P 7e54b44f60274a6483c40f1507af9bcd: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 14:53:06.527711 10559 tablet.cc:2369] T 00000000000000000000000000000000 P b4674be89c1a45b7bad9ec653182b48f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:53:06.528682 10528 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aea8d26ac8894a2dbc3e8f6bfbca0232: No bootstrap required, opened a new log
I20260808 14:53:06.539883 10528 raft_consensus.cc:348] T 00000000000000000000000000000000 P aea8d26ac8894a2dbc3e8f6bfbca0232 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e54b44f60274a6483c40f1507af9bcd" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 37933 } } peers { permanent_uuid: "aea8d26ac8894a2dbc3e8f6bfbca0232" member_type: VOTER last_known_addr { host: "127.26.206.253" port: 42017 } } peers { permanent_uuid: "b4674be89c1a45b7bad9ec653182b48f" member_type: VOTER last_known_addr { host: "127.26.206.252" port: 40859 } }
I20260808 14:53:06.540315 10528 raft_consensus.cc:374] T 00000000000000000000000000000000 P aea8d26ac8894a2dbc3e8f6bfbca0232 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:53:06.540441 10528 raft_consensus.cc:729] T 00000000000000000000000000000000 P aea8d26ac8894a2dbc3e8f6bfbca0232 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aea8d26ac8894a2dbc3e8f6bfbca0232, State: Initialized, Role: FOLLOWER
I20260808 14:53:06.541121 10528 consensus_queue.cc:260] T 00000000000000000000000000000000 P aea8d26ac8894a2dbc3e8f6bfbca0232 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e54b44f60274a6483c40f1507af9bcd" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 37933 } } peers { permanent_uuid: "aea8d26ac8894a2dbc3e8f6bfbca0232" member_type: VOTER last_known_addr { host: "127.26.206.253" port: 42017 } } peers { permanent_uuid: "b4674be89c1a45b7bad9ec653182b48f" member_type: VOTER last_known_addr { host: "127.26.206.252" port: 40859 } }
I20260808 14:53:06.542119 10658 sys_catalog.cc:455] T 00000000000000000000000000000000 P aea8d26ac8894a2dbc3e8f6bfbca0232 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e54b44f60274a6483c40f1507af9bcd" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 37933 } } peers { permanent_uuid: "aea8d26ac8894a2dbc3e8f6bfbca0232" member_type: VOTER last_known_addr { host: "127.26.206.253" port: 42017 } } peers { permanent_uuid: "b4674be89c1a45b7bad9ec653182b48f" member_type: VOTER last_known_addr { host: "127.26.206.252" port: 40859 } } }
I20260808 14:53:06.542596 10658 sys_catalog.cc:458] T 00000000000000000000000000000000 P aea8d26ac8894a2dbc3e8f6bfbca0232 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 14:53:06.543416 10528 sys_catalog.cc:564] T 00000000000000000000000000000000 P aea8d26ac8894a2dbc3e8f6bfbca0232 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:53:06.574146 10448 master_runner.cc:263] No leader master found from master aea8d26ac8894a2dbc3e8f6bfbca0232
I20260808 14:53:06.574381 10448 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260808 14:53:06.577404 10671 catalog_manager.cc:1558] T 00000000000000000000000000000000 P aea8d26ac8894a2dbc3e8f6bfbca0232: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 14:53:06.577638 10671 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 14:53:06.584859 10621 raft_consensus.cc:482] T 00000000000000000000000000000000 P b4674be89c1a45b7bad9ec653182b48f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:53:06.585153 10621 raft_consensus.cc:504] T 00000000000000000000000000000000 P b4674be89c1a45b7bad9ec653182b48f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e54b44f60274a6483c40f1507af9bcd" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 37933 } } peers { permanent_uuid: "aea8d26ac8894a2dbc3e8f6bfbca0232" member_type: VOTER last_known_addr { host: "127.26.206.253" port: 42017 } } peers { permanent_uuid: "b4674be89c1a45b7bad9ec653182b48f" member_type: VOTER last_known_addr { host: "127.26.206.252" port: 40859 } }
I20260808 14:53:06.586678 10621 leader_election.cc:288] T 00000000000000000000000000000000 P b4674be89c1a45b7bad9ec653182b48f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e54b44f60274a6483c40f1507af9bcd (127.26.206.254:37933), aea8d26ac8894a2dbc3e8f6bfbca0232 (127.26.206.253:42017)
I20260808 14:53:06.588202 10416 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b4674be89c1a45b7bad9ec653182b48f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e54b44f60274a6483c40f1507af9bcd" is_pre_election: true
I20260808 14:53:06.588863 10416 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 7e54b44f60274a6483c40f1507af9bcd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b4674be89c1a45b7bad9ec653182b48f in term 0.
I20260808 14:53:06.589516 10499 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b4674be89c1a45b7bad9ec653182b48f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aea8d26ac8894a2dbc3e8f6bfbca0232" is_pre_election: true
I20260808 14:53:06.590051 10499 raft_consensus.cc:2454] T 00000000000000000000000000000000 P aea8d26ac8894a2dbc3e8f6bfbca0232 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b4674be89c1a45b7bad9ec653182b48f in term 0.
I20260808 14:53:06.590996 10557 leader_election.cc:302] T 00000000000000000000000000000000 P b4674be89c1a45b7bad9ec653182b48f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e54b44f60274a6483c40f1507af9bcd, b4674be89c1a45b7bad9ec653182b48f; no voters:
I20260808 14:53:06.592734 10621 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b4674be89c1a45b7bad9ec653182b48f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:53:06.592907 10621 raft_consensus.cc:482] T 00000000000000000000000000000000 P b4674be89c1a45b7bad9ec653182b48f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:53:06.593032 10621 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b4674be89c1a45b7bad9ec653182b48f [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:53:06.596421 10621 raft_consensus.cc:504] T 00000000000000000000000000000000 P b4674be89c1a45b7bad9ec653182b48f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e54b44f60274a6483c40f1507af9bcd" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 37933 } } peers { permanent_uuid: "aea8d26ac8894a2dbc3e8f6bfbca0232" member_type: VOTER last_known_addr { host: "127.26.206.253" port: 42017 } } peers { permanent_uuid: "b4674be89c1a45b7bad9ec653182b48f" member_type: VOTER last_known_addr { host: "127.26.206.252" port: 40859 } }
I20260808 14:53:06.597676 10416 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b4674be89c1a45b7bad9ec653182b48f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e54b44f60274a6483c40f1507af9bcd"
I20260808 14:53:06.597900 10416 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7e54b44f60274a6483c40f1507af9bcd [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:53:06.601449 10416 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 7e54b44f60274a6483c40f1507af9bcd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4674be89c1a45b7bad9ec653182b48f in term 1.
I20260808 14:53:06.601964 10557 leader_election.cc:302] T 00000000000000000000000000000000 P b4674be89c1a45b7bad9ec653182b48f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e54b44f60274a6483c40f1507af9bcd, b4674be89c1a45b7bad9ec653182b48f; no voters:
I20260808 14:53:06.604110 10621 leader_election.cc:288] T 00000000000000000000000000000000 P b4674be89c1a45b7bad9ec653182b48f [CANDIDATE]: Term 1 election: Requested vote from peers 7e54b44f60274a6483c40f1507af9bcd (127.26.206.254:37933), aea8d26ac8894a2dbc3e8f6bfbca0232 (127.26.206.253:42017)
I20260808 14:53:06.604606 10621 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b4674be89c1a45b7bad9ec653182b48f [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:53:06.605008 10621 raft_consensus.cc:686] T 00000000000000000000000000000000 P b4674be89c1a45b7bad9ec653182b48f [term 1 LEADER]: Becoming Leader. State: Replica: b4674be89c1a45b7bad9ec653182b48f, State: Running, Role: LEADER
I20260808 14:53:06.605757 10621 consensus_queue.cc:237] T 00000000000000000000000000000000 P b4674be89c1a45b7bad9ec653182b48f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e54b44f60274a6483c40f1507af9bcd" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 37933 } } peers { permanent_uuid: "aea8d26ac8894a2dbc3e8f6bfbca0232" member_type: VOTER last_known_addr { host: "127.26.206.253" port: 42017 } } peers { permanent_uuid: "b4674be89c1a45b7bad9ec653182b48f" member_type: VOTER last_known_addr { host: "127.26.206.252" port: 40859 } }
I20260808 14:53:06.618283 10499 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b4674be89c1a45b7bad9ec653182b48f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aea8d26ac8894a2dbc3e8f6bfbca0232"
I20260808 14:53:06.618561 10499 raft_consensus.cc:3037] T 00000000000000000000000000000000 P aea8d26ac8894a2dbc3e8f6bfbca0232 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:53:06.622042 10499 raft_consensus.cc:2454] T 00000000000000000000000000000000 P aea8d26ac8894a2dbc3e8f6bfbca0232 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4674be89c1a45b7bad9ec653182b48f in term 1.
I20260808 14:53:06.626392 10674 sys_catalog.cc:455] T 00000000000000000000000000000000 P b4674be89c1a45b7bad9ec653182b48f [sys.catalog]: SysCatalogTable state changed. Reason: New leader b4674be89c1a45b7bad9ec653182b48f. Latest consensus state: current_term: 1 leader_uuid: "b4674be89c1a45b7bad9ec653182b48f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e54b44f60274a6483c40f1507af9bcd" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 37933 } } peers { permanent_uuid: "aea8d26ac8894a2dbc3e8f6bfbca0232" member_type: VOTER last_known_addr { host: "127.26.206.253" port: 42017 } } peers { permanent_uuid: "b4674be89c1a45b7bad9ec653182b48f" member_type: VOTER last_known_addr { host: "127.26.206.252" port: 40859 } } }
I20260808 14:53:06.626950 10674 sys_catalog.cc:458] T 00000000000000000000000000000000 P b4674be89c1a45b7bad9ec653182b48f [sys.catalog]: This master's current role is: LEADER
I20260808 14:53:06.640188 10676 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:53:06.642709 10676 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:53:06.670670 10499 raft_consensus.cc:1261] T 00000000000000000000000000000000 P aea8d26ac8894a2dbc3e8f6bfbca0232 [term 1 FOLLOWER]: Refusing update from remote peer b4674be89c1a45b7bad9ec653182b48f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:53:06.670920 10416 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 7e54b44f60274a6483c40f1507af9bcd [term 1 FOLLOWER]: Refusing update from remote peer b4674be89c1a45b7bad9ec653182b48f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:53:06.671936 10674 consensus_queue.cc:1035] T 00000000000000000000000000000000 P b4674be89c1a45b7bad9ec653182b48f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e54b44f60274a6483c40f1507af9bcd" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 37933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:53:06.672839 10621 consensus_queue.cc:1035] T 00000000000000000000000000000000 P b4674be89c1a45b7bad9ec653182b48f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aea8d26ac8894a2dbc3e8f6bfbca0232" member_type: VOTER last_known_addr { host: "127.26.206.253" port: 42017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:53:06.719713 10639 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7e54b44f60274a6483c40f1507af9bcd [sys.catalog]: SysCatalogTable state changed. Reason: New leader b4674be89c1a45b7bad9ec653182b48f. Latest consensus state: current_term: 1 leader_uuid: "b4674be89c1a45b7bad9ec653182b48f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e54b44f60274a6483c40f1507af9bcd" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 37933 } } peers { permanent_uuid: "aea8d26ac8894a2dbc3e8f6bfbca0232" member_type: VOTER last_known_addr { host: "127.26.206.253" port: 42017 } } peers { permanent_uuid: "b4674be89c1a45b7bad9ec653182b48f" member_type: VOTER last_known_addr { host: "127.26.206.252" port: 40859 } } }
I20260808 14:53:06.720070 10639 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7e54b44f60274a6483c40f1507af9bcd [sys.catalog]: This master's current role is: FOLLOWER
I20260808 14:53:06.728739 10681 mvcc.cc:205] Tried to move back new op lower bound from 7316278422184108032 to 7316278421949140992. Current Snapshot: MvccSnapshot[applied={T|T < 7316278422184108032}]
I20260808 14:53:06.733633 10658 sys_catalog.cc:455] T 00000000000000000000000000000000 P aea8d26ac8894a2dbc3e8f6bfbca0232 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b4674be89c1a45b7bad9ec653182b48f. Latest consensus state: current_term: 1 leader_uuid: "b4674be89c1a45b7bad9ec653182b48f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e54b44f60274a6483c40f1507af9bcd" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 37933 } } peers { permanent_uuid: "aea8d26ac8894a2dbc3e8f6bfbca0232" member_type: VOTER last_known_addr { host: "127.26.206.253" port: 42017 } } peers { permanent_uuid: "b4674be89c1a45b7bad9ec653182b48f" member_type: VOTER last_known_addr { host: "127.26.206.252" port: 40859 } } }
I20260808 14:53:06.733958 10658 sys_catalog.cc:458] T 00000000000000000000000000000000 P aea8d26ac8894a2dbc3e8f6bfbca0232 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 14:53:06.741142 10682 mvcc.cc:205] Tried to move back new op lower bound from 7316278422184108032 to 7316278421949140992. Current Snapshot: MvccSnapshot[applied={T|T < 7316278422184108032}]
I20260808 14:53:06.741681 10639 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7e54b44f60274a6483c40f1507af9bcd [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b4674be89c1a45b7bad9ec653182b48f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e54b44f60274a6483c40f1507af9bcd" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 37933 } } peers { permanent_uuid: "aea8d26ac8894a2dbc3e8f6bfbca0232" member_type: VOTER last_known_addr { host: "127.26.206.253" port: 42017 } } peers { permanent_uuid: "b4674be89c1a45b7bad9ec653182b48f" member_type: VOTER last_known_addr { host: "127.26.206.252" port: 40859 } } }
I20260808 14:53:06.741959 10639 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7e54b44f60274a6483c40f1507af9bcd [sys.catalog]: This master's current role is: FOLLOWER
I20260808 14:53:06.751351 10658 sys_catalog.cc:455] T 00000000000000000000000000000000 P aea8d26ac8894a2dbc3e8f6bfbca0232 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b4674be89c1a45b7bad9ec653182b48f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e54b44f60274a6483c40f1507af9bcd" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 37933 } } peers { permanent_uuid: "aea8d26ac8894a2dbc3e8f6bfbca0232" member_type: VOTER last_known_addr { host: "127.26.206.253" port: 42017 } } peers { permanent_uuid: "b4674be89c1a45b7bad9ec653182b48f" member_type: VOTER last_known_addr { host: "127.26.206.252" port: 40859 } } }
I20260808 14:53:06.751611 10658 sys_catalog.cc:458] T 00000000000000000000000000000000 P aea8d26ac8894a2dbc3e8f6bfbca0232 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 14:53:06.756184 10621 sys_catalog.cc:455] T 00000000000000000000000000000000 P b4674be89c1a45b7bad9ec653182b48f [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b4674be89c1a45b7bad9ec653182b48f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e54b44f60274a6483c40f1507af9bcd" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 37933 } } peers { permanent_uuid: "aea8d26ac8894a2dbc3e8f6bfbca0232" member_type: VOTER last_known_addr { host: "127.26.206.253" port: 42017 } } peers { permanent_uuid: "b4674be89c1a45b7bad9ec653182b48f" member_type: VOTER last_known_addr { host: "127.26.206.252" port: 40859 } } }
I20260808 14:53:06.756525 10621 sys_catalog.cc:458] T 00000000000000000000000000000000 P b4674be89c1a45b7bad9ec653182b48f [sys.catalog]: This master's current role is: LEADER
I20260808 14:53:06.756933 10621 sys_catalog.cc:455] T 00000000000000000000000000000000 P b4674be89c1a45b7bad9ec653182b48f [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b4674be89c1a45b7bad9ec653182b48f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e54b44f60274a6483c40f1507af9bcd" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 37933 } } peers { permanent_uuid: "aea8d26ac8894a2dbc3e8f6bfbca0232" member_type: VOTER last_known_addr { host: "127.26.206.253" port: 42017 } } peers { permanent_uuid: "b4674be89c1a45b7bad9ec653182b48f" member_type: VOTER last_known_addr { host: "127.26.206.252" port: 40859 } } }
I20260808 14:53:06.757186 10621 sys_catalog.cc:458] T 00000000000000000000000000000000 P b4674be89c1a45b7bad9ec653182b48f [sys.catalog]: This master's current role is: LEADER
I20260808 14:53:06.759070 10676 catalog_manager.cc:1347] Generated new cluster ID: e61c6258279a4c409740b479914f19d6
I20260808 14:53:06.759172 10676 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:53:06.785724 10676 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:53:06.787510 10676 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:53:06.816021 10676 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b4674be89c1a45b7bad9ec653182b48f: Generated new TSK 0
I20260808 14:53:06.820756 10676 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:53:07.474643 10654 catalog_manager.cc:1259] Loaded cluster ID: e61c6258279a4c409740b479914f19d6
I20260808 14:53:07.474794 10654 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 7e54b44f60274a6483c40f1507af9bcd: loading cluster ID for follower catalog manager: success
I20260808 14:53:07.477231 10654 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 7e54b44f60274a6483c40f1507af9bcd: acquiring CA information for follower catalog manager: success
I20260808 14:53:07.479010 10654 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 7e54b44f60274a6483c40f1507af9bcd: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 14:53:07.579797 10671 catalog_manager.cc:1259] Loaded cluster ID: e61c6258279a4c409740b479914f19d6
I20260808 14:53:07.579942 10671 catalog_manager.cc:1552] T 00000000000000000000000000000000 P aea8d26ac8894a2dbc3e8f6bfbca0232: loading cluster ID for follower catalog manager: success
I20260808 14:53:07.582397 10671 catalog_manager.cc:1574] T 00000000000000000000000000000000 P aea8d26ac8894a2dbc3e8f6bfbca0232: acquiring CA information for follower catalog manager: success
I20260808 14:53:07.584205 10671 catalog_manager.cc:1602] T 00000000000000000000000000000000 P aea8d26ac8894a2dbc3e8f6bfbca0232: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 14:53:07.983126 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 10364
I20260808 14:53:07.984282 10436 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:53:08.094039 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 10364
I20260808 14:53:08.119737 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 10448
I20260808 14:53:08.120893 10522 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:53:08.230218 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 10448
I20260808 14:53:08.253312 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 10537
I20260808 14:53:08.254484 10601 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:53:08.361368 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 10537
2026-08-08T14:53:08Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (5018 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786200577490656-27451-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:53:08 dist-test-slave-6k22 krb5kdc[10700](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:53:08 dist-test-slave-6k22 krb5kdc[10700](info): set up 2 sockets
Aug 08 14:53:08 dist-test-slave-6k22 krb5kdc[10700](info): commencing operation
krb5kdc: starting...
W20260808 14:53:09.533874 27451 mini_kdc.cc:121] Time spent starting KDC: real 1.126s user 0.000s sys 0.035s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786200577490656-27451-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786200577490656-27451-0/krb5kdc/test-user.keytab.
Aug 08 14:53:09 dist-test-slave-6k22 krb5kdc[10700](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200789, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:53:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:53:09Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.206.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.206.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.206.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.254.keytab.
Entry for principal kudu/127.26.206.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.254.keytab.
I20260808 14:53:09.799211 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786200577490656-27451-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786200577490656-27451-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786200577490656-27451-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.206.254:33883
--webserver_interface=127.26.206.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.254.keytab
--principal=kudu/127.26.206.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.206.212:39937
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.206.254:33883
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:53:10.136229 10713 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:53:10.136484 10713 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:53:10.136641 10713 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:53:10.143546 10713 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:53:10.143659 10713 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:53:10.143788 10713 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:53:10.143896 10713 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:53:10.143980 10713 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:53:10.153136 10713 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:39937
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786200577490656-27451-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786200577490656-27451-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.206.254:33883
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.254.keytab
--principal=kudu/127.26.206.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.206.254:33883
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.206.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786200577490656-27451-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:53:10.154297 10713 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:53:10.155539 10713 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:53:10.166930 10718 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:53:10.166981 10719 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:53:10.167011 10721 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:53:10.167964 10713 server_base.cc:1034] running on GCE node
I20260808 14:53:10.168735 10713 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:53:10.169935 10713 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:53:10.171133 10713 hybrid_clock.cc:648] HybridClock initialized: now 1786200790171098 us; error 26 us; skew 500 ppm
I20260808 14:53:10.171473 10713 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:53:10 dist-test-slave-6k22 krb5kdc[10700](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200790, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:53:10.175511 10713 init.cc:377] Logged in from keytab as kudu/127.26.206.254@KRBTEST.COM (short username kudu)
I20260808 14:53:10.177497 10713 webserver.cc:460] Webserver started at http://127.26.206.254:40737/ using document root <none> and password file <none>
I20260808 14:53:10.178323 10713 fs_manager.cc:359] Metadata directory not provided
I20260808 14:53:10.178499 10713 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:53:10.178820 10713 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:53:10.181905 10713 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786200577490656-27451-0/minicluster-data/master-0/data/instance:
uuid: "debebb372bda46a29992b2d5a6b38151"
format_stamp: "Formatted at 2026-08-08 14:53:10 on dist-test-slave-6k22"
server_key: "acffbd30c178bed3fa8991d4afda9a0e"
server_key_iv: "ddf3850b7e28c027c562288dc2540a28"
server_key_version: "encryptionkey@0"
I20260808 14:53:10.182643 10713 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786200577490656-27451-0/minicluster-data/master-0/wal/instance:
uuid: "debebb372bda46a29992b2d5a6b38151"
format_stamp: "Formatted at 2026-08-08 14:53:10 on dist-test-slave-6k22"
server_key: "acffbd30c178bed3fa8991d4afda9a0e"
server_key_iv: "ddf3850b7e28c027c562288dc2540a28"
server_key_version: "encryptionkey@0"
I20260808 14:53:10.188174 10713 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.005s
I20260808 14:53:10.191421 10730 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:53:10.192689 10713 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 14:53:10.192822 10713 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786200577490656-27451-0/minicluster-data/master-0/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786200577490656-27451-0/minicluster-data/master-0/wal
uuid: "debebb372bda46a29992b2d5a6b38151"
format_stamp: "Formatted at 2026-08-08 14:53:10 on dist-test-slave-6k22"
server_key: "acffbd30c178bed3fa8991d4afda9a0e"
server_key_iv: "ddf3850b7e28c027c562288dc2540a28"
server_key_version: "encryptionkey@0"
I20260808 14:53:10.192977 10713 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786200577490656-27451-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786200577490656-27451-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786200577490656-27451-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:53:10.224241 10713 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:53:10.228538 10713 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:53:10.228772 10713 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:53:10.246603 10713 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.254:33883
I20260808 14:53:10.246632 10784 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.254:33883 every 8 connection(s)
I20260808 14:53:10.248013 10713 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
I20260808 14:53:10.251623 10785 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:53:10.255940 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 10713
I20260808 14:53:10.256177 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786200577490656-27451-0/minicluster-data/master-0/wal/instance
I20260808 14:53:10.257041 27451 external_mini_cluster.cc:1428] Setting key 86d5971aeb5294f9d0a3bbfe85f0b024
I20260808 14:53:10.263051 10785 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P debebb372bda46a29992b2d5a6b38151: Bootstrap starting.
I20260808 14:53:10.266546 10785 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P debebb372bda46a29992b2d5a6b38151: Neither blocks nor log segments found. Creating new log.
I20260808 14:53:10.267807 10785 log.cc:824] T 00000000000000000000000000000000 P debebb372bda46a29992b2d5a6b38151: Log is configured to *not* fsync() on all Append() calls
I20260808 14:53:10.270742 10785 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P debebb372bda46a29992b2d5a6b38151: No bootstrap required, opened a new log
Aug 08 14:53:10 dist-test-slave-6k22 krb5kdc[10700](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200789, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.206.254@KRBTEST.COM
I20260808 14:53:10.278775 10785 raft_consensus.cc:348] T 00000000000000000000000000000000 P debebb372bda46a29992b2d5a6b38151 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "debebb372bda46a29992b2d5a6b38151" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 33883 } }
I20260808 14:53:10.279184 10785 raft_consensus.cc:374] T 00000000000000000000000000000000 P debebb372bda46a29992b2d5a6b38151 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:53:10.279316 10785 raft_consensus.cc:729] T 00000000000000000000000000000000 P debebb372bda46a29992b2d5a6b38151 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: debebb372bda46a29992b2d5a6b38151, State: Initialized, Role: FOLLOWER
I20260808 14:53:10.280019 10785 consensus_queue.cc:260] T 00000000000000000000000000000000 P debebb372bda46a29992b2d5a6b38151 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "debebb372bda46a29992b2d5a6b38151" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 33883 } }
I20260808 14:53:10.280295 10785 raft_consensus.cc:388] T 00000000000000000000000000000000 P debebb372bda46a29992b2d5a6b38151 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:53:10.280481 10785 raft_consensus.cc:482] T 00000000000000000000000000000000 P debebb372bda46a29992b2d5a6b38151 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:53:10.280663 10785 raft_consensus.cc:3037] T 00000000000000000000000000000000 P debebb372bda46a29992b2d5a6b38151 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:53:10.283620 10785 raft_consensus.cc:504] T 00000000000000000000000000000000 P debebb372bda46a29992b2d5a6b38151 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "debebb372bda46a29992b2d5a6b38151" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 33883 } }
I20260808 14:53:10.284201 10785 leader_election.cc:302] T 00000000000000000000000000000000 P debebb372bda46a29992b2d5a6b38151 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: debebb372bda46a29992b2d5a6b38151; no voters:
I20260808 14:53:10.285014 10785 leader_election.cc:288] T 00000000000000000000000000000000 P debebb372bda46a29992b2d5a6b38151 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:53:10.285152 10790 raft_consensus.cc:2781] T 00000000000000000000000000000000 P debebb372bda46a29992b2d5a6b38151 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:53:10.285874 10790 raft_consensus.cc:686] T 00000000000000000000000000000000 P debebb372bda46a29992b2d5a6b38151 [term 1 LEADER]: Becoming Leader. State: Replica: debebb372bda46a29992b2d5a6b38151, State: Running, Role: LEADER
I20260808 14:53:10.286216 10788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:10.258874 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58650 (local address 127.26.206.254:33883)
0808 14:53:10.259683 (+ 809us) server_negotiation.cc:206] Beginning negotiation
0808 14:53:10.259694 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 14:53:10.259739 (+ 45us) server_negotiation.cc:407] Connection header received
0808 14:53:10.261632 (+ 1893us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:53:10.261653 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:53:10.261993 (+ 340us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:53:10.262297 (+ 304us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:53:10.264150 (+ 1853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:10.265345 (+ 1195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:10.267323 (+ 1978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:10.268086 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:10.268214 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:53:10.277994 (+ 9780us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:53:10.278001 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:53:10.278015 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:53:10.278050 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:53:10.281481 (+ 3431us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:53:10.282319 (+ 838us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:53:10.282325 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:53:10.282331 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:53:10.282512 (+ 181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:53:10.282944 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:53:10.282946 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:53:10.282948 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:53:10.283445 (+ 497us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:53:10.283725 (+ 280us) server_negotiation.cc:1035] Waiting for connection context
0808 14:53:10.284189 (+ 464us) server_negotiation.cc:299] Negotiation successful
0808 14:53:10.284620 (+ 431us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":547,"thread_start_us":361,"threads_started":1}
I20260808 14:53:10.287499 10790 consensus_queue.cc:237] T 00000000000000000000000000000000 P debebb372bda46a29992b2d5a6b38151 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "debebb372bda46a29992b2d5a6b38151" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 33883 } }
I20260808 14:53:10.288203 10785 sys_catalog.cc:564] T 00000000000000000000000000000000 P debebb372bda46a29992b2d5a6b38151 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:53:10.290657 27451 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:53:10.298388 10792 sys_catalog.cc:455] T 00000000000000000000000000000000 P debebb372bda46a29992b2d5a6b38151 [sys.catalog]: SysCatalogTable state changed. Reason: New leader debebb372bda46a29992b2d5a6b38151. Latest consensus state: current_term: 1 leader_uuid: "debebb372bda46a29992b2d5a6b38151" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "debebb372bda46a29992b2d5a6b38151" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 33883 } } }
I20260808 14:53:10.298470 10793 sys_catalog.cc:455] T 00000000000000000000000000000000 P debebb372bda46a29992b2d5a6b38151 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "debebb372bda46a29992b2d5a6b38151" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "debebb372bda46a29992b2d5a6b38151" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 33883 } } }
I20260808 14:53:10.298878 10792 sys_catalog.cc:458] T 00000000000000000000000000000000 P debebb372bda46a29992b2d5a6b38151 [sys.catalog]: This master's current role is: LEADER
I20260808 14:53:10.298887 10793 sys_catalog.cc:458] T 00000000000000000000000000000000 P debebb372bda46a29992b2d5a6b38151 [sys.catalog]: This master's current role is: LEADER
W20260808 14:53:10.304459 10812 catalog_manager.cc:1558] T 00000000000000000000000000000000 P debebb372bda46a29992b2d5a6b38151: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 14:53:10.304574 10812 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 14:53:10.304736 10813 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:53:10.306326 10813 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:53:10.314047 10813 catalog_manager.cc:1347] Generated new cluster ID: 81d074071bbb4fd5a2585060fb47c0b1
I20260808 14:53:10.314146 10813 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:53:10.329639 10813 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:53:10.330821 10813 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:53:10.337402 10813 catalog_manager.cc:5868] T 00000000000000000000000000000000 P debebb372bda46a29992b2d5a6b38151: Generated new TSK 0
I20260808 14:53:10.338106 10813 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:53:10.353132 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 10713
I20260808 14:53:10.354235 10780 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:53:10.444648 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 10713
2026-08-08T14:53:10Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (2077 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:53:10 dist-test-slave-6k22 krb5kdc[10822](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:53:10 dist-test-slave-6k22 krb5kdc[10822](info): set up 2 sockets
Aug 08 14:53:10 dist-test-slave-6k22 krb5kdc[10822](info): commencing operation
krb5kdc: starting...
W20260808 14:53:11.610895 27451 mini_kdc.cc:121] Time spent starting KDC: real 1.126s user 0.001s sys 0.034s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/krb5kdc/test-user.keytab.
Aug 08 14:53:11 dist-test-slave-6k22 krb5kdc[10822](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200791, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:53:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:53:11Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.206.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.206.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.206.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.254.keytab.
Entry for principal kudu/127.26.206.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.254.keytab.
I20260808 14:53:11.876577 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.206.254:40593
--webserver_interface=127.26.206.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.254.keytab
--principal=kudu/127.26.206.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.206.212:42083
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.206.254:40593
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:53:12.212344 10835 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:53:12.212621 10835 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:53:12.212708 10835 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:53:12.219772 10835 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:53:12.219877 10835 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:53:12.219923 10835 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:53:12.219980 10835 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:53:12.220024 10835 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:53:12.229372 10835 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:42083
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.206.254:40593
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.254.keytab
--principal=kudu/127.26.206.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.206.254:40593
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.206.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:53:12.230587 10835 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:53:12.231799 10835 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:53:12.243466 10841 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:53:12.243428 10843 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:53:12.243517 10840 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:53:12.244383 10835 server_base.cc:1034] running on GCE node
I20260808 14:53:12.245151 10835 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:53:12.246438 10835 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:53:12.247673 10835 hybrid_clock.cc:648] HybridClock initialized: now 1786200792247615 us; error 34 us; skew 500 ppm
I20260808 14:53:12.248011 10835 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:53:12 dist-test-slave-6k22 krb5kdc[10822](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200792, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:53:12.251004 10835 init.cc:377] Logged in from keytab as kudu/127.26.206.254@KRBTEST.COM (short username kudu)
I20260808 14:53:12.252528 10835 webserver.cc:460] Webserver started at http://127.26.206.254:45835/ using document root <none> and password file <none>
I20260808 14:53:12.253191 10835 fs_manager.cc:359] Metadata directory not provided
I20260808 14:53:12.253325 10835 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:53:12.253628 10835 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:53:12.256572 10835 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/master-0/data/instance:
uuid: "fa7e80a4e89440429ab9555997d74967"
format_stamp: "Formatted at 2026-08-08 14:53:12 on dist-test-slave-6k22"
server_key: "ecaa4a0e6daf5ec669cc4abdb95641c0"
server_key_iv: "f0f08edf7a5df903e10410ee48fae57c"
server_key_version: "encryptionkey@0"
I20260808 14:53:12.257319 10835 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/master-0/wal/instance:
uuid: "fa7e80a4e89440429ab9555997d74967"
format_stamp: "Formatted at 2026-08-08 14:53:12 on dist-test-slave-6k22"
server_key: "ecaa4a0e6daf5ec669cc4abdb95641c0"
server_key_iv: "f0f08edf7a5df903e10410ee48fae57c"
server_key_version: "encryptionkey@0"
I20260808 14:53:12.262166 10835 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260808 14:53:12.265460 10851 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:53:12.266706 10835 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 14:53:12.266896 10835 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/master-0/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/master-0/wal
uuid: "fa7e80a4e89440429ab9555997d74967"
format_stamp: "Formatted at 2026-08-08 14:53:12 on dist-test-slave-6k22"
server_key: "ecaa4a0e6daf5ec669cc4abdb95641c0"
server_key_iv: "f0f08edf7a5df903e10410ee48fae57c"
server_key_version: "encryptionkey@0"
I20260808 14:53:12.267086 10835 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:53:12.297786 10835 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:53:12.301867 10835 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:53:12.302201 10835 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:53:12.320783 10835 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.254:40593
I20260808 14:53:12.320822 10905 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.254:40593 every 8 connection(s)
I20260808 14:53:12.322075 10835 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
I20260808 14:53:12.322737 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 10835
I20260808 14:53:12.322995 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/master-0/wal/instance
I20260808 14:53:12.323848 27451 external_mini_cluster.cc:1428] Setting key c6806024478574ec43e66097937c6bea
I20260808 14:53:12.326506 10906 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:53:12.337222 10906 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fa7e80a4e89440429ab9555997d74967: Bootstrap starting.
Aug 08 14:53:12 dist-test-slave-6k22 krb5kdc[10822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200791, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.206.254@KRBTEST.COM
I20260808 14:53:12.340999 10906 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fa7e80a4e89440429ab9555997d74967: Neither blocks nor log segments found. Creating new log.
I20260808 14:53:12.342046 10906 log.cc:824] T 00000000000000000000000000000000 P fa7e80a4e89440429ab9555997d74967: Log is configured to *not* fsync() on all Append() calls
I20260808 14:53:12.344831 10906 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fa7e80a4e89440429ab9555997d74967: No bootstrap required, opened a new log
I20260808 14:53:12.346112 10910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:12.325891 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47554 (local address 127.26.206.254:40593)
0808 14:53:12.326857 (+ 966us) server_negotiation.cc:206] Beginning negotiation
0808 14:53:12.326867 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 14:53:12.326907 (+ 40us) server_negotiation.cc:407] Connection header received
0808 14:53:12.328557 (+ 1650us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:53:12.328577 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:53:12.328955 (+ 378us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:53:12.329345 (+ 390us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:53:12.330832 (+ 1487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:12.332180 (+ 1348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:12.333489 (+ 1309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:12.334202 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:12.334425 (+ 223us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:53:12.338966 (+ 4541us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:53:12.338974 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:53:12.338990 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:53:12.339026 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:53:12.342093 (+ 3067us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:53:12.342823 (+ 730us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:53:12.342829 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:53:12.342835 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:53:12.343001 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:53:12.343406 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:53:12.343412 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:53:12.343415 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:53:12.343959 (+ 544us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:53:12.344299 (+ 340us) server_negotiation.cc:1035] Waiting for connection context
0808 14:53:12.344739 (+ 440us) server_negotiation.cc:299] Negotiation successful
0808 14:53:12.345193 (+ 454us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":761,"thread_start_us":466,"threads_started":1}
I20260808 14:53:12.352662 10906 raft_consensus.cc:348] T 00000000000000000000000000000000 P fa7e80a4e89440429ab9555997d74967 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa7e80a4e89440429ab9555997d74967" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 40593 } }
I20260808 14:53:12.353013 10906 raft_consensus.cc:374] T 00000000000000000000000000000000 P fa7e80a4e89440429ab9555997d74967 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:53:12.353120 10906 raft_consensus.cc:729] T 00000000000000000000000000000000 P fa7e80a4e89440429ab9555997d74967 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa7e80a4e89440429ab9555997d74967, State: Initialized, Role: FOLLOWER
I20260808 14:53:12.353634 10906 consensus_queue.cc:260] T 00000000000000000000000000000000 P fa7e80a4e89440429ab9555997d74967 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa7e80a4e89440429ab9555997d74967" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 40593 } }
I20260808 14:53:12.353912 10906 raft_consensus.cc:388] T 00000000000000000000000000000000 P fa7e80a4e89440429ab9555997d74967 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:53:12.354058 10906 raft_consensus.cc:482] T 00000000000000000000000000000000 P fa7e80a4e89440429ab9555997d74967 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:53:12.354254 10906 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fa7e80a4e89440429ab9555997d74967 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:53:12.356380 10906 raft_consensus.cc:504] T 00000000000000000000000000000000 P fa7e80a4e89440429ab9555997d74967 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa7e80a4e89440429ab9555997d74967" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 40593 } }
I20260808 14:53:12.356827 10906 leader_election.cc:302] T 00000000000000000000000000000000 P fa7e80a4e89440429ab9555997d74967 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fa7e80a4e89440429ab9555997d74967; no voters:
I20260808 14:53:12.357414 10906 leader_election.cc:288] T 00000000000000000000000000000000 P fa7e80a4e89440429ab9555997d74967 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:53:12.357565 10912 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fa7e80a4e89440429ab9555997d74967 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:53:12.358249 10912 raft_consensus.cc:686] T 00000000000000000000000000000000 P fa7e80a4e89440429ab9555997d74967 [term 1 LEADER]: Becoming Leader. State: Replica: fa7e80a4e89440429ab9555997d74967, State: Running, Role: LEADER
I20260808 14:53:12.358887 10912 consensus_queue.cc:237] T 00000000000000000000000000000000 P fa7e80a4e89440429ab9555997d74967 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa7e80a4e89440429ab9555997d74967" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 40593 } }
I20260808 14:53:12.359457 10906 sys_catalog.cc:564] T 00000000000000000000000000000000 P fa7e80a4e89440429ab9555997d74967 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:53:12.365298 10913 sys_catalog.cc:455] T 00000000000000000000000000000000 P fa7e80a4e89440429ab9555997d74967 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fa7e80a4e89440429ab9555997d74967" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa7e80a4e89440429ab9555997d74967" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 40593 } } }
I20260808 14:53:12.365409 10914 sys_catalog.cc:455] T 00000000000000000000000000000000 P fa7e80a4e89440429ab9555997d74967 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fa7e80a4e89440429ab9555997d74967. Latest consensus state: current_term: 1 leader_uuid: "fa7e80a4e89440429ab9555997d74967" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa7e80a4e89440429ab9555997d74967" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 40593 } } }
I20260808 14:53:12.365741 10913 sys_catalog.cc:458] T 00000000000000000000000000000000 P fa7e80a4e89440429ab9555997d74967 [sys.catalog]: This master's current role is: LEADER
I20260808 14:53:12.365800 10914 sys_catalog.cc:458] T 00000000000000000000000000000000 P fa7e80a4e89440429ab9555997d74967 [sys.catalog]: This master's current role is: LEADER
W20260808 14:53:12.370760 10928 catalog_manager.cc:1558] T 00000000000000000000000000000000 P fa7e80a4e89440429ab9555997d74967: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 14:53:12.370901 10928 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 14:53:12.371075 10927 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:53:12.373196 10927 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:53:12.382119 10927 catalog_manager.cc:1347] Generated new cluster ID: 0900b34a559e4a0fa35a8ba3bfca602c
I20260808 14:53:12.382246 10927 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:53:12.391621 10927 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:53:12.393487 10927 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:53:12.403204 10927 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fa7e80a4e89440429ab9555997d74967: Generated new TSK 0
I20260808 14:53:12.404218 10927 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.206.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.206.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.206.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.193.keytab.
Entry for principal kudu/127.26.206.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.193.keytab.
I20260808 14:53:12.473167 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.206.193:0
--local_ip_for_outbound_sockets=127.26.206.193
--webserver_interface=127.26.206.193
--webserver_port=0
--tserver_master_addrs=127.26.206.254:40593
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.193.keytab
--principal=kudu/127.26.206.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.206.212:42083
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:53:12.829232 10934 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:53:12.829648 10934 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:53:12.829856 10934 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:53:12.840839 10934 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:53:12.841017 10934 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:53:12.841216 10934 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.206.193
I20260808 14:53:12.857810 10934 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:42083
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.193.keytab
--principal=kudu/127.26.206.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.206.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.206.193
--webserver_port=0
--tserver_master_addrs=127.26.206.254:40593
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.206.193
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:53:12.859150 10934 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:53:12.860531 10934 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:53:12.874270 10939 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:53:12.874336 10940 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:53:12.874359 10944 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:53:12.875072 10934 server_base.cc:1034] running on GCE node
I20260808 14:53:12.875686 10934 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:53:12.876574 10934 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:53:12.877780 10934 hybrid_clock.cc:648] HybridClock initialized: now 1786200792877740 us; error 30 us; skew 500 ppm
I20260808 14:53:12.878041 10934 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:53:12 dist-test-slave-6k22 krb5kdc[10822](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200792, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:53:12.881093 10934 init.cc:377] Logged in from keytab as kudu/127.26.206.193@KRBTEST.COM (short username kudu)
I20260808 14:53:12.882520 10934 webserver.cc:460] Webserver started at http://127.26.206.193:43585/ using document root <none> and password file <none>
I20260808 14:53:12.883170 10934 fs_manager.cc:359] Metadata directory not provided
I20260808 14:53:12.883304 10934 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:53:12.883699 10934 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:53:12.886505 10934 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-0/data/instance:
uuid: "f3812b4693ca412a9ebd05153fa0161e"
format_stamp: "Formatted at 2026-08-08 14:53:12 on dist-test-slave-6k22"
server_key: "d1908835f49e980b852cdec442048f69"
server_key_iv: "42c8732f151690eeb8e202c9059c68cb"
server_key_version: "encryptionkey@0"
I20260808 14:53:12.887274 10934 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-0/wal/instance:
uuid: "f3812b4693ca412a9ebd05153fa0161e"
format_stamp: "Formatted at 2026-08-08 14:53:12 on dist-test-slave-6k22"
server_key: "d1908835f49e980b852cdec442048f69"
server_key_iv: "42c8732f151690eeb8e202c9059c68cb"
server_key_version: "encryptionkey@0"
I20260808 14:53:12.892247 10934 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.000s
I20260808 14:53:12.895512 10951 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:53:12.896782 10934 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260808 14:53:12.896946 10934 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-0/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-0/wal
uuid: "f3812b4693ca412a9ebd05153fa0161e"
format_stamp: "Formatted at 2026-08-08 14:53:12 on dist-test-slave-6k22"
server_key: "d1908835f49e980b852cdec442048f69"
server_key_iv: "42c8732f151690eeb8e202c9059c68cb"
server_key_version: "encryptionkey@0"
I20260808 14:53:12.897147 10934 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:53:12.913333 10934 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:53:12.917178 10934 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:53:12.917471 10934 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:53:12.918380 10934 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:53:12.919795 10934 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:53:12.919866 10934 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:53:12.920045 10934 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:53:12.920104 10934 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:53:12.954005 10934 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.193:40683
I20260808 14:53:12.954038 11077 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.193:40683 every 8 connection(s)
I20260808 14:53:12.955314 10934 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-0/data/info.pb
I20260808 14:53:12.959837 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 10934
I20260808 14:53:12.960069 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-0/wal/instance
I20260808 14:53:12.960987 27451 external_mini_cluster.cc:1428] Setting key fbbaa21fdeb4b221af06f4ee682ea543
Aug 08 14:53:12 dist-test-slave-6k22 krb5kdc[10822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200792, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.193@KRBTEST.COM for kudu/127.26.206.254@KRBTEST.COM
I20260808 14:53:12.978994 11080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:12.957809 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.193:56127 (local address 127.26.206.254:40593)
0808 14:53:12.958306 (+ 497us) server_negotiation.cc:206] Beginning negotiation
0808 14:53:12.958313 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:53:12.959281 (+ 968us) server_negotiation.cc:407] Connection header received
0808 14:53:12.962161 (+ 2880us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:53:12.962167 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:53:12.962261 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:53:12.962382 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:53:12.964275 (+ 1893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:12.965525 (+ 1250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:12.967047 (+ 1522us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:12.967844 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:12.968028 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:53:12.971683 (+ 3655us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:53:12.971692 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:53:12.971699 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:53:12.971747 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:53:12.975443 (+ 3696us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:53:12.976474 (+ 1031us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:53:12.976478 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:53:12.976481 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:53:12.976626 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:53:12.977177 (+ 551us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:53:12.977181 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:53:12.977183 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:53:12.977494 (+ 311us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:53:12.977618 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0808 14:53:12.978563 (+ 945us) server_negotiation.cc:299] Negotiation successful
0808 14:53:12.978734 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":359,"thread_start_us":223,"threads_started":1}
I20260808 14:53:12.980551 11081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:12.958376 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:40593 (local address 127.26.206.193:56127)
0808 14:53:12.959140 (+ 764us) negotiation.cc:107] Waiting for socket to connect
0808 14:53:12.959179 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 14:53:12.961766 (+ 2587us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:53:12.962656 (+ 890us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:53:12.962668 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:53:12.963398 (+ 730us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:53:12.964092 (+ 694us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:53:12.964110 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:53:12.965684 (+ 1574us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:53:12.965687 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:53:12.966891 (+ 1204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:53:12.966903 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:53:12.968111 (+ 1208us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:53:12.968121 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:53:12.968452 (+ 331us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:53:12.969157 (+ 705us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:53:12.969183 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:53:12.971448 (+ 2265us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:53:12.975654 (+ 4206us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:53:12.975665 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:53:12.975685 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:53:12.976326 (+ 641us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:53:12.976761 (+ 435us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:53:12.976767 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:53:12.976772 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:53:12.977026 (+ 254us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:53:12.977631 (+ 605us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:53:12.977641 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:53:12.978101 (+ 460us) client_negotiation.cc:769] Sending connection context
0808 14:53:12.978419 (+ 318us) client_negotiation.cc:240] Negotiation successful
0808 14:53:12.979004 (+ 585us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":503,"thread_start_us":287,"threads_started":1}
I20260808 14:53:12.982203 11078 heartbeater.cc:347] Connected to a master server at 127.26.206.254:40593
I20260808 14:53:12.982533 11078 heartbeater.cc:464] Registering TS with master...
I20260808 14:53:12.983322 11078 heartbeater.cc:511] Master 127.26.206.254:40593 requested a full tablet report, sending...
I20260808 14:53:12.985540 10868 ts_manager.cc:194] Registered new tserver with Master: f3812b4693ca412a9ebd05153fa0161e (127.26.206.193:40683)
I20260808 14:53:12.987066 10868 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.206.193@KRBTEST.COM'} at 127.26.206.193:56127
WARNING: no policy specified for kudu/127.26.206.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.206.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.206.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.194.keytab.
Entry for principal kudu/127.26.206.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.194.keytab.
I20260808 14:53:13.027009 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.206.194:0
--local_ip_for_outbound_sockets=127.26.206.194
--webserver_interface=127.26.206.194
--webserver_port=0
--tserver_master_addrs=127.26.206.254:40593
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.194.keytab
--principal=kudu/127.26.206.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.206.212:42083
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:53:13.355089 11084 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:53:13.355386 11084 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:53:13.355620 11084 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:53:13.362766 11084 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:53:13.362896 11084 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:53:13.363066 11084 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.206.194
I20260808 14:53:13.372519 11084 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:42083
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.194.keytab
--principal=kudu/127.26.206.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.206.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.206.194
--webserver_port=0
--tserver_master_addrs=127.26.206.254:40593
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.206.194
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:53:13.373723 11084 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:53:13.374977 11084 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:53:13.388464 11091 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:53:13.388527 11084 server_base.cc:1034] running on GCE node
W20260808 14:53:13.388619 11093 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:53:13.388563 11090 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:53:13.389683 11084 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:53:13.390558 11084 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:53:13.391780 11084 hybrid_clock.cc:648] HybridClock initialized: now 1786200793391709 us; error 50 us; skew 500 ppm
I20260808 14:53:13.392056 11084 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:53:13 dist-test-slave-6k22 krb5kdc[10822](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200793, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:53:13.395315 11084 init.cc:377] Logged in from keytab as kudu/127.26.206.194@KRBTEST.COM (short username kudu)
I20260808 14:53:13.396837 11084 webserver.cc:460] Webserver started at http://127.26.206.194:32981/ using document root <none> and password file <none>
I20260808 14:53:13.397498 11084 fs_manager.cc:359] Metadata directory not provided
I20260808 14:53:13.397596 11084 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:53:13.397841 11084 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:53:13.400731 11084 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-1/data/instance:
uuid: "9bdb12b7a2984ad6bae08231e419279a"
format_stamp: "Formatted at 2026-08-08 14:53:13 on dist-test-slave-6k22"
server_key: "9a04eafece52a059d664a4684ded196d"
server_key_iv: "892904062b62e5146f15fae9d2a90f24"
server_key_version: "encryptionkey@0"
I20260808 14:53:13.401463 11084 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-1/wal/instance:
uuid: "9bdb12b7a2984ad6bae08231e419279a"
format_stamp: "Formatted at 2026-08-08 14:53:13 on dist-test-slave-6k22"
server_key: "9a04eafece52a059d664a4684ded196d"
server_key_iv: "892904062b62e5146f15fae9d2a90f24"
server_key_version: "encryptionkey@0"
I20260808 14:53:13.406364 11084 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260808 14:53:13.409763 11100 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:53:13.411041 11084 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 14:53:13.411228 11084 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-1/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-1/wal
uuid: "9bdb12b7a2984ad6bae08231e419279a"
format_stamp: "Formatted at 2026-08-08 14:53:13 on dist-test-slave-6k22"
server_key: "9a04eafece52a059d664a4684ded196d"
server_key_iv: "892904062b62e5146f15fae9d2a90f24"
server_key_version: "encryptionkey@0"
I20260808 14:53:13.411422 11084 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:53:13.422032 11084 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:53:13.426393 11084 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:53:13.426730 11084 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:53:13.427747 11084 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:53:13.429060 11084 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:53:13.429165 11084 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:53:13.429324 11084 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:53:13.429399 11084 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:53:13.463394 11084 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.194:32785
I20260808 14:53:13.463482 11225 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.194:32785 every 8 connection(s)
I20260808 14:53:13.464702 11084 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-1/data/info.pb
I20260808 14:53:13.473124 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 11084
I20260808 14:53:13.473320 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-1/wal/instance
I20260808 14:53:13.473783 27451 external_mini_cluster.cc:1428] Setting key b02ec0d4e4788a73fc4e8e4267c73347
Aug 08 14:53:13 dist-test-slave-6k22 krb5kdc[10822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200793, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.194@KRBTEST.COM for kudu/127.26.206.254@KRBTEST.COM
I20260808 14:53:13.485131 11080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:13.467158 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.194:45117 (local address 127.26.206.254:40593)
0808 14:53:13.467348 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0808 14:53:13.467352 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:53:13.468566 (+ 1214us) server_negotiation.cc:407] Connection header received
0808 14:53:13.470518 (+ 1952us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:53:13.470524 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:53:13.470617 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:53:13.470743 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:53:13.472295 (+ 1552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:13.473014 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:13.474853 (+ 1839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:13.475318 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:13.475473 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:53:13.478932 (+ 3459us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:53:13.478937 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:53:13.478940 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:53:13.478970 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:53:13.481603 (+ 2633us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:53:13.482565 (+ 962us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:53:13.482569 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:53:13.482571 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:53:13.482692 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:53:13.483215 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:53:13.483223 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:53:13.483226 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:53:13.483492 (+ 266us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:53:13.483672 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0808 14:53:13.484504 (+ 832us) server_negotiation.cc:299] Negotiation successful
0808 14:53:13.484726 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260808 14:53:13.486753 11228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:13.467701 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:40593 (local address 127.26.206.194:45117)
0808 14:53:13.468398 (+ 697us) negotiation.cc:107] Waiting for socket to connect
0808 14:53:13.468441 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 14:53:13.470244 (+ 1803us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:53:13.470998 (+ 754us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:53:13.471010 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:53:13.471523 (+ 513us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:53:13.472121 (+ 598us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:53:13.472138 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:53:13.473180 (+ 1042us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:53:13.473187 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:53:13.474696 (+ 1509us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:53:13.474716 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:53:13.475560 (+ 844us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:53:13.475570 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:53:13.475843 (+ 273us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:53:13.476527 (+ 684us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:53:13.476548 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:53:13.478704 (+ 2156us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:53:13.481774 (+ 3070us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:53:13.481786 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:53:13.481803 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:53:13.482438 (+ 635us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:53:13.482808 (+ 370us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:53:13.482815 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:53:13.482821 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:53:13.483081 (+ 260us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:53:13.483641 (+ 560us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:53:13.483650 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:53:13.484098 (+ 448us) client_negotiation.cc:769] Sending connection context
0808 14:53:13.484395 (+ 297us) client_negotiation.cc:240] Negotiation successful
0808 14:53:13.484960 (+ 565us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":472,"thread_start_us":267,"threads_started":1}
I20260808 14:53:13.488178 11226 heartbeater.cc:347] Connected to a master server at 127.26.206.254:40593
I20260808 14:53:13.488528 11226 heartbeater.cc:464] Registering TS with master...
I20260808 14:53:13.489394 11226 heartbeater.cc:511] Master 127.26.206.254:40593 requested a full tablet report, sending...
I20260808 14:53:13.490892 10868 ts_manager.cc:194] Registered new tserver with Master: 9bdb12b7a2984ad6bae08231e419279a (127.26.206.194:32785)
I20260808 14:53:13.492134 10868 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.206.194@KRBTEST.COM'} at 127.26.206.194:45117
WARNING: no policy specified for kudu/127.26.206.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.206.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.206.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.195.keytab.
Entry for principal kudu/127.26.206.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.195.keytab.
I20260808 14:53:13.534909 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.206.195:0
--local_ip_for_outbound_sockets=127.26.206.195
--webserver_interface=127.26.206.195
--webserver_port=0
--tserver_master_addrs=127.26.206.254:40593
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.195.keytab
--principal=kudu/127.26.206.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.206.212:42083
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:53:13.863127 11231 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:53:13.863389 11231 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:53:13.863623 11231 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:53:13.870711 11231 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:53:13.870848 11231 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:53:13.871026 11231 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.206.195
I20260808 14:53:13.880358 11231 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:42083
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.195.keytab
--principal=kudu/127.26.206.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.206.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.206.195
--webserver_port=0
--tserver_master_addrs=127.26.206.254:40593
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.206.195
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:53:13.881511 11231 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:53:13.882733 11231 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:53:13.895412 11238 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:53:13.895512 11239 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:53:13.895434 11242 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:53:13.900985 11231 server_base.cc:1034] running on GCE node
I20260808 14:53:13.901681 11231 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:53:13.902680 11231 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:53:13.903903 11231 hybrid_clock.cc:648] HybridClock initialized: now 1786200793903857 us; error 57 us; skew 500 ppm
I20260808 14:53:13.904172 11231 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:53:13 dist-test-slave-6k22 krb5kdc[10822](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200793, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:53:13.907132 11231 init.cc:377] Logged in from keytab as kudu/127.26.206.195@KRBTEST.COM (short username kudu)
I20260808 14:53:13.908450 11231 webserver.cc:460] Webserver started at http://127.26.206.195:46099/ using document root <none> and password file <none>
I20260808 14:53:13.909086 11231 fs_manager.cc:359] Metadata directory not provided
I20260808 14:53:13.909235 11231 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:53:13.909556 11231 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:53:13.912457 11231 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-2/data/instance:
uuid: "d262cd4649d64d90a2bcfc3e73ac8e3c"
format_stamp: "Formatted at 2026-08-08 14:53:13 on dist-test-slave-6k22"
server_key: "8d4ce90d0e39aa631a55cd76faeeec84"
server_key_iv: "c99bd1bf361401cfeef856d007647262"
server_key_version: "encryptionkey@0"
I20260808 14:53:13.913215 11231 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-2/wal/instance:
uuid: "d262cd4649d64d90a2bcfc3e73ac8e3c"
format_stamp: "Formatted at 2026-08-08 14:53:13 on dist-test-slave-6k22"
server_key: "8d4ce90d0e39aa631a55cd76faeeec84"
server_key_iv: "c99bd1bf361401cfeef856d007647262"
server_key_version: "encryptionkey@0"
I20260808 14:53:13.918190 11231 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260808 14:53:13.921481 11250 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:53:13.922715 11231 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.001s
I20260808 14:53:13.922878 11231 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-2/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-2/wal
uuid: "d262cd4649d64d90a2bcfc3e73ac8e3c"
format_stamp: "Formatted at 2026-08-08 14:53:13 on dist-test-slave-6k22"
server_key: "8d4ce90d0e39aa631a55cd76faeeec84"
server_key_iv: "c99bd1bf361401cfeef856d007647262"
server_key_version: "encryptionkey@0"
I20260808 14:53:13.923060 11231 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:53:13.936803 11231 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:53:13.940901 11231 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:53:13.941242 11231 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:53:13.942121 11231 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:53:13.943377 11231 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:53:13.943449 11231 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:53:13.943655 11231 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:53:13.943717 11231 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:53:13.982956 11231 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.195:34885
I20260808 14:53:13.982961 11375 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.195:34885 every 8 connection(s)
I20260808 14:53:13.984387 11231 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-2/data/info.pb
I20260808 14:53:13.990173 11078 heartbeater.cc:503] Master 127.26.206.254:40593 was elected leader, sending a full tablet report...
I20260808 14:53:13.991190 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 11231
I20260808 14:53:13.991403 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-2/wal/instance
I20260808 14:53:13.992080 27451 external_mini_cluster.cc:1428] Setting key a766c32724138049307fe75cd0c4c6ae
Aug 08 14:53:13 dist-test-slave-6k22 krb5kdc[10822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200793, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.195@KRBTEST.COM for kudu/127.26.206.254@KRBTEST.COM
I20260808 14:53:14.004730 11378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:13.986988 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.195:36473 (local address 127.26.206.254:40593)
0808 14:53:13.987446 (+ 458us) server_negotiation.cc:206] Beginning negotiation
0808 14:53:13.987451 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:53:13.988472 (+ 1021us) server_negotiation.cc:407] Connection header received
0808 14:53:13.990384 (+ 1912us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:53:13.990389 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:53:13.990457 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:53:13.990585 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:53:13.992528 (+ 1943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:13.993663 (+ 1135us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:13.995469 (+ 1806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:13.995925 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:13.996038 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:53:13.999474 (+ 3436us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:53:13.999479 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:53:13.999482 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:53:13.999511 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:53:14.002165 (+ 2654us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:53:14.002779 (+ 614us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:53:14.002784 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:53:14.002786 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:53:14.002896 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:53:14.003248 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:53:14.003251 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:53:14.003253 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:53:14.003523 (+ 270us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:53:14.003723 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0808 14:53:14.004320 (+ 597us) server_negotiation.cc:299] Negotiation successful
0808 14:53:14.004472 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":345,"thread_start_us":245,"threads_started":1}
I20260808 14:53:14.005638 11379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:13.987623 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:40593 (local address 127.26.206.195:36473)
0808 14:53:13.988318 (+ 695us) negotiation.cc:107] Waiting for socket to connect
0808 14:53:13.988355 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0808 14:53:13.990052 (+ 1697us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:53:13.990839 (+ 787us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:53:13.990851 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:53:13.991516 (+ 665us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:53:13.992351 (+ 835us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:53:13.992371 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:53:13.993811 (+ 1440us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:53:13.993815 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:53:13.995345 (+ 1530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:53:13.995357 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:53:13.996162 (+ 805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:53:13.996170 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:53:13.996379 (+ 209us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:53:13.997013 (+ 634us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:53:13.997034 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:53:13.999293 (+ 2259us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:53:14.002296 (+ 3003us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:53:14.002302 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:53:14.002312 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:53:14.002679 (+ 367us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:53:14.002984 (+ 305us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:53:14.002987 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:53:14.002989 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:53:14.003162 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:53:14.003690 (+ 528us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:53:14.003695 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:53:14.004009 (+ 314us) client_negotiation.cc:769] Sending connection context
0808 14:53:14.004225 (+ 216us) client_negotiation.cc:240] Negotiation successful
0808 14:53:14.004571 (+ 346us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":458,"thread_start_us":262,"threads_started":1}
I20260808 14:53:14.007215 11376 heartbeater.cc:347] Connected to a master server at 127.26.206.254:40593
I20260808 14:53:14.007550 11376 heartbeater.cc:464] Registering TS with master...
I20260808 14:53:14.008285 11376 heartbeater.cc:511] Master 127.26.206.254:40593 requested a full tablet report, sending...
I20260808 14:53:14.009624 10868 ts_manager.cc:194] Registered new tserver with Master: d262cd4649d64d90a2bcfc3e73ac8e3c (127.26.206.195:34885)
I20260808 14:53:14.010414 10868 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.206.195@KRBTEST.COM'} at 127.26.206.195:36473
I20260808 14:53:14.019181 27451 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 14:53:14.036031 11378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:14.023491 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47570 (local address 127.26.206.254:40593)
0808 14:53:14.023686 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0808 14:53:14.023694 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:53:14.024056 (+ 362us) server_negotiation.cc:407] Connection header received
0808 14:53:14.024260 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:53:14.024266 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:53:14.024350 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:53:14.024454 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:53:14.025808 (+ 1354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:14.026509 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:14.027877 (+ 1368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:14.028291 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:14.028431 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:53:14.030685 (+ 2254us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:53:14.030691 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:53:14.030695 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:53:14.030739 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:53:14.033126 (+ 2387us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:53:14.033755 (+ 629us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:53:14.033762 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:53:14.033766 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:53:14.033914 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:53:14.034270 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:53:14.034284 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:53:14.034287 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:53:14.034817 (+ 530us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:53:14.035091 (+ 274us) server_negotiation.cc:1035] Waiting for connection context
0808 14:53:14.035429 (+ 338us) server_negotiation.cc:299] Negotiation successful
0808 14:53:14.035709 (+ 280us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260808 14:53:14.040014 10868 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47570:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:53:14.047456 10868 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:53:14.069311 11392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:14.059595 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.195:34885 (local address 127.0.0.1:53506)
0808 14:53:14.060346 (+ 751us) negotiation.cc:107] Waiting for socket to connect
0808 14:53:14.060361 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 14:53:14.060544 (+ 183us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:53:14.061777 (+ 1233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:53:14.061782 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:53:14.061802 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:53:14.062385 (+ 583us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:53:14.062404 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:53:14.064610 (+ 2206us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:53:14.064615 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:53:14.066825 (+ 2210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:53:14.066839 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:53:14.068505 (+ 1666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:53:14.068511 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:53:14.068688 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:53:14.068727 (+ 39us) client_negotiation.cc:769] Sending connection context
0808 14:53:14.068799 (+ 72us) client_negotiation.cc:240] Negotiation successful
0808 14:53:14.068950 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":593,"thread_start_us":963,"threads_started":1}
I20260808 14:53:14.069888 11391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:14.059090 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33442 (local address 127.26.206.194:32785)
0808 14:53:14.059752 (+ 662us) server_negotiation.cc:206] Beginning negotiation
0808 14:53:14.059764 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 14:53:14.060508 (+ 744us) server_negotiation.cc:407] Connection header received
0808 14:53:14.060807 (+ 299us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:53:14.060817 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:53:14.061073 (+ 256us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:53:14.061234 (+ 161us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:53:14.062883 (+ 1649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:14.064082 (+ 1199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:14.066486 (+ 2404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:14.067676 (+ 1190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:14.067852 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:53:14.068009 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0808 14:53:14.068309 (+ 300us) server_negotiation.cc:299] Negotiation successful
0808 14:53:14.069543 (+ 1234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":501,"thread_start_us":339,"threads_started":1}
I20260808 14:53:14.069903 11393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:14.060288 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53506 (local address 127.26.206.195:34885)
0808 14:53:14.061180 (+ 892us) server_negotiation.cc:206] Beginning negotiation
0808 14:53:14.061190 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 14:53:14.061220 (+ 30us) server_negotiation.cc:407] Connection header received
0808 14:53:14.061314 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:53:14.061321 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:53:14.061520 (+ 199us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:53:14.061927 (+ 407us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:53:14.062605 (+ 678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:14.064458 (+ 1853us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:14.066985 (+ 2527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:14.068275 (+ 1290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:14.069128 (+ 853us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:53:14.069323 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0808 14:53:14.069401 (+ 78us) server_negotiation.cc:299] Negotiation successful
0808 14:53:14.069547 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":712,"thread_start_us":557,"threads_started":1}
I20260808 14:53:14.068941 11390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:14.058872 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.194:32785 (local address 127.0.0.1:33442)
0808 14:53:14.060309 (+ 1437us) negotiation.cc:107] Waiting for socket to connect
0808 14:53:14.060354 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 14:53:14.060599 (+ 245us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:53:14.061539 (+ 940us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:53:14.061546 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:53:14.061576 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:53:14.062736 (+ 1160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:53:14.062746 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:53:14.064213 (+ 1467us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:53:14.064217 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:53:14.066336 (+ 2119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:53:14.066353 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:53:14.067858 (+ 1505us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:53:14.067864 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:53:14.068050 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:53:14.068097 (+ 47us) client_negotiation.cc:769] Sending connection context
0808 14:53:14.068254 (+ 157us) client_negotiation.cc:240] Negotiation successful
0808 14:53:14.068440 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1167,"mutex_wait_us":1,"thread_start_us":1006,"threads_started":1}
I20260808 14:53:14.070758 11394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:14.061068 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41886 (local address 127.26.206.193:40683)
0808 14:53:14.061667 (+ 599us) server_negotiation.cc:206] Beginning negotiation
0808 14:53:14.061677 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 14:53:14.062454 (+ 777us) server_negotiation.cc:407] Connection header received
0808 14:53:14.062687 (+ 233us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:53:14.062694 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:53:14.062910 (+ 216us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:53:14.063081 (+ 171us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:53:14.063982 (+ 901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:14.065381 (+ 1399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:14.067450 (+ 2069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:14.068828 (+ 1378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:14.069061 (+ 233us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:53:14.069260 (+ 199us) server_negotiation.cc:1035] Waiting for connection context
0808 14:53:14.070261 (+ 1001us) server_negotiation.cc:299] Negotiation successful
0808 14:53:14.070436 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":427,"thread_start_us":438,"threads_started":1}
I20260808 14:53:14.071120 11397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:14.061402 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.193:40683 (local address 127.0.0.1:41886)
0808 14:53:14.062324 (+ 922us) negotiation.cc:107] Waiting for socket to connect
0808 14:53:14.062348 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0808 14:53:14.062494 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:53:14.063397 (+ 903us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:53:14.063403 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:53:14.063428 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:53:14.063812 (+ 384us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:53:14.063823 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:53:14.065548 (+ 1725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:53:14.065553 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:53:14.067316 (+ 1763us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:53:14.067326 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:53:14.069409 (+ 2083us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:53:14.069418 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:53:14.069574 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:53:14.069608 (+ 34us) client_negotiation.cc:769] Sending connection context
0808 14:53:14.069702 (+ 94us) client_negotiation.cc:240] Negotiation successful
0808 14:53:14.069839 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":768,"thread_start_us":606,"threads_started":1}
I20260808 14:53:14.073809 11305 tablet_service.cc:1467] Processing CreateTablet for tablet d3176428f9bf4d0e84d80d2a4651f9cb (DEFAULT_TABLE table=test-table [id=d599997fec8645528c59ef4c54a861f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:53:14.074065 11158 tablet_service.cc:1467] Processing CreateTablet for tablet d3176428f9bf4d0e84d80d2a4651f9cb (DEFAULT_TABLE table=test-table [id=d599997fec8645528c59ef4c54a861f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:53:14.075004 11305 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d3176428f9bf4d0e84d80d2a4651f9cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:53:14.074615 11004 tablet_service.cc:1467] Processing CreateTablet for tablet d3176428f9bf4d0e84d80d2a4651f9cb (DEFAULT_TABLE table=test-table [id=d599997fec8645528c59ef4c54a861f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:53:14.075394 11158 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d3176428f9bf4d0e84d80d2a4651f9cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:53:14.075910 11004 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d3176428f9bf4d0e84d80d2a4651f9cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:53:14.086102 11398 tablet_bootstrap.cc:492] T d3176428f9bf4d0e84d80d2a4651f9cb P d262cd4649d64d90a2bcfc3e73ac8e3c: Bootstrap starting.
I20260808 14:53:14.089159 11398 tablet_bootstrap.cc:654] T d3176428f9bf4d0e84d80d2a4651f9cb P d262cd4649d64d90a2bcfc3e73ac8e3c: Neither blocks nor log segments found. Creating new log.
I20260808 14:53:14.089495 11399 tablet_bootstrap.cc:492] T d3176428f9bf4d0e84d80d2a4651f9cb P f3812b4693ca412a9ebd05153fa0161e: Bootstrap starting.
I20260808 14:53:14.091482 11398 log.cc:824] T d3176428f9bf4d0e84d80d2a4651f9cb P d262cd4649d64d90a2bcfc3e73ac8e3c: Log is configured to *not* fsync() on all Append() calls
I20260808 14:53:14.092283 11400 tablet_bootstrap.cc:492] T d3176428f9bf4d0e84d80d2a4651f9cb P 9bdb12b7a2984ad6bae08231e419279a: Bootstrap starting.
I20260808 14:53:14.093087 11399 tablet_bootstrap.cc:654] T d3176428f9bf4d0e84d80d2a4651f9cb P f3812b4693ca412a9ebd05153fa0161e: Neither blocks nor log segments found. Creating new log.
I20260808 14:53:14.094364 11399 log.cc:824] T d3176428f9bf4d0e84d80d2a4651f9cb P f3812b4693ca412a9ebd05153fa0161e: Log is configured to *not* fsync() on all Append() calls
I20260808 14:53:14.095712 11400 tablet_bootstrap.cc:654] T d3176428f9bf4d0e84d80d2a4651f9cb P 9bdb12b7a2984ad6bae08231e419279a: Neither blocks nor log segments found. Creating new log.
I20260808 14:53:14.096891 11400 log.cc:824] T d3176428f9bf4d0e84d80d2a4651f9cb P 9bdb12b7a2984ad6bae08231e419279a: Log is configured to *not* fsync() on all Append() calls
I20260808 14:53:14.097023 11399 tablet_bootstrap.cc:492] T d3176428f9bf4d0e84d80d2a4651f9cb P f3812b4693ca412a9ebd05153fa0161e: No bootstrap required, opened a new log
I20260808 14:53:14.097287 11399 ts_tablet_manager.cc:1397] T d3176428f9bf4d0e84d80d2a4651f9cb P f3812b4693ca412a9ebd05153fa0161e: Time spent bootstrapping tablet: real 0.008s user 0.007s sys 0.000s
I20260808 14:53:14.097338 11398 tablet_bootstrap.cc:492] T d3176428f9bf4d0e84d80d2a4651f9cb P d262cd4649d64d90a2bcfc3e73ac8e3c: No bootstrap required, opened a new log
I20260808 14:53:14.097661 11398 ts_tablet_manager.cc:1397] T d3176428f9bf4d0e84d80d2a4651f9cb P d262cd4649d64d90a2bcfc3e73ac8e3c: Time spent bootstrapping tablet: real 0.012s user 0.006s sys 0.004s
I20260808 14:53:14.100507 11400 tablet_bootstrap.cc:492] T d3176428f9bf4d0e84d80d2a4651f9cb P 9bdb12b7a2984ad6bae08231e419279a: No bootstrap required, opened a new log
I20260808 14:53:14.100778 11400 ts_tablet_manager.cc:1397] T d3176428f9bf4d0e84d80d2a4651f9cb P 9bdb12b7a2984ad6bae08231e419279a: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.004s
I20260808 14:53:14.105350 11399 raft_consensus.cc:348] T d3176428f9bf4d0e84d80d2a4651f9cb P f3812b4693ca412a9ebd05153fa0161e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bdb12b7a2984ad6bae08231e419279a" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 32785 } } peers { permanent_uuid: "f3812b4693ca412a9ebd05153fa0161e" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 40683 } } peers { permanent_uuid: "d262cd4649d64d90a2bcfc3e73ac8e3c" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 34885 } }
I20260808 14:53:14.105692 11399 raft_consensus.cc:374] T d3176428f9bf4d0e84d80d2a4651f9cb P f3812b4693ca412a9ebd05153fa0161e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:53:14.105806 11399 raft_consensus.cc:729] T d3176428f9bf4d0e84d80d2a4651f9cb P f3812b4693ca412a9ebd05153fa0161e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3812b4693ca412a9ebd05153fa0161e, State: Initialized, Role: FOLLOWER
I20260808 14:53:14.106400 11399 consensus_queue.cc:260] T d3176428f9bf4d0e84d80d2a4651f9cb P f3812b4693ca412a9ebd05153fa0161e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bdb12b7a2984ad6bae08231e419279a" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 32785 } } peers { permanent_uuid: "f3812b4693ca412a9ebd05153fa0161e" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 40683 } } peers { permanent_uuid: "d262cd4649d64d90a2bcfc3e73ac8e3c" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 34885 } }
I20260808 14:53:14.108093 11399 ts_tablet_manager.cc:1428] T d3176428f9bf4d0e84d80d2a4651f9cb P f3812b4693ca412a9ebd05153fa0161e: Time spent starting tablet: real 0.011s user 0.010s sys 0.000s
I20260808 14:53:14.107991 11398 raft_consensus.cc:348] T d3176428f9bf4d0e84d80d2a4651f9cb P d262cd4649d64d90a2bcfc3e73ac8e3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bdb12b7a2984ad6bae08231e419279a" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 32785 } } peers { permanent_uuid: "f3812b4693ca412a9ebd05153fa0161e" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 40683 } } peers { permanent_uuid: "d262cd4649d64d90a2bcfc3e73ac8e3c" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 34885 } }
I20260808 14:53:14.108441 11398 raft_consensus.cc:374] T d3176428f9bf4d0e84d80d2a4651f9cb P d262cd4649d64d90a2bcfc3e73ac8e3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:53:14.108577 11398 raft_consensus.cc:729] T d3176428f9bf4d0e84d80d2a4651f9cb P d262cd4649d64d90a2bcfc3e73ac8e3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d262cd4649d64d90a2bcfc3e73ac8e3c, State: Initialized, Role: FOLLOWER
I20260808 14:53:14.109148 11398 consensus_queue.cc:260] T d3176428f9bf4d0e84d80d2a4651f9cb P d262cd4649d64d90a2bcfc3e73ac8e3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bdb12b7a2984ad6bae08231e419279a" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 32785 } } peers { permanent_uuid: "f3812b4693ca412a9ebd05153fa0161e" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 40683 } } peers { permanent_uuid: "d262cd4649d64d90a2bcfc3e73ac8e3c" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 34885 } }
I20260808 14:53:14.110291 11376 heartbeater.cc:503] Master 127.26.206.254:40593 was elected leader, sending a full tablet report...
I20260808 14:53:14.110884 11398 ts_tablet_manager.cc:1428] T d3176428f9bf4d0e84d80d2a4651f9cb P d262cd4649d64d90a2bcfc3e73ac8e3c: Time spent starting tablet: real 0.013s user 0.012s sys 0.000s
I20260808 14:53:14.113149 11400 raft_consensus.cc:348] T d3176428f9bf4d0e84d80d2a4651f9cb P 9bdb12b7a2984ad6bae08231e419279a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bdb12b7a2984ad6bae08231e419279a" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 32785 } } peers { permanent_uuid: "f3812b4693ca412a9ebd05153fa0161e" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 40683 } } peers { permanent_uuid: "d262cd4649d64d90a2bcfc3e73ac8e3c" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 34885 } }
I20260808 14:53:14.113564 11400 raft_consensus.cc:374] T d3176428f9bf4d0e84d80d2a4651f9cb P 9bdb12b7a2984ad6bae08231e419279a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:53:14.113690 11400 raft_consensus.cc:729] T d3176428f9bf4d0e84d80d2a4651f9cb P 9bdb12b7a2984ad6bae08231e419279a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bdb12b7a2984ad6bae08231e419279a, State: Initialized, Role: FOLLOWER
I20260808 14:53:14.114224 11400 consensus_queue.cc:260] T d3176428f9bf4d0e84d80d2a4651f9cb P 9bdb12b7a2984ad6bae08231e419279a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bdb12b7a2984ad6bae08231e419279a" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 32785 } } peers { permanent_uuid: "f3812b4693ca412a9ebd05153fa0161e" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 40683 } } peers { permanent_uuid: "d262cd4649d64d90a2bcfc3e73ac8e3c" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 34885 } }
I20260808 14:53:14.115315 11226 heartbeater.cc:503] Master 127.26.206.254:40593 was elected leader, sending a full tablet report...
I20260808 14:53:14.115936 11400 ts_tablet_manager.cc:1428] T d3176428f9bf4d0e84d80d2a4651f9cb P 9bdb12b7a2984ad6bae08231e419279a: Time spent starting tablet: real 0.015s user 0.009s sys 0.004s
W20260808 14:53:14.207948 11079 tablet.cc:2369] T d3176428f9bf4d0e84d80d2a4651f9cb P f3812b4693ca412a9ebd05153fa0161e: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 14:53:14.216637 11227 tablet.cc:2369] T d3176428f9bf4d0e84d80d2a4651f9cb P 9bdb12b7a2984ad6bae08231e419279a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:53:14.228981 11407 raft_consensus.cc:482] T d3176428f9bf4d0e84d80d2a4651f9cb P 9bdb12b7a2984ad6bae08231e419279a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:53:14.229241 11407 raft_consensus.cc:504] T d3176428f9bf4d0e84d80d2a4651f9cb P 9bdb12b7a2984ad6bae08231e419279a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bdb12b7a2984ad6bae08231e419279a" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 32785 } } peers { permanent_uuid: "f3812b4693ca412a9ebd05153fa0161e" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 40683 } } peers { permanent_uuid: "d262cd4649d64d90a2bcfc3e73ac8e3c" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 34885 } }
I20260808 14:53:14.230880 11407 leader_election.cc:288] T d3176428f9bf4d0e84d80d2a4651f9cb P 9bdb12b7a2984ad6bae08231e419279a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3812b4693ca412a9ebd05153fa0161e (127.26.206.193:40683), d262cd4649d64d90a2bcfc3e73ac8e3c (127.26.206.195:34885)
W20260808 14:53:14.236008 11377 tablet.cc:2369] T d3176428f9bf4d0e84d80d2a4651f9cb P d262cd4649d64d90a2bcfc3e73ac8e3c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:53:14.237694 11393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:14.231380 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.194:53643 (local address 127.26.206.195:34885)
0808 14:53:14.231645 (+ 265us) server_negotiation.cc:206] Beginning negotiation
0808 14:53:14.231653 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:53:14.232299 (+ 646us) server_negotiation.cc:407] Connection header received
0808 14:53:14.232491 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:53:14.232496 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:53:14.232553 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:53:14.232649 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:53:14.233315 (+ 666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:14.234014 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:14.235749 (+ 1735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:14.236744 (+ 995us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:14.236929 (+ 185us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:53:14.237002 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 14:53:14.237336 (+ 334us) server_negotiation.cc:299] Negotiation successful
0808 14:53:14.237455 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260808 14:53:14.237811 11394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:14.231233 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.194:54097 (local address 127.26.206.193:40683)
0808 14:53:14.231459 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0808 14:53:14.231465 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:53:14.232194 (+ 729us) server_negotiation.cc:407] Connection header received
0808 14:53:14.232437 (+ 243us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:53:14.232441 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:53:14.232499 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:53:14.232598 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:53:14.233179 (+ 581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:14.233884 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:14.235737 (+ 1853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:14.236932 (+ 1195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:14.237104 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:53:14.237181 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0808 14:53:14.237454 (+ 273us) server_negotiation.cc:299] Negotiation successful
0808 14:53:14.237573 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260808 14:53:14.237875 11409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:14.231411 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.195:34885 (local address 127.26.206.194:53643)
0808 14:53:14.232184 (+ 773us) negotiation.cc:107] Waiting for socket to connect
0808 14:53:14.232199 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 14:53:14.232353 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:53:14.232663 (+ 310us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:53:14.232668 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:53:14.232690 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:53:14.233154 (+ 464us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:53:14.233162 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:53:14.234156 (+ 994us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:53:14.234161 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:53:14.235596 (+ 1435us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:53:14.235619 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:53:14.236954 (+ 1335us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:53:14.236960 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:53:14.237137 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:53:14.237204 (+ 67us) client_negotiation.cc:769] Sending connection context
0808 14:53:14.237306 (+ 102us) client_negotiation.cc:240] Negotiation successful
0808 14:53:14.237424 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":674,"mutex_wait_us":40,"thread_start_us":481,"threads_started":1}
I20260808 14:53:14.237973 11408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:14.231109 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.193:40683 (local address 127.26.206.194:54097)
0808 14:53:14.232083 (+ 974us) negotiation.cc:107] Waiting for socket to connect
0808 14:53:14.232108 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0808 14:53:14.232274 (+ 166us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:53:14.232619 (+ 345us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:53:14.232623 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:53:14.232647 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:53:14.233026 (+ 379us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:53:14.233035 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:53:14.234024 (+ 989us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:53:14.234032 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:53:14.235527 (+ 1495us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:53:14.235538 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:53:14.237139 (+ 1601us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:53:14.237144 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:53:14.237305 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:53:14.237327 (+ 22us) client_negotiation.cc:769] Sending connection context
0808 14:53:14.237429 (+ 102us) client_negotiation.cc:240] Negotiation successful
0808 14:53:14.237549 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":825,"mutex_wait_us":29,"thread_start_us":579,"threads_started":1}
I20260808 14:53:14.238889 11327 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3176428f9bf4d0e84d80d2a4651f9cb" candidate_uuid: "9bdb12b7a2984ad6bae08231e419279a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d262cd4649d64d90a2bcfc3e73ac8e3c" is_pre_election: true
I20260808 14:53:14.238937 11027 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3176428f9bf4d0e84d80d2a4651f9cb" candidate_uuid: "9bdb12b7a2984ad6bae08231e419279a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3812b4693ca412a9ebd05153fa0161e" is_pre_election: true
I20260808 14:53:14.239392 11327 raft_consensus.cc:2454] T d3176428f9bf4d0e84d80d2a4651f9cb P d262cd4649d64d90a2bcfc3e73ac8e3c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bdb12b7a2984ad6bae08231e419279a in term 0.
I20260808 14:53:14.239423 11027 raft_consensus.cc:2454] T d3176428f9bf4d0e84d80d2a4651f9cb P f3812b4693ca412a9ebd05153fa0161e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bdb12b7a2984ad6bae08231e419279a in term 0.
I20260808 14:53:14.240047 11106 leader_election.cc:302] T d3176428f9bf4d0e84d80d2a4651f9cb P 9bdb12b7a2984ad6bae08231e419279a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bdb12b7a2984ad6bae08231e419279a, d262cd4649d64d90a2bcfc3e73ac8e3c; no voters:
I20260808 14:53:14.240423 11407 raft_consensus.cc:2781] T d3176428f9bf4d0e84d80d2a4651f9cb P 9bdb12b7a2984ad6bae08231e419279a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:53:14.240576 11407 raft_consensus.cc:482] T d3176428f9bf4d0e84d80d2a4651f9cb P 9bdb12b7a2984ad6bae08231e419279a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:53:14.240687 11407 raft_consensus.cc:3037] T d3176428f9bf4d0e84d80d2a4651f9cb P 9bdb12b7a2984ad6bae08231e419279a [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:53:14.242898 11407 raft_consensus.cc:504] T d3176428f9bf4d0e84d80d2a4651f9cb P 9bdb12b7a2984ad6bae08231e419279a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bdb12b7a2984ad6bae08231e419279a" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 32785 } } peers { permanent_uuid: "f3812b4693ca412a9ebd05153fa0161e" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 40683 } } peers { permanent_uuid: "d262cd4649d64d90a2bcfc3e73ac8e3c" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 34885 } }
I20260808 14:53:14.243548 11407 leader_election.cc:288] T d3176428f9bf4d0e84d80d2a4651f9cb P 9bdb12b7a2984ad6bae08231e419279a [CANDIDATE]: Term 1 election: Requested vote from peers f3812b4693ca412a9ebd05153fa0161e (127.26.206.193:40683), d262cd4649d64d90a2bcfc3e73ac8e3c (127.26.206.195:34885)
I20260808 14:53:14.243947 11027 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3176428f9bf4d0e84d80d2a4651f9cb" candidate_uuid: "9bdb12b7a2984ad6bae08231e419279a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3812b4693ca412a9ebd05153fa0161e"
I20260808 14:53:14.244042 11327 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3176428f9bf4d0e84d80d2a4651f9cb" candidate_uuid: "9bdb12b7a2984ad6bae08231e419279a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d262cd4649d64d90a2bcfc3e73ac8e3c"
I20260808 14:53:14.244160 11027 raft_consensus.cc:3037] T d3176428f9bf4d0e84d80d2a4651f9cb P f3812b4693ca412a9ebd05153fa0161e [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:53:14.244230 11327 raft_consensus.cc:3037] T d3176428f9bf4d0e84d80d2a4651f9cb P d262cd4649d64d90a2bcfc3e73ac8e3c [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:53:14.247427 11027 raft_consensus.cc:2454] T d3176428f9bf4d0e84d80d2a4651f9cb P f3812b4693ca412a9ebd05153fa0161e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bdb12b7a2984ad6bae08231e419279a in term 1.
I20260808 14:53:14.247427 11327 raft_consensus.cc:2454] T d3176428f9bf4d0e84d80d2a4651f9cb P d262cd4649d64d90a2bcfc3e73ac8e3c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bdb12b7a2984ad6bae08231e419279a in term 1.
I20260808 14:53:14.247890 11107 leader_election.cc:302] T d3176428f9bf4d0e84d80d2a4651f9cb P 9bdb12b7a2984ad6bae08231e419279a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bdb12b7a2984ad6bae08231e419279a, f3812b4693ca412a9ebd05153fa0161e; no voters:
I20260808 14:53:14.248206 11407 raft_consensus.cc:2781] T d3176428f9bf4d0e84d80d2a4651f9cb P 9bdb12b7a2984ad6bae08231e419279a [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:53:14.248791 11407 raft_consensus.cc:686] T d3176428f9bf4d0e84d80d2a4651f9cb P 9bdb12b7a2984ad6bae08231e419279a [term 1 LEADER]: Becoming Leader. State: Replica: 9bdb12b7a2984ad6bae08231e419279a, State: Running, Role: LEADER
I20260808 14:53:14.249261 11407 consensus_queue.cc:237] T d3176428f9bf4d0e84d80d2a4651f9cb P 9bdb12b7a2984ad6bae08231e419279a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bdb12b7a2984ad6bae08231e419279a" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 32785 } } peers { permanent_uuid: "f3812b4693ca412a9ebd05153fa0161e" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 40683 } } peers { permanent_uuid: "d262cd4649d64d90a2bcfc3e73ac8e3c" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 34885 } }
I20260808 14:53:14.253918 10867 catalog_manager.cc:5495] T d3176428f9bf4d0e84d80d2a4651f9cb P 9bdb12b7a2984ad6bae08231e419279a reported cstate change: term changed from 0 to 1, leader changed from <none> to 9bdb12b7a2984ad6bae08231e419279a (127.26.206.194). New cstate: current_term: 1 leader_uuid: "9bdb12b7a2984ad6bae08231e419279a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bdb12b7a2984ad6bae08231e419279a" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 32785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3812b4693ca412a9ebd05153fa0161e" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 40683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d262cd4649d64d90a2bcfc3e73ac8e3c" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 34885 } health_report { overall_health: UNKNOWN } } }
I20260808 14:53:14.307941 11391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:14.302144 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33446 (local address 127.26.206.194:32785)
0808 14:53:14.302359 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0808 14:53:14.302366 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:53:14.302417 (+ 51us) server_negotiation.cc:407] Connection header received
0808 14:53:14.302682 (+ 265us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:53:14.302686 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:53:14.302770 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:53:14.302922 (+ 152us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:53:14.303277 (+ 355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:14.304207 (+ 930us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:14.305709 (+ 1502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:14.306127 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:14.306264 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:53:14.306789 (+ 525us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:53:14.307275 (+ 486us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:53:14.307435 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0808 14:53:14.307518 (+ 83us) server_negotiation.cc:299] Negotiation successful
0808 14:53:14.307627 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260808 14:53:14.315486 11327 raft_consensus.cc:1261] T d3176428f9bf4d0e84d80d2a4651f9cb P d262cd4649d64d90a2bcfc3e73ac8e3c [term 1 FOLLOWER]: Refusing update from remote peer 9bdb12b7a2984ad6bae08231e419279a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:53:14.315485 11027 raft_consensus.cc:1261] T d3176428f9bf4d0e84d80d2a4651f9cb P f3812b4693ca412a9ebd05153fa0161e [term 1 FOLLOWER]: Refusing update from remote peer 9bdb12b7a2984ad6bae08231e419279a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:53:14.316429 11407 consensus_queue.cc:1035] T d3176428f9bf4d0e84d80d2a4651f9cb P 9bdb12b7a2984ad6bae08231e419279a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3812b4693ca412a9ebd05153fa0161e" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 40683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:53:14.316748 11410 consensus_queue.cc:1035] T d3176428f9bf4d0e84d80d2a4651f9cb P 9bdb12b7a2984ad6bae08231e419279a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d262cd4649d64d90a2bcfc3e73ac8e3c" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 34885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:53:14.330236 11413 mvcc.cc:205] Tried to move back new op lower bound from 7316278453507399680 to 7316278453248757760. Current Snapshot: MvccSnapshot[applied={T|T < 7316278453507399680}]
I20260808 14:53:14.342268 11416 mvcc.cc:205] Tried to move back new op lower bound from 7316278453507399680 to 7316278453248757760. Current Snapshot: MvccSnapshot[applied={T|T < 7316278453507399680}]
I20260808 14:53:14.348994 10867 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47570:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:53:14.349299 10867 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47570:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:53:14.353240 10867 catalog_manager.cc:5782] T 00000000000000000000000000000000 P fa7e80a4e89440429ab9555997d74967: Sending DeleteTablet for 3 replicas of tablet d3176428f9bf4d0e84d80d2a4651f9cb
I20260808 14:53:14.354305 11158 tablet_service.cc:1514] Processing DeleteTablet for tablet d3176428f9bf4d0e84d80d2a4651f9cb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:53:14 UTC) from {username='kudu', principal='kudu/127.26.206.254@KRBTEST.COM'} at 127.0.0.1:33442
I20260808 14:53:14.354439 11305 tablet_service.cc:1514] Processing DeleteTablet for tablet d3176428f9bf4d0e84d80d2a4651f9cb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:53:14 UTC) from {username='kudu', principal='kudu/127.26.206.254@KRBTEST.COM'} at 127.0.0.1:53506
I20260808 14:53:14.354437 11004 tablet_service.cc:1514] Processing DeleteTablet for tablet d3176428f9bf4d0e84d80d2a4651f9cb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:53:14 UTC) from {username='kudu', principal='kudu/127.26.206.254@KRBTEST.COM'} at 127.0.0.1:41886
I20260808 14:53:14.355320 11424 tablet_replica.cc:330] T d3176428f9bf4d0e84d80d2a4651f9cb P 9bdb12b7a2984ad6bae08231e419279a: stopping tablet replica
I20260808 14:53:14.355705 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 10934
I20260808 14:53:14.356004 11424 raft_consensus.cc:2229] T d3176428f9bf4d0e84d80d2a4651f9cb P 9bdb12b7a2984ad6bae08231e419279a [term 1 LEADER]: Raft consensus shutting down.
I20260808 14:53:14.364771 11424 raft_consensus.cc:2258] T d3176428f9bf4d0e84d80d2a4651f9cb P 9bdb12b7a2984ad6bae08231e419279a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:53:14.368953 11424 ts_tablet_manager.cc:1905] T d3176428f9bf4d0e84d80d2a4651f9cb P 9bdb12b7a2984ad6bae08231e419279a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:53:14.371410 11425 tablet_replica.cc:330] T d3176428f9bf4d0e84d80d2a4651f9cb P d262cd4649d64d90a2bcfc3e73ac8e3c: stopping tablet replica
I20260808 14:53:14.371843 11425 raft_consensus.cc:2229] T d3176428f9bf4d0e84d80d2a4651f9cb P d262cd4649d64d90a2bcfc3e73ac8e3c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:53:14.372401 11425 raft_consensus.cc:2258] T d3176428f9bf4d0e84d80d2a4651f9cb P d262cd4649d64d90a2bcfc3e73ac8e3c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:53:14.379034 11425 ts_tablet_manager.cc:1905] T d3176428f9bf4d0e84d80d2a4651f9cb P d262cd4649d64d90a2bcfc3e73ac8e3c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:53:14.380129 11424 ts_tablet_manager.cc:1918] T d3176428f9bf4d0e84d80d2a4651f9cb P 9bdb12b7a2984ad6bae08231e419279a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:53:14.380411 11424 log.cc:1196] T d3176428f9bf4d0e84d80d2a4651f9cb P 9bdb12b7a2984ad6bae08231e419279a: Deleting WAL directory at /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-1/wal/wals/d3176428f9bf4d0e84d80d2a4651f9cb
I20260808 14:53:14.381251 11424 ts_tablet_manager.cc:1939] T d3176428f9bf4d0e84d80d2a4651f9cb P 9bdb12b7a2984ad6bae08231e419279a: Deleting consensus metadata
I20260808 14:53:14.383628 10855 catalog_manager.cc:4841] TS 9bdb12b7a2984ad6bae08231e419279a (127.26.206.194:32785): tablet d3176428f9bf4d0e84d80d2a4651f9cb (table test-table [id=d599997fec8645528c59ef4c54a861f1]) successfully deleted
I20260808 14:53:14.385115 11427 tablet_replica.cc:330] T d3176428f9bf4d0e84d80d2a4651f9cb P f3812b4693ca412a9ebd05153fa0161e: stopping tablet replica
I20260808 14:53:14.385576 11427 raft_consensus.cc:2229] T d3176428f9bf4d0e84d80d2a4651f9cb P f3812b4693ca412a9ebd05153fa0161e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:53:14.386065 11427 raft_consensus.cc:2258] T d3176428f9bf4d0e84d80d2a4651f9cb P f3812b4693ca412a9ebd05153fa0161e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:53:14.387921 11427 ts_tablet_manager.cc:1905] T d3176428f9bf4d0e84d80d2a4651f9cb P f3812b4693ca412a9ebd05153fa0161e: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 08 14:53:14 dist-test-slave-6k22 krb5kdc[10822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200791, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.206.193@KRBTEST.COM
I20260808 14:53:14.390537 11425 ts_tablet_manager.cc:1918] T d3176428f9bf4d0e84d80d2a4651f9cb P d262cd4649d64d90a2bcfc3e73ac8e3c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:53:14.390802 11425 log.cc:1196] T d3176428f9bf4d0e84d80d2a4651f9cb P d262cd4649d64d90a2bcfc3e73ac8e3c: Deleting WAL directory at /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-2/wal/wals/d3176428f9bf4d0e84d80d2a4651f9cb
I20260808 14:53:14.391397 11425 ts_tablet_manager.cc:1939] T d3176428f9bf4d0e84d80d2a4651f9cb P d262cd4649d64d90a2bcfc3e73ac8e3c: Deleting consensus metadata
I20260808 14:53:14.393915 10854 catalog_manager.cc:4841] TS d262cd4649d64d90a2bcfc3e73ac8e3c (127.26.206.195:34885): tablet d3176428f9bf4d0e84d80d2a4651f9cb (table test-table [id=d599997fec8645528c59ef4c54a861f1]) successfully deleted
I20260808 14:53:14.395053 11427 ts_tablet_manager.cc:1918] T d3176428f9bf4d0e84d80d2a4651f9cb P f3812b4693ca412a9ebd05153fa0161e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:53:14.395202 11427 log.cc:1196] T d3176428f9bf4d0e84d80d2a4651f9cb P f3812b4693ca412a9ebd05153fa0161e: Deleting WAL directory at /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-0/wal/wals/d3176428f9bf4d0e84d80d2a4651f9cb
I20260808 14:53:14.395776 11427 ts_tablet_manager.cc:1939] T d3176428f9bf4d0e84d80d2a4651f9cb P f3812b4693ca412a9ebd05153fa0161e: Deleting consensus metadata
I20260808 14:53:14.397541 10855 catalog_manager.cc:4841] TS f3812b4693ca412a9ebd05153fa0161e (127.26.206.193:40683): tablet d3176428f9bf4d0e84d80d2a4651f9cb (table test-table [id=d599997fec8645528c59ef4c54a861f1]) successfully deleted
I20260808 14:53:14.399135 11394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:14.357058 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41900 (local address 127.26.206.193:40683)
0808 14:53:14.357279 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0808 14:53:14.357285 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:53:14.367140 (+ 9855us) server_negotiation.cc:407] Connection header received
0808 14:53:14.368118 (+ 978us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:53:14.368124 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:53:14.368208 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:53:14.368295 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:53:14.373314 (+ 5019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:14.374573 (+ 1259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:14.376696 (+ 2123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:14.377384 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:14.377487 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:53:14.391296 (+ 13809us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:53:14.391312 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:53:14.391331 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:53:14.391383 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:53:14.395835 (+ 4452us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:53:14.396762 (+ 927us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:53:14.396772 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:53:14.396776 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:53:14.396970 (+ 194us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:53:14.397481 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:53:14.397485 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:53:14.397487 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:53:14.397884 (+ 397us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:53:14.398196 (+ 312us) server_negotiation.cc:1035] Waiting for connection context
0808 14:53:14.398536 (+ 340us) server_negotiation.cc:299] Negotiation successful
0808 14:53:14.398767 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260808 14:53:14.399948 11071 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:53:14.531879 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 10934
I20260808 14:53:14.553869 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 11084
Aug 08 14:53:14 dist-test-slave-6k22 krb5kdc[10822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200791, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.206.194@KRBTEST.COM
I20260808 14:53:14.572274 11391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:14.554701 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33452 (local address 127.26.206.194:32785)
0808 14:53:14.554876 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0808 14:53:14.554881 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:53:14.554961 (+ 80us) server_negotiation.cc:407] Connection header received
0808 14:53:14.555133 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:53:14.555137 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:53:14.555218 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:53:14.555306 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:53:14.557024 (+ 1718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:14.557829 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:14.559132 (+ 1303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:14.559835 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:14.559974 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:53:14.564762 (+ 4788us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:53:14.564778 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:53:14.564797 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:53:14.564847 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:53:14.568840 (+ 3993us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:53:14.569556 (+ 716us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:53:14.569566 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:53:14.569569 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:53:14.569735 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:53:14.570089 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:53:14.570094 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:53:14.570097 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:53:14.570661 (+ 564us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:53:14.571010 (+ 349us) server_negotiation.cc:1035] Waiting for connection context
0808 14:53:14.571402 (+ 392us) server_negotiation.cc:299] Negotiation successful
0808 14:53:14.571869 (+ 467us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260808 14:53:14.573071 11221 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:53:14.685882 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 11084
I20260808 14:53:14.708865 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 11231
Aug 08 14:53:14 dist-test-slave-6k22 krb5kdc[10822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200791, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.206.195@KRBTEST.COM
I20260808 14:53:14.724511 11393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:14.709648 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53522 (local address 127.26.206.195:34885)
0808 14:53:14.709852 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0808 14:53:14.709858 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:53:14.709879 (+ 21us) server_negotiation.cc:407] Connection header received
0808 14:53:14.710078 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:53:14.710084 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:53:14.710159 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:53:14.710265 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:53:14.711614 (+ 1349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:14.712353 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:14.713634 (+ 1281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:14.714043 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:14.714173 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:53:14.718696 (+ 4523us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:53:14.718708 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:53:14.718725 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:53:14.718757 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:53:14.721811 (+ 3054us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:53:14.722481 (+ 670us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:53:14.722488 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:53:14.722490 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:53:14.722628 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:53:14.722965 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:53:14.722968 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:53:14.722970 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:53:14.723299 (+ 329us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:53:14.723515 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0808 14:53:14.724094 (+ 579us) server_negotiation.cc:299] Negotiation successful
0808 14:53:14.724251 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260808 14:53:14.725138 11369 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:53:14.815459 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 11231
I20260808 14:53:14.834851 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 10835
I20260808 14:53:14.836041 10901 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:53:14.948437 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 10835
I20260808 14:53:14.974046 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.206.254:40593
--webserver_interface=127.26.206.254
--webserver_port=45835
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.254.keytab
--principal=kudu/127.26.206.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.206.212:42083
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.206.254:40593
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:53:15.322552 11433 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:53:15.322911 11433 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:53:15.323103 11433 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:53:15.330981 11433 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:53:15.331130 11433 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:53:15.331229 11433 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:53:15.331326 11433 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:53:15.331414 11433 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:53:15.341274 11433 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:42083
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.26.206.254:40593
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.254.keytab
--principal=kudu/127.26.206.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.206.254:40593
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.206.254
--webserver_port=45835
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:53:15.342571 11433 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:53:15.344154 11433 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:53:15.369769 11439 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:53:15.369907 11443 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:53:15.369933 11440 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:53:15.371431 11433 server_base.cc:1034] running on GCE node
I20260808 14:53:15.372345 11433 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:53:15.373857 11433 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:53:15.375084 11433 hybrid_clock.cc:648] HybridClock initialized: now 1786200795375038 us; error 50 us; skew 500 ppm
I20260808 14:53:15.375461 11433 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:53:15 dist-test-slave-6k22 krb5kdc[10822](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200795, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:53:15.384078 11433 init.cc:377] Logged in from keytab as kudu/127.26.206.254@KRBTEST.COM (short username kudu)
I20260808 14:53:15.385712 11433 webserver.cc:460] Webserver started at http://127.26.206.254:45835/ using document root <none> and password file <none>
I20260808 14:53:15.386502 11433 fs_manager.cc:359] Metadata directory not provided
I20260808 14:53:15.386696 11433 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:53:15.392853 11433 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 14:53:15.395988 11450 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:53:15.397744 11433 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 14:53:15.397948 11433 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/master-0/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/master-0/wal
uuid: "fa7e80a4e89440429ab9555997d74967"
format_stamp: "Formatted at 2026-08-08 14:53:12 on dist-test-slave-6k22"
server_key: "ecaa4a0e6daf5ec669cc4abdb95641c0"
server_key_iv: "f0f08edf7a5df903e10410ee48fae57c"
server_key_version: "encryptionkey@0"
I20260808 14:53:15.399060 11433 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:53:15.423179 11433 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:53:15.427546 11433 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:53:15.427927 11433 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:53:15.447062 11433 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.254:40593
I20260808 14:53:15.447094 11509 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.254:40593 every 8 connection(s)
I20260808 14:53:15.448566 11433 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
I20260808 14:53:15.451370 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 11433
I20260808 14:53:15.452198 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.206.193:40683
--local_ip_for_outbound_sockets=127.26.206.193
--tserver_master_addrs=127.26.206.254:40593
--webserver_port=43585
--webserver_interface=127.26.206.193
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.193.keytab
--principal=kudu/127.26.206.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.206.212:42083
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 14:53:15.455407 11510 sys_catalog.cc:263] Verifying existing consensus state
I20260808 14:53:15.458564 11510 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fa7e80a4e89440429ab9555997d74967: Bootstrap starting.
I20260808 14:53:15.477767 11510 log.cc:824] T 00000000000000000000000000000000 P fa7e80a4e89440429ab9555997d74967: Log is configured to *not* fsync() on all Append() calls
I20260808 14:53:15.489766 11510 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fa7e80a4e89440429ab9555997d74967: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 14:53:15.490319 11510 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fa7e80a4e89440429ab9555997d74967: Bootstrap complete.
I20260808 14:53:15.499529 11510 raft_consensus.cc:348] T 00000000000000000000000000000000 P fa7e80a4e89440429ab9555997d74967 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa7e80a4e89440429ab9555997d74967" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 40593 } }
I20260808 14:53:15.500375 11510 raft_consensus.cc:729] T 00000000000000000000000000000000 P fa7e80a4e89440429ab9555997d74967 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa7e80a4e89440429ab9555997d74967, State: Initialized, Role: FOLLOWER
I20260808 14:53:15.500985 11510 consensus_queue.cc:260] T 00000000000000000000000000000000 P fa7e80a4e89440429ab9555997d74967 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa7e80a4e89440429ab9555997d74967" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 40593 } }
I20260808 14:53:15.501227 11510 raft_consensus.cc:388] T 00000000000000000000000000000000 P fa7e80a4e89440429ab9555997d74967 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:53:15.501343 11510 raft_consensus.cc:482] T 00000000000000000000000000000000 P fa7e80a4e89440429ab9555997d74967 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:53:15.501519 11510 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fa7e80a4e89440429ab9555997d74967 [term 1 FOLLOWER]: Advancing to term 2
I20260808 14:53:15.505476 11510 raft_consensus.cc:504] T 00000000000000000000000000000000 P fa7e80a4e89440429ab9555997d74967 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa7e80a4e89440429ab9555997d74967" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 40593 } }
I20260808 14:53:15.506029 11510 leader_election.cc:302] T 00000000000000000000000000000000 P fa7e80a4e89440429ab9555997d74967 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fa7e80a4e89440429ab9555997d74967; no voters:
I20260808 14:53:15.506628 11510 leader_election.cc:288] T 00000000000000000000000000000000 P fa7e80a4e89440429ab9555997d74967 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260808 14:53:15.506762 11514 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fa7e80a4e89440429ab9555997d74967 [term 2 FOLLOWER]: Leader election won for term 2
I20260808 14:53:15.508419 11514 raft_consensus.cc:686] T 00000000000000000000000000000000 P fa7e80a4e89440429ab9555997d74967 [term 2 LEADER]: Becoming Leader. State: Replica: fa7e80a4e89440429ab9555997d74967, State: Running, Role: LEADER
I20260808 14:53:15.508944 11514 consensus_queue.cc:237] T 00000000000000000000000000000000 P fa7e80a4e89440429ab9555997d74967 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa7e80a4e89440429ab9555997d74967" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 40593 } }
I20260808 14:53:15.509348 11510 sys_catalog.cc:564] T 00000000000000000000000000000000 P fa7e80a4e89440429ab9555997d74967 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:53:15.511827 11515 sys_catalog.cc:455] T 00000000000000000000000000000000 P fa7e80a4e89440429ab9555997d74967 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "fa7e80a4e89440429ab9555997d74967" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa7e80a4e89440429ab9555997d74967" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 40593 } } }
I20260808 14:53:15.512246 11515 sys_catalog.cc:458] T 00000000000000000000000000000000 P fa7e80a4e89440429ab9555997d74967 [sys.catalog]: This master's current role is: LEADER
I20260808 14:53:15.512658 11516 sys_catalog.cc:455] T 00000000000000000000000000000000 P fa7e80a4e89440429ab9555997d74967 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fa7e80a4e89440429ab9555997d74967. Latest consensus state: current_term: 2 leader_uuid: "fa7e80a4e89440429ab9555997d74967" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa7e80a4e89440429ab9555997d74967" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 40593 } } }
I20260808 14:53:15.512992 11516 sys_catalog.cc:458] T 00000000000000000000000000000000 P fa7e80a4e89440429ab9555997d74967 [sys.catalog]: This master's current role is: LEADER
I20260808 14:53:15.516510 11521 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:53:15.530910 11521 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:53:15.532595 11521 catalog_manager.cc:1259] Loaded cluster ID: 0900b34a559e4a0fa35a8ba3bfca602c
I20260808 14:53:15.532706 11521 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:53:15.537652 11521 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260808 14:53:15.563472 11521 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260808 14:53:15.586414 11521 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:53:15.588833 11521 catalog_manager.cc:5879] T 00000000000000000000000000000000 P fa7e80a4e89440429ab9555997d74967: Loaded TSK: 0
I20260808 14:53:15.590651 11521 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 14:53:15.828698 11512 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:53:15.829003 11512 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:53:15.829186 11512 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:53:15.836361 11512 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:53:15.836499 11512 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:53:15.836684 11512 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.206.193
I20260808 14:53:15.846254 11512 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:42083
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.193.keytab
--principal=kudu/127.26.206.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.206.193:40683
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.206.193
--webserver_port=43585
--tserver_master_addrs=127.26.206.254:40593
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.206.193
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:53:15.847506 11512 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:53:15.848830 11512 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:53:15.863345 11540 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:53:15.863464 11541 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:53:15.863916 11543 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:53:15.864976 11512 server_base.cc:1034] running on GCE node
I20260808 14:53:15.865594 11512 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:53:15.866562 11512 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:53:15.867785 11512 hybrid_clock.cc:648] HybridClock initialized: now 1786200795867722 us; error 52 us; skew 500 ppm
I20260808 14:53:15.868096 11512 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:53:15 dist-test-slave-6k22 krb5kdc[10822](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200795, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:53:15.871273 11512 init.cc:377] Logged in from keytab as kudu/127.26.206.193@KRBTEST.COM (short username kudu)
I20260808 14:53:15.872861 11512 webserver.cc:460] Webserver started at http://127.26.206.193:43585/ using document root <none> and password file <none>
I20260808 14:53:15.873543 11512 fs_manager.cc:359] Metadata directory not provided
I20260808 14:53:15.873699 11512 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:53:15.880024 11512 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.006s sys 0.000s
I20260808 14:53:15.882771 11551 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:53:15.884145 11512 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 14:53:15.884321 11512 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-0/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-0/wal
uuid: "f3812b4693ca412a9ebd05153fa0161e"
format_stamp: "Formatted at 2026-08-08 14:53:12 on dist-test-slave-6k22"
server_key: "d1908835f49e980b852cdec442048f69"
server_key_iv: "42c8732f151690eeb8e202c9059c68cb"
server_key_version: "encryptionkey@0"
I20260808 14:53:15.885236 11512 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:53:15.915656 11512 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:53:15.920089 11512 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:53:15.920356 11512 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:53:15.921337 11512 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:53:15.922596 11512 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:53:15.922716 11512 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:53:15.922840 11512 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:53:15.922928 11512 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:53:15.956014 11512 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.193:40683
I20260808 14:53:15.956101 11676 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.193:40683 every 8 connection(s)
I20260808 14:53:15.957494 11512 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-0/data/info.pb
I20260808 14:53:15.963943 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 11512
I20260808 14:53:15.964648 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.206.194:32785
--local_ip_for_outbound_sockets=127.26.206.194
--tserver_master_addrs=127.26.206.254:40593
--webserver_port=32981
--webserver_interface=127.26.206.194
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.194.keytab
--principal=kudu/127.26.206.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.206.212:42083
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 14:53:15 dist-test-slave-6k22 krb5kdc[10822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200795, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.193@KRBTEST.COM for kudu/127.26.206.254@KRBTEST.COM
I20260808 14:53:15.984560 11680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:15.961175 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:40593 (local address 127.26.206.193:54211)
0808 14:53:15.962300 (+ 1125us) negotiation.cc:107] Waiting for socket to connect
0808 14:53:15.962339 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 14:53:15.964227 (+ 1888us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:53:15.965819 (+ 1592us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:53:15.965831 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:53:15.966602 (+ 771us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:53:15.967244 (+ 642us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:53:15.967265 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:53:15.969205 (+ 1940us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:53:15.969211 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:53:15.970603 (+ 1392us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:53:15.970616 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:53:15.971856 (+ 1240us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:53:15.971866 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:53:15.972203 (+ 337us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:53:15.972990 (+ 787us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:53:15.973022 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:53:15.975496 (+ 2474us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:53:15.979497 (+ 4001us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:53:15.979509 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:53:15.979528 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:53:15.980082 (+ 554us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:53:15.980596 (+ 514us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:53:15.980605 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:53:15.980612 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:53:15.980842 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:53:15.981682 (+ 840us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:53:15.981693 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:53:15.982069 (+ 376us) client_negotiation.cc:769] Sending connection context
0808 14:53:15.982384 (+ 315us) client_negotiation.cc:240] Negotiation successful
0808 14:53:15.983012 (+ 628us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":809,"thread_start_us":587,"threads_started":1}
I20260808 14:53:15.984555 11679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:15.960861 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.193:54211 (local address 127.26.206.254:40593)
0808 14:53:15.961593 (+ 732us) server_negotiation.cc:206] Beginning negotiation
0808 14:53:15.961608 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 14:53:15.962487 (+ 879us) server_negotiation.cc:407] Connection header received
0808 14:53:15.964833 (+ 2346us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:53:15.964856 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:53:15.965256 (+ 400us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:53:15.965608 (+ 352us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:53:15.967542 (+ 1934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:15.968975 (+ 1433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:15.970784 (+ 1809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:15.971533 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:15.971810 (+ 277us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:53:15.975850 (+ 4040us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:53:15.975859 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:53:15.975872 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:53:15.975912 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:53:15.979321 (+ 3409us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:53:15.980251 (+ 930us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:53:15.980266 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:53:15.980274 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:53:15.980458 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:53:15.980991 (+ 533us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:53:15.980997 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:53:15.980999 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:53:15.981509 (+ 510us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:53:15.981770 (+ 261us) server_negotiation.cc:1035] Waiting for connection context
0808 14:53:15.982629 (+ 859us) server_negotiation.cc:299] Negotiation successful
0808 14:53:15.983090 (+ 461us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":490,"thread_start_us":301,"threads_started":1}
I20260808 14:53:15.988080 11677 heartbeater.cc:347] Connected to a master server at 127.26.206.254:40593
I20260808 14:53:15.988448 11677 heartbeater.cc:464] Registering TS with master...
I20260808 14:53:15.989459 11677 heartbeater.cc:511] Master 127.26.206.254:40593 requested a full tablet report, sending...
I20260808 14:53:15.991833 11469 ts_manager.cc:194] Registered new tserver with Master: f3812b4693ca412a9ebd05153fa0161e (127.26.206.193:40683)
I20260808 14:53:15.993242 11469 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.206.193@KRBTEST.COM'} at 127.26.206.193:54211
W20260808 14:53:16.295282 11681 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:53:16.295538 11681 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:53:16.295706 11681 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:53:16.302790 11681 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:53:16.302899 11681 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:53:16.303102 11681 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.206.194
I20260808 14:53:16.313035 11681 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:42083
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.194.keytab
--principal=kudu/127.26.206.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.206.194:32785
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.206.194
--webserver_port=32981
--tserver_master_addrs=127.26.206.254:40593
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.206.194
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:53:16.314234 11681 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:53:16.315464 11681 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:53:16.328416 11686 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:53:16.328378 11687 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:53:16.328707 11689 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:53:16.329509 11681 server_base.cc:1034] running on GCE node
I20260808 14:53:16.330078 11681 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:53:16.331220 11681 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:53:16.332432 11681 hybrid_clock.cc:648] HybridClock initialized: now 1786200796332381 us; error 39 us; skew 500 ppm
I20260808 14:53:16.332716 11681 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:53:16 dist-test-slave-6k22 krb5kdc[10822](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200796, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:53:16.335762 11681 init.cc:377] Logged in from keytab as kudu/127.26.206.194@KRBTEST.COM (short username kudu)
I20260808 14:53:16.337049 11681 webserver.cc:460] Webserver started at http://127.26.206.194:32981/ using document root <none> and password file <none>
I20260808 14:53:16.337668 11681 fs_manager.cc:359] Metadata directory not provided
I20260808 14:53:16.337783 11681 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:53:16.342754 11681 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.001s sys 0.001s
I20260808 14:53:16.345340 11696 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:53:16.346704 11681 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 14:53:16.346869 11681 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-1/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-1/wal
uuid: "9bdb12b7a2984ad6bae08231e419279a"
format_stamp: "Formatted at 2026-08-08 14:53:13 on dist-test-slave-6k22"
server_key: "9a04eafece52a059d664a4684ded196d"
server_key_iv: "892904062b62e5146f15fae9d2a90f24"
server_key_version: "encryptionkey@0"
I20260808 14:53:16.347904 11681 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:53:16.367686 11681 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:53:16.371284 11681 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:53:16.371528 11681 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:53:16.372471 11681 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:53:16.373760 11681 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:53:16.373890 11681 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:53:16.374007 11681 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:53:16.374099 11681 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:53:16.405236 11681 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.194:32785
I20260808 14:53:16.405319 11822 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.194:32785 every 8 connection(s)
I20260808 14:53:16.406678 11681 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-1/data/info.pb
I20260808 14:53:16.411882 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 11681
I20260808 14:53:16.412487 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.206.195:34885
--local_ip_for_outbound_sockets=127.26.206.195
--tserver_master_addrs=127.26.206.254:40593
--webserver_port=46099
--webserver_interface=127.26.206.195
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.195.keytab
--principal=kudu/127.26.206.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.206.212:42083
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 14:53:16 dist-test-slave-6k22 krb5kdc[10822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200796, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.194@KRBTEST.COM for kudu/127.26.206.254@KRBTEST.COM
I20260808 14:53:16.430872 11679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:16.409281 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.194:51635 (local address 127.26.206.254:40593)
0808 14:53:16.409487 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0808 14:53:16.409491 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:53:16.410865 (+ 1374us) server_negotiation.cc:407] Connection header received
0808 14:53:16.413088 (+ 2223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:53:16.413094 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:53:16.413197 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:53:16.413327 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:53:16.415008 (+ 1681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:16.415872 (+ 864us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:16.417548 (+ 1676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:16.418002 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:16.418154 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:53:16.424733 (+ 6579us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:53:16.424738 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:53:16.424741 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:53:16.424777 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:53:16.427607 (+ 2830us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:53:16.428357 (+ 750us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:53:16.428366 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:53:16.428372 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:53:16.428518 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:53:16.428972 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:53:16.428978 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:53:16.428982 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:53:16.429287 (+ 305us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:53:16.429456 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0808 14:53:16.430180 (+ 724us) server_negotiation.cc:299] Negotiation successful
0808 14:53:16.430439 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":98}
I20260808 14:53:16.432109 11825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:16.409757 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:40593 (local address 127.26.206.194:51635)
0808 14:53:16.410692 (+ 935us) negotiation.cc:107] Waiting for socket to connect
0808 14:53:16.410741 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0808 14:53:16.412792 (+ 2051us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:53:16.413589 (+ 797us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:53:16.413599 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:53:16.414121 (+ 522us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:53:16.414820 (+ 699us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:53:16.414840 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:53:16.416048 (+ 1208us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:53:16.416053 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:53:16.417366 (+ 1313us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:53:16.417379 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:53:16.418270 (+ 891us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:53:16.418278 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:53:16.418534 (+ 256us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:53:16.419283 (+ 749us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:53:16.419313 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:53:16.424498 (+ 5185us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:53:16.427754 (+ 3256us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:53:16.427764 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:53:16.427779 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:53:16.428210 (+ 431us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:53:16.428638 (+ 428us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:53:16.428644 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:53:16.428648 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:53:16.428848 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:53:16.429426 (+ 578us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:53:16.429435 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:53:16.429782 (+ 347us) client_negotiation.cc:769] Sending connection context
0808 14:53:16.430084 (+ 302us) client_negotiation.cc:240] Negotiation successful
0808 14:53:16.430619 (+ 535us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":591,"thread_start_us":381,"threads_started":1}
I20260808 14:53:16.433769 11823 heartbeater.cc:347] Connected to a master server at 127.26.206.254:40593
I20260808 14:53:16.434093 11823 heartbeater.cc:464] Registering TS with master...
I20260808 14:53:16.434863 11823 heartbeater.cc:511] Master 127.26.206.254:40593 requested a full tablet report, sending...
I20260808 14:53:16.436378 11469 ts_manager.cc:194] Registered new tserver with Master: 9bdb12b7a2984ad6bae08231e419279a (127.26.206.194:32785)
I20260808 14:53:16.437247 11469 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.206.194@KRBTEST.COM'} at 127.26.206.194:51635
W20260808 14:53:16.741933 11826 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:53:16.742228 11826 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:53:16.742414 11826 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:53:16.749509 11826 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:53:16.749639 11826 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:53:16.749799 11826 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.206.195
I20260808 14:53:16.758821 11826 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:42083
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.195.keytab
--principal=kudu/127.26.206.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.206.195:34885
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.206.195
--webserver_port=46099
--tserver_master_addrs=127.26.206.254:40593
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.206.195
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:53:16.760097 11826 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:53:16.761389 11826 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:53:16.774160 11833 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:53:16.774179 11831 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:53:16.774341 11835 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:53:16.775060 11826 server_base.cc:1034] running on GCE node
I20260808 14:53:16.775677 11826 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:53:16.776541 11826 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:53:16.777766 11826 hybrid_clock.cc:648] HybridClock initialized: now 1786200796777726 us; error 55 us; skew 500 ppm
I20260808 14:53:16.778069 11826 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:53:16 dist-test-slave-6k22 krb5kdc[10822](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200796, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:53:16.781277 11826 init.cc:377] Logged in from keytab as kudu/127.26.206.195@KRBTEST.COM (short username kudu)
I20260808 14:53:16.782655 11826 webserver.cc:460] Webserver started at http://127.26.206.195:46099/ using document root <none> and password file <none>
I20260808 14:53:16.783371 11826 fs_manager.cc:359] Metadata directory not provided
I20260808 14:53:16.783519 11826 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:53:16.788890 11826 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.001s sys 0.003s
I20260808 14:53:16.791543 11842 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:53:16.792881 11826 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 14:53:16.793041 11826 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-2/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-2/wal
uuid: "d262cd4649d64d90a2bcfc3e73ac8e3c"
format_stamp: "Formatted at 2026-08-08 14:53:13 on dist-test-slave-6k22"
server_key: "8d4ce90d0e39aa631a55cd76faeeec84"
server_key_iv: "c99bd1bf361401cfeef856d007647262"
server_key_version: "encryptionkey@0"
I20260808 14:53:16.793993 11826 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:53:16.810195 11826 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:53:16.813951 11826 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:53:16.814213 11826 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:53:16.815131 11826 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:53:16.816421 11826 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:53:16.816515 11826 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:53:16.816668 11826 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:53:16.816752 11826 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:53:16.848453 11826 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.195:34885
I20260808 14:53:16.848538 11964 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.195:34885 every 8 connection(s)
I20260808 14:53:16.849848 11826 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-2/data/info.pb
I20260808 14:53:16.851085 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 11826
Aug 08 14:53:16 dist-test-slave-6k22 krb5kdc[10822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200796, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.195@KRBTEST.COM for kudu/127.26.206.254@KRBTEST.COM
I20260808 14:53:16.866284 11679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:16.852207 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47584 (local address 127.26.206.254:40593)
0808 14:53:16.852455 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0808 14:53:16.852461 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:53:16.853057 (+ 596us) server_negotiation.cc:407] Connection header received
0808 14:53:16.853271 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:53:16.853283 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:53:16.853381 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:53:16.853492 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:53:16.855069 (+ 1577us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:16.855935 (+ 866us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:16.857246 (+ 1311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:16.857666 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:16.857800 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:53:16.860592 (+ 2792us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:53:16.860597 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:53:16.860600 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:53:16.860629 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:53:16.863535 (+ 2906us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:53:16.864316 (+ 781us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:53:16.864320 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:53:16.864322 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:53:16.864443 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:53:16.864881 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:53:16.864888 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:53:16.864892 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:53:16.865182 (+ 290us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:53:16.865377 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0808 14:53:16.865794 (+ 417us) server_negotiation.cc:299] Negotiation successful
0808 14:53:16.865986 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260808 14:53:16.870785 11968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:16.852464 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.195:40497 (local address 127.26.206.254:40593)
0808 14:53:16.855185 (+ 2721us) server_negotiation.cc:206] Beginning negotiation
0808 14:53:16.855196 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 14:53:16.855211 (+ 15us) server_negotiation.cc:407] Connection header received
0808 14:53:16.856124 (+ 913us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:53:16.856129 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:53:16.856201 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:53:16.856325 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:53:16.857689 (+ 1364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:16.858615 (+ 926us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:16.860167 (+ 1552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:16.860668 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:16.860799 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:53:16.864105 (+ 3306us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:53:16.864114 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:53:16.864120 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:53:16.864153 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:53:16.867188 (+ 3035us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:53:16.868044 (+ 856us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:53:16.868048 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:53:16.868051 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:53:16.868196 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:53:16.868655 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:53:16.868660 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:53:16.868663 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:53:16.869109 (+ 446us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:53:16.869285 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0808 14:53:16.870053 (+ 768us) server_negotiation.cc:299] Negotiation successful
0808 14:53:16.870308 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2600,"thread_start_us":881,"threads_started":1}
I20260808 14:53:16.871517 11970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:16.853252 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:40593 (local address 127.26.206.195:40497)
0808 14:53:16.854123 (+ 871us) negotiation.cc:107] Waiting for socket to connect
0808 14:53:16.854173 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0808 14:53:16.855888 (+ 1715us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:53:16.856543 (+ 655us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:53:16.856551 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:53:16.857003 (+ 452us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:53:16.857525 (+ 522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:53:16.857540 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:53:16.858766 (+ 1226us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:53:16.858769 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:53:16.860030 (+ 1261us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:53:16.860041 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:53:16.860894 (+ 853us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:53:16.860901 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:53:16.861120 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:53:16.861594 (+ 474us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:53:16.861613 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:53:16.863889 (+ 2276us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:53:16.867321 (+ 3432us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:53:16.867350 (+ 29us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:53:16.867366 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:53:16.867914 (+ 548us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:53:16.868305 (+ 391us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:53:16.868309 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:53:16.868311 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:53:16.868526 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:53:16.869261 (+ 735us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:53:16.869269 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:53:16.869651 (+ 382us) client_negotiation.cc:769] Sending connection context
0808 14:53:16.869912 (+ 261us) client_negotiation.cc:240] Negotiation successful
0808 14:53:16.870394 (+ 482us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":577,"thread_start_us":352,"threads_started":1}
I20260808 14:53:16.872756 11965 heartbeater.cc:347] Connected to a master server at 127.26.206.254:40593
I20260808 14:53:16.873051 11965 heartbeater.cc:464] Registering TS with master...
I20260808 14:53:16.873723 11965 heartbeater.cc:511] Master 127.26.206.254:40593 requested a full tablet report, sending...
I20260808 14:53:16.874951 11469 ts_manager.cc:194] Registered new tserver with Master: d262cd4649d64d90a2bcfc3e73ac8e3c (127.26.206.195:34885)
I20260808 14:53:16.875831 11469 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.206.195@KRBTEST.COM'} at 127.26.206.195:40497
I20260808 14:53:16.880800 27451 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 14:53:16.887552 11968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:16.881649 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47588 (local address 127.26.206.254:40593)
0808 14:53:16.881834 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0808 14:53:16.881842 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:53:16.882288 (+ 446us) server_negotiation.cc:407] Connection header received
0808 14:53:16.882463 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:53:16.882467 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:53:16.882579 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:53:16.882688 (+ 109us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:53:16.883050 (+ 362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:16.884063 (+ 1013us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:16.885598 (+ 1535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:16.885998 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:16.886090 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:53:16.886568 (+ 478us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:53:16.887009 (+ 441us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:53:16.887116 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0808 14:53:16.887201 (+ 85us) server_negotiation.cc:299] Negotiation successful
0808 14:53:16.887256 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260808 14:53:16.888517 11469 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:47588:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:53:16.895641 11469 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:53:16.931299 11979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:16.907927 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53532 (local address 127.26.206.195:34885)
0808 14:53:16.922821 (+ 14894us) server_negotiation.cc:206] Beginning negotiation
0808 14:53:16.922829 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:53:16.922865 (+ 36us) server_negotiation.cc:407] Connection header received
0808 14:53:16.922961 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:53:16.922970 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:53:16.923698 (+ 728us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:53:16.923971 (+ 273us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:53:16.924666 (+ 695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:16.925931 (+ 1265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:16.929023 (+ 3092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:16.930083 (+ 1060us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:16.930313 (+ 230us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:53:16.930499 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0808 14:53:16.930761 (+ 262us) server_negotiation.cc:299] Negotiation successful
0808 14:53:16.930931 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14681,"thread_start_us":14528,"threads_started":1}
I20260808 14:53:16.931485 11976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:16.907699 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.195:34885 (local address 127.0.0.1:53532)
0808 14:53:16.922017 (+ 14318us) negotiation.cc:107] Waiting for socket to connect
0808 14:53:16.922037 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 14:53:16.922173 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:53:16.923990 (+ 1817us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:53:16.923996 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:53:16.924025 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:53:16.924456 (+ 431us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:53:16.924472 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:53:16.926071 (+ 1599us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:53:16.926078 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:53:16.928839 (+ 2761us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:53:16.928854 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:53:16.930313 (+ 1459us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:53:16.930320 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:53:16.930515 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:53:16.930576 (+ 61us) client_negotiation.cc:769] Sending connection context
0808 14:53:16.930716 (+ 140us) client_negotiation.cc:240] Negotiation successful
0808 14:53:16.930911 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14171,"mutex_wait_us":138,"thread_start_us":11985,"threads_started":1}
I20260808 14:53:16.932463 11977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:16.907686 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41912 (local address 127.26.206.193:40683)
0808 14:53:16.923974 (+ 16288us) server_negotiation.cc:206] Beginning negotiation
0808 14:53:16.923982 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:53:16.924008 (+ 26us) server_negotiation.cc:407] Connection header received
0808 14:53:16.924117 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:53:16.924124 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:53:16.924373 (+ 249us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:53:16.924591 (+ 218us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:53:16.925278 (+ 687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:16.926659 (+ 1381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:16.929336 (+ 2677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:16.930863 (+ 1527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:16.931024 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:53:16.931181 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0808 14:53:16.931954 (+ 773us) server_negotiation.cc:299] Negotiation successful
0808 14:53:16.932114 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16114,"thread_start_us":15961,"threads_started":1}
I20260808 14:53:16.933156 11978 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:16.907594 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.193:40683 (local address 127.0.0.1:41912)
0808 14:53:16.920182 (+ 12588us) negotiation.cc:107] Waiting for socket to connect
0808 14:53:16.920235 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0808 14:53:16.920447 (+ 212us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:53:16.924723 (+ 4276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:53:16.924730 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:53:16.924761 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:53:16.925080 (+ 319us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:53:16.925095 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:53:16.926806 (+ 1711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:53:16.926816 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:53:16.929154 (+ 2338us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:53:16.929174 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:53:16.931373 (+ 2199us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:53:16.931380 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:53:16.931709 (+ 329us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:53:16.931742 (+ 33us) client_negotiation.cc:769] Sending connection context
0808 14:53:16.931825 (+ 83us) client_negotiation.cc:240] Negotiation successful
0808 14:53:16.932750 (+ 925us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12264,"mutex_wait_us":73,"thread_start_us":14138,"threads_started":1}
I20260808 14:53:16.935109 11896 tablet_service.cc:1467] Processing CreateTablet for tablet 4ebf4627c4724a45b76109afc135618a (DEFAULT_TABLE table=test-table [id=6ad6bf84be954b3f8d45f56e45b32ebe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:53:16.936499 11982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:16.923071 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.194:32785 (local address 127.0.0.1:33466)
0808 14:53:16.924403 (+ 1332us) negotiation.cc:107] Waiting for socket to connect
0808 14:53:16.924427 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0808 14:53:16.924662 (+ 235us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:53:16.925517 (+ 855us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:53:16.925523 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:53:16.925551 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:53:16.925955 (+ 404us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:53:16.925967 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:53:16.927931 (+ 1964us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:53:16.927937 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:53:16.930127 (+ 2190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:53:16.930142 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:53:16.932706 (+ 2564us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:53:16.932715 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:53:16.935896 (+ 3181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:53:16.935929 (+ 33us) client_negotiation.cc:769] Sending connection context
0808 14:53:16.936022 (+ 93us) client_negotiation.cc:240] Negotiation successful
0808 14:53:16.936161 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1187,"mutex_wait_us":37,"thread_start_us":272,"threads_started":1}
I20260808 14:53:16.936525 11896 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4ebf4627c4724a45b76109afc135618a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:53:16.936609 11980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:16.922466 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33466 (local address 127.26.206.194:32785)
0808 14:53:16.923141 (+ 675us) server_negotiation.cc:206] Beginning negotiation
0808 14:53:16.923155 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 14:53:16.924553 (+ 1398us) server_negotiation.cc:407] Connection header received
0808 14:53:16.924869 (+ 316us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:53:16.924875 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:53:16.925024 (+ 149us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:53:16.925154 (+ 130us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:53:16.926225 (+ 1071us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:16.927752 (+ 1527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:16.930306 (+ 2554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:16.931734 (+ 1428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:16.931909 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:53:16.932057 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0808 14:53:16.936116 (+ 4059us) server_negotiation.cc:299] Negotiation successful
0808 14:53:16.936291 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":474,"thread_start_us":301,"threads_started":1}
I20260808 14:53:16.936126 11605 tablet_service.cc:1467] Processing CreateTablet for tablet 4ebf4627c4724a45b76109afc135618a (DEFAULT_TABLE table=test-table [id=6ad6bf84be954b3f8d45f56e45b32ebe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:53:16.937517 11605 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4ebf4627c4724a45b76109afc135618a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:53:16.940132 11753 tablet_service.cc:1467] Processing CreateTablet for tablet 4ebf4627c4724a45b76109afc135618a (DEFAULT_TABLE table=test-table [id=6ad6bf84be954b3f8d45f56e45b32ebe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:53:16.941403 11753 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4ebf4627c4724a45b76109afc135618a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:53:16.949920 11983 tablet_bootstrap.cc:492] T 4ebf4627c4724a45b76109afc135618a P f3812b4693ca412a9ebd05153fa0161e: Bootstrap starting.
I20260808 14:53:16.954509 11983 tablet_bootstrap.cc:654] T 4ebf4627c4724a45b76109afc135618a P f3812b4693ca412a9ebd05153fa0161e: Neither blocks nor log segments found. Creating new log.
I20260808 14:53:16.955511 11984 tablet_bootstrap.cc:492] T 4ebf4627c4724a45b76109afc135618a P d262cd4649d64d90a2bcfc3e73ac8e3c: Bootstrap starting.
I20260808 14:53:16.956236 11983 log.cc:824] T 4ebf4627c4724a45b76109afc135618a P f3812b4693ca412a9ebd05153fa0161e: Log is configured to *not* fsync() on all Append() calls
I20260808 14:53:16.961074 11984 tablet_bootstrap.cc:654] T 4ebf4627c4724a45b76109afc135618a P d262cd4649d64d90a2bcfc3e73ac8e3c: Neither blocks nor log segments found. Creating new log.
I20260808 14:53:16.962925 11984 log.cc:824] T 4ebf4627c4724a45b76109afc135618a P d262cd4649d64d90a2bcfc3e73ac8e3c: Log is configured to *not* fsync() on all Append() calls
I20260808 14:53:16.963366 11985 tablet_bootstrap.cc:492] T 4ebf4627c4724a45b76109afc135618a P 9bdb12b7a2984ad6bae08231e419279a: Bootstrap starting.
I20260808 14:53:16.967818 11983 tablet_bootstrap.cc:492] T 4ebf4627c4724a45b76109afc135618a P f3812b4693ca412a9ebd05153fa0161e: No bootstrap required, opened a new log
I20260808 14:53:16.968146 11983 ts_tablet_manager.cc:1397] T 4ebf4627c4724a45b76109afc135618a P f3812b4693ca412a9ebd05153fa0161e: Time spent bootstrapping tablet: real 0.018s user 0.009s sys 0.007s
I20260808 14:53:16.973109 11985 tablet_bootstrap.cc:654] T 4ebf4627c4724a45b76109afc135618a P 9bdb12b7a2984ad6bae08231e419279a: Neither blocks nor log segments found. Creating new log.
I20260808 14:53:16.975006 11985 log.cc:824] T 4ebf4627c4724a45b76109afc135618a P 9bdb12b7a2984ad6bae08231e419279a: Log is configured to *not* fsync() on all Append() calls
I20260808 14:53:16.978940 11983 raft_consensus.cc:348] T 4ebf4627c4724a45b76109afc135618a P f3812b4693ca412a9ebd05153fa0161e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3812b4693ca412a9ebd05153fa0161e" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 40683 } } peers { permanent_uuid: "d262cd4649d64d90a2bcfc3e73ac8e3c" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 34885 } } peers { permanent_uuid: "9bdb12b7a2984ad6bae08231e419279a" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 32785 } }
I20260808 14:53:16.979430 11983 raft_consensus.cc:374] T 4ebf4627c4724a45b76109afc135618a P f3812b4693ca412a9ebd05153fa0161e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:53:16.979542 11983 raft_consensus.cc:729] T 4ebf4627c4724a45b76109afc135618a P f3812b4693ca412a9ebd05153fa0161e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3812b4693ca412a9ebd05153fa0161e, State: Initialized, Role: FOLLOWER
I20260808 14:53:16.979823 11984 tablet_bootstrap.cc:492] T 4ebf4627c4724a45b76109afc135618a P d262cd4649d64d90a2bcfc3e73ac8e3c: No bootstrap required, opened a new log
I20260808 14:53:16.980070 11985 tablet_bootstrap.cc:492] T 4ebf4627c4724a45b76109afc135618a P 9bdb12b7a2984ad6bae08231e419279a: No bootstrap required, opened a new log
I20260808 14:53:16.980201 11984 ts_tablet_manager.cc:1397] T 4ebf4627c4724a45b76109afc135618a P d262cd4649d64d90a2bcfc3e73ac8e3c: Time spent bootstrapping tablet: real 0.025s user 0.010s sys 0.012s
I20260808 14:53:16.980351 11985 ts_tablet_manager.cc:1397] T 4ebf4627c4724a45b76109afc135618a P 9bdb12b7a2984ad6bae08231e419279a: Time spent bootstrapping tablet: real 0.017s user 0.011s sys 0.000s
I20260808 14:53:16.980242 11983 consensus_queue.cc:260] T 4ebf4627c4724a45b76109afc135618a P f3812b4693ca412a9ebd05153fa0161e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3812b4693ca412a9ebd05153fa0161e" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 40683 } } peers { permanent_uuid: "d262cd4649d64d90a2bcfc3e73ac8e3c" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 34885 } } peers { permanent_uuid: "9bdb12b7a2984ad6bae08231e419279a" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 32785 } }
I20260808 14:53:16.981431 11677 heartbeater.cc:503] Master 127.26.206.254:40593 was elected leader, sending a full tablet report...
I20260808 14:53:16.982034 11983 ts_tablet_manager.cc:1428] T 4ebf4627c4724a45b76109afc135618a P f3812b4693ca412a9ebd05153fa0161e: Time spent starting tablet: real 0.014s user 0.009s sys 0.004s
I20260808 14:53:16.989456 11985 raft_consensus.cc:348] T 4ebf4627c4724a45b76109afc135618a P 9bdb12b7a2984ad6bae08231e419279a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3812b4693ca412a9ebd05153fa0161e" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 40683 } } peers { permanent_uuid: "d262cd4649d64d90a2bcfc3e73ac8e3c" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 34885 } } peers { permanent_uuid: "9bdb12b7a2984ad6bae08231e419279a" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 32785 } }
I20260808 14:53:16.989827 11985 raft_consensus.cc:374] T 4ebf4627c4724a45b76109afc135618a P 9bdb12b7a2984ad6bae08231e419279a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:53:16.989934 11985 raft_consensus.cc:729] T 4ebf4627c4724a45b76109afc135618a P 9bdb12b7a2984ad6bae08231e419279a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bdb12b7a2984ad6bae08231e419279a, State: Initialized, Role: FOLLOWER
I20260808 14:53:16.990159 11984 raft_consensus.cc:348] T 4ebf4627c4724a45b76109afc135618a P d262cd4649d64d90a2bcfc3e73ac8e3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3812b4693ca412a9ebd05153fa0161e" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 40683 } } peers { permanent_uuid: "d262cd4649d64d90a2bcfc3e73ac8e3c" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 34885 } } peers { permanent_uuid: "9bdb12b7a2984ad6bae08231e419279a" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 32785 } }
I20260808 14:53:16.990623 11984 raft_consensus.cc:374] T 4ebf4627c4724a45b76109afc135618a P d262cd4649d64d90a2bcfc3e73ac8e3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:53:16.990459 11985 consensus_queue.cc:260] T 4ebf4627c4724a45b76109afc135618a P 9bdb12b7a2984ad6bae08231e419279a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3812b4693ca412a9ebd05153fa0161e" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 40683 } } peers { permanent_uuid: "d262cd4649d64d90a2bcfc3e73ac8e3c" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 34885 } } peers { permanent_uuid: "9bdb12b7a2984ad6bae08231e419279a" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 32785 } }
I20260808 14:53:16.990741 11984 raft_consensus.cc:729] T 4ebf4627c4724a45b76109afc135618a P d262cd4649d64d90a2bcfc3e73ac8e3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d262cd4649d64d90a2bcfc3e73ac8e3c, State: Initialized, Role: FOLLOWER
I20260808 14:53:16.991393 11984 consensus_queue.cc:260] T 4ebf4627c4724a45b76109afc135618a P d262cd4649d64d90a2bcfc3e73ac8e3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3812b4693ca412a9ebd05153fa0161e" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 40683 } } peers { permanent_uuid: "d262cd4649d64d90a2bcfc3e73ac8e3c" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 34885 } } peers { permanent_uuid: "9bdb12b7a2984ad6bae08231e419279a" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 32785 } }
I20260808 14:53:16.991671 11823 heartbeater.cc:503] Master 127.26.206.254:40593 was elected leader, sending a full tablet report...
I20260808 14:53:16.992236 11985 ts_tablet_manager.cc:1428] T 4ebf4627c4724a45b76109afc135618a P 9bdb12b7a2984ad6bae08231e419279a: Time spent starting tablet: real 0.012s user 0.007s sys 0.005s
I20260808 14:53:16.992607 11965 heartbeater.cc:503] Master 127.26.206.254:40593 was elected leader, sending a full tablet report...
I20260808 14:53:16.993244 11984 ts_tablet_manager.cc:1428] T 4ebf4627c4724a45b76109afc135618a P d262cd4649d64d90a2bcfc3e73ac8e3c: Time spent starting tablet: real 0.013s user 0.012s sys 0.000s
I20260808 14:53:17.064149 11990 raft_consensus.cc:482] T 4ebf4627c4724a45b76109afc135618a P 9bdb12b7a2984ad6bae08231e419279a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:53:17.064522 11990 raft_consensus.cc:504] T 4ebf4627c4724a45b76109afc135618a P 9bdb12b7a2984ad6bae08231e419279a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3812b4693ca412a9ebd05153fa0161e" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 40683 } } peers { permanent_uuid: "d262cd4649d64d90a2bcfc3e73ac8e3c" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 34885 } } peers { permanent_uuid: "9bdb12b7a2984ad6bae08231e419279a" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 32785 } }
I20260808 14:53:17.066239 11990 leader_election.cc:288] T 4ebf4627c4724a45b76109afc135618a P 9bdb12b7a2984ad6bae08231e419279a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3812b4693ca412a9ebd05153fa0161e (127.26.206.193:40683), d262cd4649d64d90a2bcfc3e73ac8e3c (127.26.206.195:34885)
I20260808 14:53:17.075853 11977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:17.066824 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.194:33069 (local address 127.26.206.193:40683)
0808 14:53:17.067011 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0808 14:53:17.067016 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:53:17.068201 (+ 1185us) server_negotiation.cc:407] Connection header received
0808 14:53:17.068444 (+ 243us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:53:17.068452 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:53:17.068535 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:53:17.068597 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:53:17.069443 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:17.070531 (+ 1088us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:17.073403 (+ 2872us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:17.074720 (+ 1317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:17.074908 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:53:17.075015 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0808 14:53:17.075432 (+ 417us) server_negotiation.cc:299] Negotiation successful
0808 14:53:17.075587 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260808 14:53:17.076197 11993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:17.066824 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.193:40683 (local address 127.26.206.194:33069)
0808 14:53:17.068098 (+ 1274us) negotiation.cc:107] Waiting for socket to connect
0808 14:53:17.068112 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 14:53:17.068251 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:53:17.068806 (+ 555us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:53:17.068809 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:53:17.068837 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:53:17.069268 (+ 431us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:53:17.069281 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:53:17.070691 (+ 1410us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:53:17.070696 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:53:17.073187 (+ 2491us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:53:17.073202 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:53:17.075032 (+ 1830us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:53:17.075042 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:53:17.075238 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:53:17.075273 (+ 35us) client_negotiation.cc:769] Sending connection context
0808 14:53:17.075391 (+ 118us) client_negotiation.cc:240] Negotiation successful
0808 14:53:17.075521 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1122,"mutex_wait_us":270,"thread_start_us":665,"threads_started":1}
I20260808 14:53:17.077399 11979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:17.066757 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.194:58913 (local address 127.26.206.195:34885)
0808 14:53:17.067038 (+ 281us) server_negotiation.cc:206] Beginning negotiation
0808 14:53:17.067047 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:53:17.067815 (+ 768us) server_negotiation.cc:407] Connection header received
0808 14:53:17.068074 (+ 259us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:53:17.068092 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:53:17.068186 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:53:17.068318 (+ 132us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:53:17.068956 (+ 638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:17.070754 (+ 1798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:17.075105 (+ 4351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:17.076367 (+ 1262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:17.076538 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:53:17.076615 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0808 14:53:17.077007 (+ 392us) server_negotiation.cc:299] Negotiation successful
0808 14:53:17.077143 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":109}
I20260808 14:53:17.077436 11992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:17.066824 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.195:34885 (local address 127.26.206.194:58913)
0808 14:53:17.067682 (+ 858us) negotiation.cc:107] Waiting for socket to connect
0808 14:53:17.067710 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0808 14:53:17.067898 (+ 188us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:53:17.068334 (+ 436us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:53:17.068339 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:53:17.068365 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:53:17.068714 (+ 349us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:53:17.068729 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:53:17.070889 (+ 2160us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:53:17.070895 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:53:17.073187 (+ 2292us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:53:17.073202 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:53:17.076562 (+ 3360us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:53:17.076568 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:53:17.076784 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:53:17.076836 (+ 52us) client_negotiation.cc:769] Sending connection context
0808 14:53:17.076940 (+ 104us) client_negotiation.cc:240] Negotiation successful
0808 14:53:17.077063 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":662,"mutex_wait_us":35,"thread_start_us":469,"threads_started":1}
I20260808 14:53:17.077369 11626 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ebf4627c4724a45b76109afc135618a" candidate_uuid: "9bdb12b7a2984ad6bae08231e419279a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3812b4693ca412a9ebd05153fa0161e" is_pre_election: true
I20260808 14:53:17.079743 11626 raft_consensus.cc:2454] T 4ebf4627c4724a45b76109afc135618a P f3812b4693ca412a9ebd05153fa0161e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bdb12b7a2984ad6bae08231e419279a in term 0.
I20260808 14:53:17.081115 11700 leader_election.cc:302] T 4ebf4627c4724a45b76109afc135618a P 9bdb12b7a2984ad6bae08231e419279a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bdb12b7a2984ad6bae08231e419279a, f3812b4693ca412a9ebd05153fa0161e; no voters:
I20260808 14:53:17.081293 11916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ebf4627c4724a45b76109afc135618a" candidate_uuid: "9bdb12b7a2984ad6bae08231e419279a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d262cd4649d64d90a2bcfc3e73ac8e3c" is_pre_election: true
I20260808 14:53:17.081553 11990 raft_consensus.cc:2781] T 4ebf4627c4724a45b76109afc135618a P 9bdb12b7a2984ad6bae08231e419279a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:53:17.081707 11990 raft_consensus.cc:482] T 4ebf4627c4724a45b76109afc135618a P 9bdb12b7a2984ad6bae08231e419279a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:53:17.081830 11990 raft_consensus.cc:3037] T 4ebf4627c4724a45b76109afc135618a P 9bdb12b7a2984ad6bae08231e419279a [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:53:17.081871 11916 raft_consensus.cc:2454] T 4ebf4627c4724a45b76109afc135618a P d262cd4649d64d90a2bcfc3e73ac8e3c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bdb12b7a2984ad6bae08231e419279a in term 0.
I20260808 14:53:17.084275 11990 raft_consensus.cc:504] T 4ebf4627c4724a45b76109afc135618a P 9bdb12b7a2984ad6bae08231e419279a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3812b4693ca412a9ebd05153fa0161e" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 40683 } } peers { permanent_uuid: "d262cd4649d64d90a2bcfc3e73ac8e3c" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 34885 } } peers { permanent_uuid: "9bdb12b7a2984ad6bae08231e419279a" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 32785 } }
I20260808 14:53:17.084877 11990 leader_election.cc:288] T 4ebf4627c4724a45b76109afc135618a P 9bdb12b7a2984ad6bae08231e419279a [CANDIDATE]: Term 1 election: Requested vote from peers f3812b4693ca412a9ebd05153fa0161e (127.26.206.193:40683), d262cd4649d64d90a2bcfc3e73ac8e3c (127.26.206.195:34885)
I20260808 14:53:17.085235 11626 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ebf4627c4724a45b76109afc135618a" candidate_uuid: "9bdb12b7a2984ad6bae08231e419279a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3812b4693ca412a9ebd05153fa0161e"
I20260808 14:53:17.085353 11916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ebf4627c4724a45b76109afc135618a" candidate_uuid: "9bdb12b7a2984ad6bae08231e419279a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d262cd4649d64d90a2bcfc3e73ac8e3c"
I20260808 14:53:17.085457 11626 raft_consensus.cc:3037] T 4ebf4627c4724a45b76109afc135618a P f3812b4693ca412a9ebd05153fa0161e [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:53:17.085547 11916 raft_consensus.cc:3037] T 4ebf4627c4724a45b76109afc135618a P d262cd4649d64d90a2bcfc3e73ac8e3c [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:53:17.088802 11916 raft_consensus.cc:2454] T 4ebf4627c4724a45b76109afc135618a P d262cd4649d64d90a2bcfc3e73ac8e3c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bdb12b7a2984ad6bae08231e419279a in term 1.
I20260808 14:53:17.088792 11626 raft_consensus.cc:2454] T 4ebf4627c4724a45b76109afc135618a P f3812b4693ca412a9ebd05153fa0161e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bdb12b7a2984ad6bae08231e419279a in term 1.
I20260808 14:53:17.089207 11699 leader_election.cc:302] T 4ebf4627c4724a45b76109afc135618a P 9bdb12b7a2984ad6bae08231e419279a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bdb12b7a2984ad6bae08231e419279a, d262cd4649d64d90a2bcfc3e73ac8e3c; no voters:
I20260808 14:53:17.089479 11990 raft_consensus.cc:2781] T 4ebf4627c4724a45b76109afc135618a P 9bdb12b7a2984ad6bae08231e419279a [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:53:17.089931 11990 raft_consensus.cc:686] T 4ebf4627c4724a45b76109afc135618a P 9bdb12b7a2984ad6bae08231e419279a [term 1 LEADER]: Becoming Leader. State: Replica: 9bdb12b7a2984ad6bae08231e419279a, State: Running, Role: LEADER
I20260808 14:53:17.090379 11990 consensus_queue.cc:237] T 4ebf4627c4724a45b76109afc135618a P 9bdb12b7a2984ad6bae08231e419279a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3812b4693ca412a9ebd05153fa0161e" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 40683 } } peers { permanent_uuid: "d262cd4649d64d90a2bcfc3e73ac8e3c" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 34885 } } peers { permanent_uuid: "9bdb12b7a2984ad6bae08231e419279a" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 32785 } }
I20260808 14:53:17.095074 11469 catalog_manager.cc:5495] T 4ebf4627c4724a45b76109afc135618a P 9bdb12b7a2984ad6bae08231e419279a reported cstate change: term changed from 0 to 1, leader changed from <none> to 9bdb12b7a2984ad6bae08231e419279a (127.26.206.194). New cstate: current_term: 1 leader_uuid: "9bdb12b7a2984ad6bae08231e419279a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3812b4693ca412a9ebd05153fa0161e" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 40683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d262cd4649d64d90a2bcfc3e73ac8e3c" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 34885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bdb12b7a2984ad6bae08231e419279a" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 32785 } health_report { overall_health: HEALTHY } } }
W20260808 14:53:17.101627 11966 tablet.cc:2369] T 4ebf4627c4724a45b76109afc135618a P d262cd4649d64d90a2bcfc3e73ac8e3c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:53:17.125123 11980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:17.120200 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33470 (local address 127.26.206.194:32785)
0808 14:53:17.120390 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0808 14:53:17.120395 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:53:17.120412 (+ 17us) server_negotiation.cc:407] Connection header received
0808 14:53:17.120551 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:53:17.120554 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:53:17.120630 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:53:17.120791 (+ 161us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:53:17.121119 (+ 328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:17.121815 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:17.123172 (+ 1357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:17.123714 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:17.123831 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:53:17.124235 (+ 404us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:53:17.124698 (+ 463us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:53:17.124804 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0808 14:53:17.124877 (+ 73us) server_negotiation.cc:299] Negotiation successful
0808 14:53:17.124937 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260808 14:53:17.132969 11916 raft_consensus.cc:1261] T 4ebf4627c4724a45b76109afc135618a P d262cd4649d64d90a2bcfc3e73ac8e3c [term 1 FOLLOWER]: Refusing update from remote peer 9bdb12b7a2984ad6bae08231e419279a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:53:17.133013 11626 raft_consensus.cc:1261] T 4ebf4627c4724a45b76109afc135618a P f3812b4693ca412a9ebd05153fa0161e [term 1 FOLLOWER]: Refusing update from remote peer 9bdb12b7a2984ad6bae08231e419279a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:53:17.133908 11990 consensus_queue.cc:1035] T 4ebf4627c4724a45b76109afc135618a P 9bdb12b7a2984ad6bae08231e419279a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3812b4693ca412a9ebd05153fa0161e" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 40683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:53:17.134186 11994 consensus_queue.cc:1035] T 4ebf4627c4724a45b76109afc135618a P 9bdb12b7a2984ad6bae08231e419279a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d262cd4649d64d90a2bcfc3e73ac8e3c" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 34885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:53:17.145419 11996 mvcc.cc:205] Tried to move back new op lower bound from 7316278465046667264 to 7316278464885997568. Current Snapshot: MvccSnapshot[applied={T|T < 7316278465046667264}]
I20260808 14:53:17.161063 11468 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:47588:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:53:17.161350 11468 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:47588:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:53:17.164633 11468 catalog_manager.cc:5782] T 00000000000000000000000000000000 P fa7e80a4e89440429ab9555997d74967: Sending DeleteTablet for 3 replicas of tablet 4ebf4627c4724a45b76109afc135618a
I20260808 14:53:17.165699 11896 tablet_service.cc:1514] Processing DeleteTablet for tablet 4ebf4627c4724a45b76109afc135618a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:53:17 UTC) from {username='kudu', principal='kudu/127.26.206.254@KRBTEST.COM'} at 127.0.0.1:53532
I20260808 14:53:17.165971 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 11512
I20260808 14:53:17.166069 11605 tablet_service.cc:1514] Processing DeleteTablet for tablet 4ebf4627c4724a45b76109afc135618a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:53:17 UTC) from {username='kudu', principal='kudu/127.26.206.254@KRBTEST.COM'} at 127.0.0.1:41912
I20260808 14:53:17.166708 11753 tablet_service.cc:1514] Processing DeleteTablet for tablet 4ebf4627c4724a45b76109afc135618a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:53:17 UTC) from {username='kudu', principal='kudu/127.26.206.254@KRBTEST.COM'} at 127.0.0.1:33466
I20260808 14:53:17.192051 11977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:17.168327 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41926 (local address 127.26.206.193:40683)
0808 14:53:17.168560 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0808 14:53:17.168568 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:53:17.168590 (+ 22us) server_negotiation.cc:407] Connection header received
0808 14:53:17.168660 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:53:17.168668 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:53:17.168762 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:53:17.168874 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:53:17.171545 (+ 2671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:17.173044 (+ 1499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:17.175522 (+ 2478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:17.176389 (+ 867us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:17.176533 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:53:17.181346 (+ 4813us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:53:17.181365 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:53:17.181389 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:53:17.181476 (+ 87us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:53:17.186552 (+ 5076us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:53:17.187798 (+ 1246us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:53:17.187811 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:53:17.187816 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:53:17.188009 (+ 193us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:53:17.188630 (+ 621us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:53:17.188638 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:53:17.188644 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:53:17.189267 (+ 623us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:53:17.189682 (+ 415us) server_negotiation.cc:1035] Waiting for connection context
0808 14:53:17.191198 (+ 1516us) server_negotiation.cc:299] Negotiation successful
0808 14:53:17.191494 (+ 296us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260808 14:53:17.193467 11672 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:53:17.194123 12007 tablet_replica.cc:330] T 4ebf4627c4724a45b76109afc135618a P d262cd4649d64d90a2bcfc3e73ac8e3c: stopping tablet replica
I20260808 14:53:17.194550 12007 raft_consensus.cc:2229] T 4ebf4627c4724a45b76109afc135618a P d262cd4649d64d90a2bcfc3e73ac8e3c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:53:17.195029 12007 raft_consensus.cc:2258] T 4ebf4627c4724a45b76109afc135618a P d262cd4649d64d90a2bcfc3e73ac8e3c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:53:17.195861 12009 tablet_replica.cc:330] T 4ebf4627c4724a45b76109afc135618a P 9bdb12b7a2984ad6bae08231e419279a: stopping tablet replica
I20260808 14:53:17.196264 12009 raft_consensus.cc:2229] T 4ebf4627c4724a45b76109afc135618a P 9bdb12b7a2984ad6bae08231e419279a [term 1 LEADER]: Raft consensus shutting down.
I20260808 14:53:17.198946 12007 ts_tablet_manager.cc:1905] T 4ebf4627c4724a45b76109afc135618a P d262cd4649d64d90a2bcfc3e73ac8e3c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:53:17.202692 12009 raft_consensus.cc:2258] T 4ebf4627c4724a45b76109afc135618a P 9bdb12b7a2984ad6bae08231e419279a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:53:17.206763 12007 ts_tablet_manager.cc:1918] T 4ebf4627c4724a45b76109afc135618a P d262cd4649d64d90a2bcfc3e73ac8e3c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:53:17.206928 12007 log.cc:1196] T 4ebf4627c4724a45b76109afc135618a P d262cd4649d64d90a2bcfc3e73ac8e3c: Deleting WAL directory at /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-2/wal/wals/4ebf4627c4724a45b76109afc135618a
I20260808 14:53:17.207499 12007 ts_tablet_manager.cc:1939] T 4ebf4627c4724a45b76109afc135618a P d262cd4649d64d90a2bcfc3e73ac8e3c: Deleting consensus metadata
I20260808 14:53:17.209383 11453 catalog_manager.cc:4841] TS d262cd4649d64d90a2bcfc3e73ac8e3c (127.26.206.195:34885): tablet 4ebf4627c4724a45b76109afc135618a (table test-table [id=6ad6bf84be954b3f8d45f56e45b32ebe]) successfully deleted
I20260808 14:53:17.211884 12009 ts_tablet_manager.cc:1905] T 4ebf4627c4724a45b76109afc135618a P 9bdb12b7a2984ad6bae08231e419279a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:53:17.219508 12009 ts_tablet_manager.cc:1918] T 4ebf4627c4724a45b76109afc135618a P 9bdb12b7a2984ad6bae08231e419279a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:53:17.219730 12009 log.cc:1196] T 4ebf4627c4724a45b76109afc135618a P 9bdb12b7a2984ad6bae08231e419279a: Deleting WAL directory at /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-1/wal/wals/4ebf4627c4724a45b76109afc135618a
I20260808 14:53:17.220309 12009 ts_tablet_manager.cc:1939] T 4ebf4627c4724a45b76109afc135618a P 9bdb12b7a2984ad6bae08231e419279a: Deleting consensus metadata
I20260808 14:53:17.222231 11454 catalog_manager.cc:4841] TS 9bdb12b7a2984ad6bae08231e419279a (127.26.206.194:32785): tablet 4ebf4627c4724a45b76109afc135618a (table test-table [id=6ad6bf84be954b3f8d45f56e45b32ebe]) successfully deleted
I20260808 14:53:17.336867 12008 tablet_replica.cc:330] T 4ebf4627c4724a45b76109afc135618a P f3812b4693ca412a9ebd05153fa0161e: stopping tablet replica
I20260808 14:53:17.337443 12008 raft_consensus.cc:2229] T 4ebf4627c4724a45b76109afc135618a P f3812b4693ca412a9ebd05153fa0161e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:53:17.337818 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 11512
I20260808 14:53:17.338001 12008 raft_consensus.cc:2258] T 4ebf4627c4724a45b76109afc135618a P f3812b4693ca412a9ebd05153fa0161e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:53:17.366194 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 11681
W20260808 14:53:17.366273 11454 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.26.206.193:40683 (error 108)
I20260808 14:53:17.368693 11982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:17.368288 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.193:40683 (local address 127.0.0.1:41940)
0808 14:53:17.368458 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0808 14:53:17.368563 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.193:40683: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260808 14:53:17.369140 11454 catalog_manager.cc:4584] TS f3812b4693ca412a9ebd05153fa0161e (127.26.206.193:40683): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 4ebf4627c4724a45b76109afc135618a: Network error: Client connection negotiation failed: client connection to 127.26.206.193:40683: connect: Connection refused (error 111)
I20260808 14:53:17.382311 11980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:17.367017 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33480 (local address 127.26.206.194:32785)
0808 14:53:17.367242 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0808 14:53:17.367251 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:53:17.367289 (+ 38us) server_negotiation.cc:407] Connection header received
0808 14:53:17.367538 (+ 249us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:53:17.367573 (+ 35us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:53:17.367661 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:53:17.367754 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:53:17.369634 (+ 1880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:17.370455 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:17.372483 (+ 2028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:17.372909 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:17.373014 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:53:17.376477 (+ 3463us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:53:17.376488 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:53:17.376504 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:53:17.376533 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:53:17.379521 (+ 2988us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:53:17.380350 (+ 829us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:53:17.380356 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:53:17.380359 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:53:17.380510 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:53:17.380960 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:53:17.380963 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:53:17.380965 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:53:17.381306 (+ 341us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:53:17.381544 (+ 238us) server_negotiation.cc:1035] Waiting for connection context
0808 14:53:17.381852 (+ 308us) server_negotiation.cc:299] Negotiation successful
0808 14:53:17.382008 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260808 14:53:17.383044 11818 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:53:17.422786 11982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:17.422313 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.193:40683 (local address 127.0.0.1:41942)
0808 14:53:17.422505 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0808 14:53:17.422621 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.193:40683: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
I20260808 14:53:17.423787 11982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:17.423399 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.193:40683 (local address 127.0.0.1:41952)
0808 14:53:17.423535 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0808 14:53:17.423656 (+ 121us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.193:40683: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260808 14:53:17.484321 11982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:17.483875 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.193:40683 (local address 127.0.0.1:41958)
0808 14:53:17.484071 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0808 14:53:17.484160 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.193:40683: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
I20260808 14:53:17.485337 11982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:17.485002 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.193:40683 (local address 127.0.0.1:41970)
0808 14:53:17.485139 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0808 14:53:17.485227 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.193:40683: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260808 14:53:17.495875 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 11681
I20260808 14:53:17.518350 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 11826
I20260808 14:53:17.531102 11979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:17.519080 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53538 (local address 127.26.206.195:34885)
0808 14:53:17.519286 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0808 14:53:17.519291 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:53:17.519309 (+ 18us) server_negotiation.cc:407] Connection header received
0808 14:53:17.519431 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:53:17.519435 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:53:17.519498 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:53:17.519635 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:53:17.520961 (+ 1326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:17.521774 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:17.522963 (+ 1189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:17.523323 (+ 360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:17.523406 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:53:17.525818 (+ 2412us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:53:17.525849 (+ 31us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:53:17.525883 (+ 34us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:53:17.525913 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:53:17.528742 (+ 2829us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:53:17.529342 (+ 600us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:53:17.529349 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:53:17.529351 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:53:17.529479 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:53:17.529792 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:53:17.529795 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:53:17.529797 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:53:17.530116 (+ 319us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:53:17.530351 (+ 235us) server_negotiation.cc:1035] Waiting for connection context
0808 14:53:17.530548 (+ 197us) server_negotiation.cc:299] Negotiation successful
0808 14:53:17.530719 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260808 14:53:17.531853 11960 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:53:17.566622 11982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:17.566006 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.193:40683 (local address 127.0.0.1:41980)
0808 14:53:17.566332 (+ 326us) negotiation.cc:107] Waiting for socket to connect
0808 14:53:17.566450 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.193:40683: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":176}
I20260808 14:53:17.567754 11982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:17.567319 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.193:40683 (local address 127.0.0.1:41994)
0808 14:53:17.567517 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0808 14:53:17.567632 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.193:40683: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100}
I20260808 14:53:17.619750 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 11826
I20260808 14:53:17.639693 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 11433
I20260808 14:53:17.640928 11504 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:53:17.752594 11982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:17.751932 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.193:40683 (local address 127.0.0.1:42008)
0808 14:53:17.752150 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0808 14:53:17.752284 (+ 134us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.193:40683: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260808 14:53:17.752919 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 11433
I20260808 14:53:17.778650 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.206.254:40593
--webserver_interface=127.26.206.254
--webserver_port=45835
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.254.keytab
--principal=kudu/127.26.206.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.206.212:42083
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.206.254:40593
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:53:18.113071 12015 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:53:18.113337 12015 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:53:18.113555 12015 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:53:18.120687 12015 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:53:18.120786 12015 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:53:18.120884 12015 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:53:18.120971 12015 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:53:18.121052 12015 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:53:18.130746 12015 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:42083
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.206.254:40593
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.254.keytab
--principal=kudu/127.26.206.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.206.254:40593
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.206.254
--webserver_port=45835
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:53:18.132072 12015 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:53:18.133419 12015 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:53:18.145298 12021 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:53:18.145363 12022 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:53:18.145328 12024 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:53:18.146411 12015 server_base.cc:1034] running on GCE node
I20260808 14:53:18.147109 12015 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:53:18.148461 12015 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:53:18.149686 12015 hybrid_clock.cc:648] HybridClock initialized: now 1786200798149606 us; error 81 us; skew 500 ppm
I20260808 14:53:18.150036 12015 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:53:18 dist-test-slave-6k22 krb5kdc[10822](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200798, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:53:18.153087 12015 init.cc:377] Logged in from keytab as kudu/127.26.206.254@KRBTEST.COM (short username kudu)
I20260808 14:53:18.154692 12015 webserver.cc:460] Webserver started at http://127.26.206.254:45835/ using document root <none> and password file <none>
I20260808 14:53:18.155323 12015 fs_manager.cc:359] Metadata directory not provided
I20260808 14:53:18.155462 12015 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:53:18.160651 12015 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 14:53:18.163364 12033 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:53:18.164697 12015 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 14:53:18.164868 12015 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/master-0/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/master-0/wal
uuid: "fa7e80a4e89440429ab9555997d74967"
format_stamp: "Formatted at 2026-08-08 14:53:12 on dist-test-slave-6k22"
server_key: "ecaa4a0e6daf5ec669cc4abdb95641c0"
server_key_iv: "f0f08edf7a5df903e10410ee48fae57c"
server_key_version: "encryptionkey@0"
I20260808 14:53:18.165803 12015 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:53:18.185248 12015 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:53:18.188905 12015 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:53:18.189155 12015 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:53:18.207809 12015 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.254:40593
I20260808 14:53:18.207845 12091 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.254:40593 every 8 connection(s)
I20260808 14:53:18.209236 12015 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
I20260808 14:53:18.215098 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 12015
I20260808 14:53:18.216190 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.206.193:40683
--local_ip_for_outbound_sockets=127.26.206.193
--tserver_master_addrs=127.26.206.254:40593
--webserver_port=43585
--webserver_interface=127.26.206.193
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.193.keytab
--principal=kudu/127.26.206.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.206.212:42083
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 14:53:18.216995 12092 sys_catalog.cc:263] Verifying existing consensus state
I20260808 14:53:18.222066 12092 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fa7e80a4e89440429ab9555997d74967: Bootstrap starting.
I20260808 14:53:18.243855 12092 log.cc:824] T 00000000000000000000000000000000 P fa7e80a4e89440429ab9555997d74967: Log is configured to *not* fsync() on all Append() calls
I20260808 14:53:18.259855 12092 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fa7e80a4e89440429ab9555997d74967: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 14:53:18.260367 12092 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fa7e80a4e89440429ab9555997d74967: Bootstrap complete.
I20260808 14:53:18.269713 12092 raft_consensus.cc:348] T 00000000000000000000000000000000 P fa7e80a4e89440429ab9555997d74967 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa7e80a4e89440429ab9555997d74967" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 40593 } }
I20260808 14:53:18.270702 12092 raft_consensus.cc:729] T 00000000000000000000000000000000 P fa7e80a4e89440429ab9555997d74967 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa7e80a4e89440429ab9555997d74967, State: Initialized, Role: FOLLOWER
I20260808 14:53:18.271348 12092 consensus_queue.cc:260] T 00000000000000000000000000000000 P fa7e80a4e89440429ab9555997d74967 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa7e80a4e89440429ab9555997d74967" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 40593 } }
I20260808 14:53:18.271620 12092 raft_consensus.cc:388] T 00000000000000000000000000000000 P fa7e80a4e89440429ab9555997d74967 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:53:18.271740 12092 raft_consensus.cc:482] T 00000000000000000000000000000000 P fa7e80a4e89440429ab9555997d74967 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:53:18.271967 12092 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fa7e80a4e89440429ab9555997d74967 [term 2 FOLLOWER]: Advancing to term 3
I20260808 14:53:18.275650 12092 raft_consensus.cc:504] T 00000000000000000000000000000000 P fa7e80a4e89440429ab9555997d74967 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa7e80a4e89440429ab9555997d74967" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 40593 } }
I20260808 14:53:18.276139 12092 leader_election.cc:302] T 00000000000000000000000000000000 P fa7e80a4e89440429ab9555997d74967 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fa7e80a4e89440429ab9555997d74967; no voters:
I20260808 14:53:18.276811 12092 leader_election.cc:288] T 00000000000000000000000000000000 P fa7e80a4e89440429ab9555997d74967 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260808 14:53:18.276947 12097 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fa7e80a4e89440429ab9555997d74967 [term 3 FOLLOWER]: Leader election won for term 3
I20260808 14:53:18.278163 12097 raft_consensus.cc:686] T 00000000000000000000000000000000 P fa7e80a4e89440429ab9555997d74967 [term 3 LEADER]: Becoming Leader. State: Replica: fa7e80a4e89440429ab9555997d74967, State: Running, Role: LEADER
I20260808 14:53:18.278784 12097 consensus_queue.cc:237] T 00000000000000000000000000000000 P fa7e80a4e89440429ab9555997d74967 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa7e80a4e89440429ab9555997d74967" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 40593 } }
I20260808 14:53:18.279088 12092 sys_catalog.cc:564] T 00000000000000000000000000000000 P fa7e80a4e89440429ab9555997d74967 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:53:18.282904 12099 sys_catalog.cc:455] T 00000000000000000000000000000000 P fa7e80a4e89440429ab9555997d74967 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fa7e80a4e89440429ab9555997d74967. Latest consensus state: current_term: 3 leader_uuid: "fa7e80a4e89440429ab9555997d74967" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa7e80a4e89440429ab9555997d74967" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 40593 } } }
I20260808 14:53:18.283330 12099 sys_catalog.cc:458] T 00000000000000000000000000000000 P fa7e80a4e89440429ab9555997d74967 [sys.catalog]: This master's current role is: LEADER
I20260808 14:53:18.283964 12098 sys_catalog.cc:455] T 00000000000000000000000000000000 P fa7e80a4e89440429ab9555997d74967 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "fa7e80a4e89440429ab9555997d74967" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa7e80a4e89440429ab9555997d74967" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 40593 } } }
I20260808 14:53:18.284288 12098 sys_catalog.cc:458] T 00000000000000000000000000000000 P fa7e80a4e89440429ab9555997d74967 [sys.catalog]: This master's current role is: LEADER
I20260808 14:53:18.294802 12104 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:53:18.306663 12104 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:53:18.308274 12104 catalog_manager.cc:1259] Loaded cluster ID: 0900b34a559e4a0fa35a8ba3bfca602c
I20260808 14:53:18.308460 12104 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260808 14:53:18.311022 12104 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f4860a329ad google::LogMessage::Fail() at ??:0
@ 0x7f4860a3588a google::LogMessage::SendToLog() at ??:0
@ 0x7f4860a324de google::LogMessage::Flush() at ??:0
@ 0x7f4860a33a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f4876465512 kudu::master::CatalogManager::PrepareForLeadershipTask()::$_6::operator()() at ??:0
@ 0x7f4876462976 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f48764ea610 kudu::master::CatalogManager::ElectedAsLeaderCb()::$_2::operator()() at ??:0
@ 0x7f48764ea439 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f486367e345 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f486368191c kudu::ThreadPool::CreateThread()::$_2::operator()() at ??:0
@ 0x7f4863681799 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f486365ceaf kudu::Thread::SuperviseThread() at ??:0
@ 0x7f48669366db start_thread at ??:0
@ 0x7f485f8cc61f clone at ??:0
W20260808 14:53:18.622185 12095 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:53:18.622447 12095 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:53:18.622622 12095 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:53:18.629907 12095 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:53:18.630035 12095 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:53:18.630218 12095 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.206.193
I20260808 14:53:18.639890 12095 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:42083
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.193.keytab
--principal=kudu/127.26.206.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.206.193:40683
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.206.193
--webserver_port=43585
--tserver_master_addrs=127.26.206.254:40593
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.206.193
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:53:18.641161 12095 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:53:18.642499 12095 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:53:18.656154 12138 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:53:18.656306 12139 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:53:18.656312 12141 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:53:18.657653 12095 server_base.cc:1034] running on GCE node
I20260808 14:53:18.658192 12095 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:53:18.659104 12095 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:53:18.660296 12095 hybrid_clock.cc:648] HybridClock initialized: now 1786200798660249 us; error 39 us; skew 500 ppm
I20260808 14:53:18.660581 12095 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:53:18 dist-test-slave-6k22 krb5kdc[10822](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200798, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:53:18.663861 12095 init.cc:377] Logged in from keytab as kudu/127.26.206.193@KRBTEST.COM (short username kudu)
I20260808 14:53:18.665302 12095 webserver.cc:460] Webserver started at http://127.26.206.193:43585/ using document root <none> and password file <none>
I20260808 14:53:18.665997 12095 fs_manager.cc:359] Metadata directory not provided
I20260808 14:53:18.666128 12095 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:53:18.671417 12095 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260808 14:53:18.676924 12151 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:53:18.678193 12095 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 14:53:18.678366 12095 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-0/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-0/wal
uuid: "f3812b4693ca412a9ebd05153fa0161e"
format_stamp: "Formatted at 2026-08-08 14:53:12 on dist-test-slave-6k22"
server_key: "d1908835f49e980b852cdec442048f69"
server_key_iv: "42c8732f151690eeb8e202c9059c68cb"
server_key_version: "encryptionkey@0"
I20260808 14:53:18.679384 12095 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:53:18.725975 12095 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:53:18.730480 12095 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:53:18.730786 12095 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:53:18.731837 12095 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:53:18.733731 12159 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20260808 14:53:18.739480 12095 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260808 14:53:18.739638 12095 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.006s user 0.001s sys 0.000s
I20260808 14:53:18.739781 12095 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260808 14:53:18.742903 12095 ts_tablet_manager.cc:610] Registered 1 tablets
I20260808 14:53:18.743005 12095 ts_tablet_manager.cc:589] Time spent register tablets: real 0.003s user 0.000s sys 0.000s
I20260808 14:53:18.743319 12159 tablet_bootstrap.cc:492] T 4ebf4627c4724a45b76109afc135618a P f3812b4693ca412a9ebd05153fa0161e: Bootstrap starting.
I20260808 14:53:18.771230 12159 log.cc:824] T 4ebf4627c4724a45b76109afc135618a P f3812b4693ca412a9ebd05153fa0161e: Log is configured to *not* fsync() on all Append() calls
I20260808 14:53:18.787781 12095 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.193:40683
I20260808 14:53:18.787829 12276 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.193:40683 every 8 connection(s)
I20260808 14:53:18.789053 12095 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-0/data/info.pb
I20260808 14:53:18.789512 12159 tablet_bootstrap.cc:492] T 4ebf4627c4724a45b76109afc135618a P f3812b4693ca412a9ebd05153fa0161e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 14:53:18.790258 12159 tablet_bootstrap.cc:492] T 4ebf4627c4724a45b76109afc135618a P f3812b4693ca412a9ebd05153fa0161e: Bootstrap complete.
I20260808 14:53:18.792150 12159 ts_tablet_manager.cc:1397] T 4ebf4627c4724a45b76109afc135618a P f3812b4693ca412a9ebd05153fa0161e: Time spent bootstrapping tablet: real 0.049s user 0.030s sys 0.017s
I20260808 14:53:18.793972 12279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:18.791967 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:40593 (local address 127.26.206.193:54629)
0808 14:53:18.792824 (+ 857us) negotiation.cc:107] Waiting for socket to connect
0808 14:53:18.793108 (+ 284us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:40593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":620,"thread_start_us":417,"threads_started":1}
W20260808 14:53:18.794715 12277 heartbeater.cc:644] Failed to heartbeat to 127.26.206.254:40593 (0 consecutive failures): Network error: Failed to ping master at 127.26.206.254:40593: Client connection negotiation failed: client connection to 127.26.206.254:40593: connect: Connection refused (error 111)
I20260808 14:53:18.795533 12279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:18.795200 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:40593 (local address 127.26.206.193:58625)
0808 14:53:18.795357 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0808 14:53:18.795431 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:40593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
I20260808 14:53:18.796504 12279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:18.796087 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:40593 (local address 127.26.206.193:34535)
0808 14:53:18.796238 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0808 14:53:18.796344 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:40593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260808 14:53:18.796787 12277 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260808 14:53:18.798501 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 12095
I20260808 14:53:18.799266 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.206.194:32785
--local_ip_for_outbound_sockets=127.26.206.194
--tserver_master_addrs=127.26.206.254:40593
--webserver_port=32981
--webserver_interface=127.26.206.194
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.194.keytab
--principal=kudu/127.26.206.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.206.212:42083
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 14:53:18.800223 12159 raft_consensus.cc:348] T 4ebf4627c4724a45b76109afc135618a P f3812b4693ca412a9ebd05153fa0161e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3812b4693ca412a9ebd05153fa0161e" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 40683 } } peers { permanent_uuid: "d262cd4649d64d90a2bcfc3e73ac8e3c" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 34885 } } peers { permanent_uuid: "9bdb12b7a2984ad6bae08231e419279a" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 32785 } }
I20260808 14:53:18.801656 12159 raft_consensus.cc:729] T 4ebf4627c4724a45b76109afc135618a P f3812b4693ca412a9ebd05153fa0161e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3812b4693ca412a9ebd05153fa0161e, State: Initialized, Role: FOLLOWER
I20260808 14:53:18.802285 12159 consensus_queue.cc:260] T 4ebf4627c4724a45b76109afc135618a P f3812b4693ca412a9ebd05153fa0161e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3812b4693ca412a9ebd05153fa0161e" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 40683 } } peers { permanent_uuid: "d262cd4649d64d90a2bcfc3e73ac8e3c" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 34885 } } peers { permanent_uuid: "9bdb12b7a2984ad6bae08231e419279a" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 32785 } }
I20260808 14:53:18.803828 12279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:18.803470 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:40593 (local address 127.26.206.193:33331)
0808 14:53:18.803629 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0808 14:53:18.803718 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:40593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260808 14:53:18.804081 12159 ts_tablet_manager.cc:1428] T 4ebf4627c4724a45b76109afc135618a P f3812b4693ca412a9ebd05153fa0161e: Time spent starting tablet: real 0.012s user 0.007s sys 0.005s
I20260808 14:53:18.805047 12279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:18.804614 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:40593 (local address 127.26.206.193:48571)
0808 14:53:18.804801 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0808 14:53:18.804890 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:40593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260808 14:53:19.139793 12281 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:53:19.140081 12281 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:53:19.140246 12281 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:53:19.147207 12281 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:53:19.147344 12281 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:53:19.147504 12281 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.206.194
I20260808 14:53:19.156751 12281 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:42083
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.194.keytab
--principal=kudu/127.26.206.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.206.194:32785
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.206.194
--webserver_port=32981
--tserver_master_addrs=127.26.206.254:40593
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.206.194
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:53:19.157940 12281 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:53:19.159221 12281 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:53:19.172364 12286 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:53:19.172309 12287 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:53:19.172344 12289 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:53:19.173060 12281 server_base.cc:1034] running on GCE node
I20260808 14:53:19.173605 12281 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:53:19.174463 12281 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:53:19.175640 12281 hybrid_clock.cc:648] HybridClock initialized: now 1786200799175605 us; error 40 us; skew 500 ppm
I20260808 14:53:19.175916 12281 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:53:19 dist-test-slave-6k22 krb5kdc[10822](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200799, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:53:19.178952 12281 init.cc:377] Logged in from keytab as kudu/127.26.206.194@KRBTEST.COM (short username kudu)
I20260808 14:53:19.180320 12281 webserver.cc:460] Webserver started at http://127.26.206.194:32981/ using document root <none> and password file <none>
I20260808 14:53:19.180950 12281 fs_manager.cc:359] Metadata directory not provided
I20260808 14:53:19.181085 12281 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:53:19.186208 12281 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20260808 14:53:19.188802 12296 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:53:19.190009 12281 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 14:53:19.190168 12281 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-1/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-1/wal
uuid: "9bdb12b7a2984ad6bae08231e419279a"
format_stamp: "Formatted at 2026-08-08 14:53:13 on dist-test-slave-6k22"
server_key: "9a04eafece52a059d664a4684ded196d"
server_key_iv: "892904062b62e5146f15fae9d2a90f24"
server_key_version: "encryptionkey@0"
I20260808 14:53:19.191110 12281 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:53:19.207190 12281 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:53:19.210866 12281 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:53:19.211128 12281 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:53:19.212067 12281 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:53:19.213361 12281 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:53:19.213505 12281 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:53:19.213632 12281 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:53:19.213718 12281 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:53:19.246735 12281 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.194:32785
I20260808 14:53:19.246838 12420 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.194:32785 every 8 connection(s)
I20260808 14:53:19.248201 12281 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-1/data/info.pb
I20260808 14:53:19.252911 12424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:19.250983 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:40593 (local address 127.26.206.194:59779)
0808 14:53:19.251915 (+ 932us) negotiation.cc:107] Waiting for socket to connect
0808 14:53:19.252119 (+ 204us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:40593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":687,"thread_start_us":496,"threads_started":1}
W20260808 14:53:19.253580 12421 heartbeater.cc:644] Failed to heartbeat to 127.26.206.254:40593 (0 consecutive failures): Network error: Failed to ping master at 127.26.206.254:40593: Client connection negotiation failed: client connection to 127.26.206.254:40593: connect: Connection refused (error 111)
I20260808 14:53:19.254305 12424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:19.253996 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:40593 (local address 127.26.206.194:44911)
0808 14:53:19.254142 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0808 14:53:19.254203 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:40593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260808 14:53:19.255119 12424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:19.254811 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:40593 (local address 127.26.206.194:48709)
0808 14:53:19.254942 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0808 14:53:19.255018 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:40593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260808 14:53:19.255340 12421 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260808 14:53:19.257685 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 12281
I20260808 14:53:19.258309 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.206.195:34885
--local_ip_for_outbound_sockets=127.26.206.195
--tserver_master_addrs=127.26.206.254:40593
--webserver_port=46099
--webserver_interface=127.26.206.195
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.195.keytab
--principal=kudu/127.26.206.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.206.212:42083
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:53:19.583665 12425 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:53:19.583997 12425 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:53:19.584185 12425 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:53:19.591269 12425 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:53:19.591406 12425 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:53:19.591595 12425 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.206.195
I20260808 14:53:19.601150 12425 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:42083
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.195.keytab
--principal=kudu/127.26.206.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.206.195:34885
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.206.195
--webserver_port=46099
--tserver_master_addrs=127.26.206.254:40593
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.206.195
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:53:19.602372 12425 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:53:19.603684 12425 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:53:19.616320 12433 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:53:19.616369 12430 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:53:19.616328 12431 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:53:19.617177 12425 server_base.cc:1034] running on GCE node
I20260808 14:53:19.617753 12425 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:53:19.618629 12425 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:53:19.619836 12425 hybrid_clock.cc:648] HybridClock initialized: now 1786200799619787 us; error 47 us; skew 500 ppm
I20260808 14:53:19.620131 12425 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:53:19 dist-test-slave-6k22 krb5kdc[10822](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200799, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:53:19.623157 12425 init.cc:377] Logged in from keytab as kudu/127.26.206.195@KRBTEST.COM (short username kudu)
I20260808 14:53:19.624558 12425 webserver.cc:460] Webserver started at http://127.26.206.195:46099/ using document root <none> and password file <none>
I20260808 14:53:19.625182 12425 fs_manager.cc:359] Metadata directory not provided
I20260808 14:53:19.625327 12425 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:53:19.630358 12425 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20260808 14:53:19.632916 12440 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:53:19.634228 12425 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 14:53:19.634395 12425 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-2/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-2/wal
uuid: "d262cd4649d64d90a2bcfc3e73ac8e3c"
format_stamp: "Formatted at 2026-08-08 14:53:13 on dist-test-slave-6k22"
server_key: "8d4ce90d0e39aa631a55cd76faeeec84"
server_key_iv: "c99bd1bf361401cfeef856d007647262"
server_key_version: "encryptionkey@0"
I20260808 14:53:19.635350 12425 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:53:19.659142 12425 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:53:19.662912 12425 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:53:19.663254 12425 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:53:19.664386 12425 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:53:19.665750 12425 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:53:19.665879 12425 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:53:19.665993 12425 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:53:19.666076 12425 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:53:19.699430 12425 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.195:34885
I20260808 14:53:19.699513 12564 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.195:34885 every 8 connection(s)
I20260808 14:53:19.700924 12425 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200577490656-27451-0/minicluster-data/ts-2/data/info.pb
I20260808 14:53:19.705195 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 12425
I20260808 14:53:19.705701 12568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:19.703839 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:40593 (local address 127.26.206.195:49675)
0808 14:53:19.704567 (+ 728us) negotiation.cc:107] Waiting for socket to connect
0808 14:53:19.704840 (+ 273us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:40593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":484,"thread_start_us":283,"threads_started":1}
W20260808 14:53:19.706446 12566 heartbeater.cc:644] Failed to heartbeat to 127.26.206.254:40593 (0 consecutive failures): Network error: Failed to ping master at 127.26.206.254:40593: Client connection negotiation failed: client connection to 127.26.206.254:40593: connect: Connection refused (error 111)
I20260808 14:53:19.707216 12568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:19.706910 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:40593 (local address 127.26.206.195:53277)
0808 14:53:19.707046 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0808 14:53:19.707115 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:40593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260808 14:53:19.708052 12568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:19.707756 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:40593 (local address 127.26.206.195:48817)
0808 14:53:19.707880 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0808 14:53:19.707950 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:40593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260808 14:53:19.708264 12566 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260808 14:53:19.806529 12570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:19.805818 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:40593 (local address 127.26.206.193:57859)
0808 14:53:19.806250 (+ 432us) negotiation.cc:107] Waiting for socket to connect
0808 14:53:19.806335 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:40593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":342,"thread_start_us":217,"threads_started":1}
I20260808 14:53:20.256640 12571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:20.255836 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:40593 (local address 127.26.206.194:34495)
0808 14:53:20.256265 (+ 429us) negotiation.cc:107] Waiting for socket to connect
0808 14:53:20.256410 (+ 145us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:40593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":333,"thread_start_us":218,"threads_started":1}
I20260808 14:53:20.533620 12572 raft_consensus.cc:482] T 4ebf4627c4724a45b76109afc135618a P f3812b4693ca412a9ebd05153fa0161e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:53:20.533922 12572 raft_consensus.cc:504] T 4ebf4627c4724a45b76109afc135618a P f3812b4693ca412a9ebd05153fa0161e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3812b4693ca412a9ebd05153fa0161e" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 40683 } } peers { permanent_uuid: "d262cd4649d64d90a2bcfc3e73ac8e3c" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 34885 } } peers { permanent_uuid: "9bdb12b7a2984ad6bae08231e419279a" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 32785 } }
I20260808 14:53:20.535615 12572 leader_election.cc:288] T 4ebf4627c4724a45b76109afc135618a P f3812b4693ca412a9ebd05153fa0161e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d262cd4649d64d90a2bcfc3e73ac8e3c (127.26.206.195:34885), 9bdb12b7a2984ad6bae08231e419279a (127.26.206.194:32785)
Aug 08 14:53:20 dist-test-slave-6k22 krb5kdc[10822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200798, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.193@KRBTEST.COM for kudu/127.26.206.194@KRBTEST.COM
Aug 08 14:53:20 dist-test-slave-6k22 krb5kdc[10822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200798, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.193@KRBTEST.COM for kudu/127.26.206.195@KRBTEST.COM
I20260808 14:53:20.574537 12577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:20.536252 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.193:47269 (local address 127.26.206.194:32785)
0808 14:53:20.548410 (+ 12158us) server_negotiation.cc:206] Beginning negotiation
0808 14:53:20.548426 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 14:53:20.548786 (+ 360us) server_negotiation.cc:407] Connection header received
0808 14:53:20.550650 (+ 1864us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:53:20.550658 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:53:20.550962 (+ 304us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:53:20.551247 (+ 285us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:53:20.553239 (+ 1992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:20.554570 (+ 1331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:20.556604 (+ 2034us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:20.557431 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:20.557628 (+ 197us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:53:20.567189 (+ 9561us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:53:20.567200 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:53:20.567218 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:53:20.567265 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:53:20.570669 (+ 3404us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:53:20.571593 (+ 924us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:53:20.571602 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:53:20.571609 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:53:20.571810 (+ 201us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:53:20.572292 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:53:20.572297 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:53:20.572300 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:53:20.572812 (+ 512us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:53:20.572980 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0808 14:53:20.573784 (+ 804us) server_negotiation.cc:299] Negotiation successful
0808 14:53:20.574135 (+ 351us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11955,"thread_start_us":11771,"threads_started":1}
I20260808 14:53:20.574537 12575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:20.535846 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.195:34885 (local address 127.26.206.193:56605)
0808 14:53:20.548171 (+ 12325us) negotiation.cc:107] Waiting for socket to connect
0808 14:53:20.548226 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0808 14:53:20.548832 (+ 606us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:53:20.551323 (+ 2491us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:53:20.551330 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:53:20.552350 (+ 1020us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:53:20.553051 (+ 701us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:53:20.553073 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:53:20.554734 (+ 1661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:53:20.554738 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:53:20.556234 (+ 1496us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:53:20.556246 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:53:20.557409 (+ 1163us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:53:20.557415 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:53:20.557715 (+ 300us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:53:20.564267 (+ 6552us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:53:20.564291 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:53:20.567211 (+ 2920us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:53:20.571162 (+ 3951us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:53:20.571165 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:53:20.571167 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:53:20.571621 (+ 454us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:53:20.572090 (+ 469us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:53:20.572094 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:53:20.572096 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:53:20.572282 (+ 186us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:53:20.573002 (+ 720us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:53:20.573007 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:53:20.573270 (+ 263us) client_negotiation.cc:769] Sending connection context
0808 14:53:20.573558 (+ 288us) client_negotiation.cc:240] Negotiation successful
0808 14:53:20.574085 (+ 527us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12179,"mutex_wait_us":176,"spinlock_wait_cycles":11904,"thread_start_us":12787,"threads_started":1}
I20260808 14:53:20.574544 12576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:20.536084 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.193:56605 (local address 127.26.206.195:34885)
0808 14:53:20.548649 (+ 12565us) server_negotiation.cc:206] Beginning negotiation
0808 14:53:20.548665 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 14:53:20.548708 (+ 43us) server_negotiation.cc:407] Connection header received
0808 14:53:20.550524 (+ 1816us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:53:20.550532 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:53:20.550892 (+ 360us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:53:20.551200 (+ 308us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:53:20.553241 (+ 2041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:20.554541 (+ 1300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:20.556381 (+ 1840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:20.557208 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:20.557416 (+ 208us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:53:20.567524 (+ 10108us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:53:20.567536 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:53:20.567592 (+ 56us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:53:20.567638 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:53:20.571034 (+ 3396us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:53:20.571745 (+ 711us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:53:20.571750 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:53:20.571755 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:53:20.571959 (+ 204us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:53:20.572392 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:53:20.572396 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:53:20.572398 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:53:20.572847 (+ 449us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:53:20.573045 (+ 198us) server_negotiation.cc:1035] Waiting for connection context
0808 14:53:20.573789 (+ 744us) server_negotiation.cc:299] Negotiation successful
0808 14:53:20.574136 (+ 347us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12387,"thread_start_us":12348,"threads_started":1}
I20260808 14:53:20.574657 12573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:20.536048 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.194:32785 (local address 127.26.206.193:47269)
0808 14:53:20.548540 (+ 12492us) negotiation.cc:107] Waiting for socket to connect
0808 14:53:20.548559 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 14:53:20.548834 (+ 275us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:53:20.551320 (+ 2486us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:53:20.551330 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:53:20.552333 (+ 1003us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:53:20.553049 (+ 716us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:53:20.553073 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:53:20.554731 (+ 1658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:53:20.554737 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:53:20.556232 (+ 1495us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:53:20.556244 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:53:20.557638 (+ 1394us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:53:20.557645 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:53:20.557857 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:53:20.564270 (+ 6413us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:53:20.564298 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:53:20.566857 (+ 2559us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:53:20.570811 (+ 3954us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:53:20.570820 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:53:20.570835 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:53:20.571425 (+ 590us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:53:20.571923 (+ 498us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:53:20.571928 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:53:20.571932 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:53:20.572162 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:53:20.572950 (+ 788us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:53:20.572958 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:53:20.573279 (+ 321us) client_negotiation.cc:769] Sending connection context
0808 14:53:20.573558 (+ 279us) client_negotiation.cc:240] Negotiation successful
0808 14:53:20.574226 (+ 668us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12375,"mutex_wait_us":451,"spinlock_wait_cycles":79872,"thread_start_us":11830,"threads_started":1}
W20260808 14:53:20.578037 12155 leader_election.cc:341] T 4ebf4627c4724a45b76109afc135618a P f3812b4693ca412a9ebd05153fa0161e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 9bdb12b7a2984ad6bae08231e419279a (127.26.206.194:32785): Not found: Tablet not found: 4ebf4627c4724a45b76109afc135618a
W20260808 14:53:20.578315 12154 leader_election.cc:341] T 4ebf4627c4724a45b76109afc135618a P f3812b4693ca412a9ebd05153fa0161e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d262cd4649d64d90a2bcfc3e73ac8e3c (127.26.206.195:34885): Not found: Tablet not found: 4ebf4627c4724a45b76109afc135618a
I20260808 14:53:20.578485 12154 leader_election.cc:302] T 4ebf4627c4724a45b76109afc135618a P f3812b4693ca412a9ebd05153fa0161e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3812b4693ca412a9ebd05153fa0161e; no voters: 9bdb12b7a2984ad6bae08231e419279a, d262cd4649d64d90a2bcfc3e73ac8e3c
I20260808 14:53:20.578903 12572 raft_consensus.cc:2726] T 4ebf4627c4724a45b76109afc135618a P f3812b4693ca412a9ebd05153fa0161e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 14:53:20.709547 12578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:20.708725 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:40593 (local address 127.26.206.195:57461)
0808 14:53:20.709182 (+ 457us) negotiation.cc:107] Waiting for socket to connect
0808 14:53:20.709334 (+ 152us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:40593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":365,"thread_start_us":235,"threads_started":1}
I20260808 14:53:20.807904 12573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:20.807486 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:40593 (local address 127.26.206.193:54197)
0808 14:53:20.807684 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0808 14:53:20.807776 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:40593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":85}
I20260808 14:53:21.258193 12579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:21.257563 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:40593 (local address 127.26.206.194:39025)
0808 14:53:21.257964 (+ 401us) negotiation.cc:107] Waiting for socket to connect
0808 14:53:21.258041 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:40593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":312,"thread_start_us":220,"threads_started":1}
I20260808 14:53:21.711016 12580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:21.710386 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:40593 (local address 127.26.206.195:38279)
0808 14:53:21.710793 (+ 407us) negotiation.cc:107] Waiting for socket to connect
0808 14:53:21.710870 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:40593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":319,"thread_start_us":206,"threads_started":1}
I20260808 14:53:21.809463 12581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:21.808706 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:40593 (local address 127.26.206.193:48559)
0808 14:53:21.809180 (+ 474us) negotiation.cc:107] Waiting for socket to connect
0808 14:53:21.809258 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:40593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":384,"thread_start_us":224,"threads_started":1}
I20260808 14:53:22.256536 12582 raft_consensus.cc:482] T 4ebf4627c4724a45b76109afc135618a P f3812b4693ca412a9ebd05153fa0161e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:53:22.256724 12582 raft_consensus.cc:504] T 4ebf4627c4724a45b76109afc135618a P f3812b4693ca412a9ebd05153fa0161e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3812b4693ca412a9ebd05153fa0161e" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 40683 } } peers { permanent_uuid: "d262cd4649d64d90a2bcfc3e73ac8e3c" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 34885 } } peers { permanent_uuid: "9bdb12b7a2984ad6bae08231e419279a" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 32785 } }
I20260808 14:53:22.257302 12582 leader_election.cc:288] T 4ebf4627c4724a45b76109afc135618a P f3812b4693ca412a9ebd05153fa0161e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d262cd4649d64d90a2bcfc3e73ac8e3c (127.26.206.195:34885), 9bdb12b7a2984ad6bae08231e419279a (127.26.206.194:32785)
W20260808 14:53:22.258363 12154 leader_election.cc:341] T 4ebf4627c4724a45b76109afc135618a P f3812b4693ca412a9ebd05153fa0161e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d262cd4649d64d90a2bcfc3e73ac8e3c (127.26.206.195:34885): Not found: Tablet not found: 4ebf4627c4724a45b76109afc135618a
W20260808 14:53:22.258546 12155 leader_election.cc:341] T 4ebf4627c4724a45b76109afc135618a P f3812b4693ca412a9ebd05153fa0161e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 9bdb12b7a2984ad6bae08231e419279a (127.26.206.194:32785): Not found: Tablet not found: 4ebf4627c4724a45b76109afc135618a
I20260808 14:53:22.258708 12155 leader_election.cc:302] T 4ebf4627c4724a45b76109afc135618a P f3812b4693ca412a9ebd05153fa0161e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3812b4693ca412a9ebd05153fa0161e; no voters: 9bdb12b7a2984ad6bae08231e419279a, d262cd4649d64d90a2bcfc3e73ac8e3c
I20260808 14:53:22.259056 12582 raft_consensus.cc:2726] T 4ebf4627c4724a45b76109afc135618a P f3812b4693ca412a9ebd05153fa0161e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 14:53:22.259779 12583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:22.259006 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:40593 (local address 127.26.206.194:36375)
0808 14:53:22.259465 (+ 459us) negotiation.cc:107] Waiting for socket to connect
0808 14:53:22.259590 (+ 125us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:40593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":358,"thread_start_us":269,"threads_started":1}
I20260808 14:53:22.712559 12584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:22.711927 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:40593 (local address 127.26.206.195:52171)
0808 14:53:22.712336 (+ 409us) negotiation.cc:107] Waiting for socket to connect
0808 14:53:22.712410 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:40593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":314,"thread_start_us":218,"threads_started":1}
I20260808 14:53:22.810926 12586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:22.810249 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:40593 (local address 127.26.206.193:38579)
0808 14:53:22.810669 (+ 420us) negotiation.cc:107] Waiting for socket to connect
0808 14:53:22.810747 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:40593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":318,"thread_start_us":210,"threads_started":1}
I20260808 14:53:23.261314 12587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:23.260660 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:40593 (local address 127.26.206.194:55137)
0808 14:53:23.261059 (+ 399us) negotiation.cc:107] Waiting for socket to connect
0808 14:53:23.261136 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:40593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":306,"thread_start_us":189,"threads_started":1}
I20260808 14:53:23.714334 12588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:23.713444 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:40593 (local address 127.26.206.195:39759)
0808 14:53:23.714003 (+ 559us) negotiation.cc:107] Waiting for socket to connect
0808 14:53:23.714096 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:40593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":433,"thread_start_us":272,"threads_started":1}
I20260808 14:53:23.812976 12589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:23.812158 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:40593 (local address 127.26.206.193:36263)
0808 14:53:23.812652 (+ 494us) negotiation.cc:107] Waiting for socket to connect
0808 14:53:23.812753 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:40593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":366,"thread_start_us":255,"threads_started":1}
I20260808 14:53:24.262849 12590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:24.262194 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:40593 (local address 127.26.206.194:56567)
0808 14:53:24.262610 (+ 416us) negotiation.cc:107] Waiting for socket to connect
0808 14:53:24.262686 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:40593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":316,"thread_start_us":207,"threads_started":1}
I20260808 14:53:24.715891 12591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:24.715168 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:40593 (local address 127.26.206.195:60257)
0808 14:53:24.715635 (+ 467us) negotiation.cc:107] Waiting for socket to connect
0808 14:53:24.715724 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:40593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":326,"thread_start_us":221,"threads_started":1}
I20260808 14:53:24.814438 12592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:24.813734 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:40593 (local address 127.26.206.193:42783)
0808 14:53:24.814180 (+ 446us) negotiation.cc:107] Waiting for socket to connect
0808 14:53:24.814256 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:40593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":346,"thread_start_us":219,"threads_started":1}
I20260808 14:53:25.120990 12593 raft_consensus.cc:482] T 4ebf4627c4724a45b76109afc135618a P f3812b4693ca412a9ebd05153fa0161e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:53:25.121217 12593 raft_consensus.cc:504] T 4ebf4627c4724a45b76109afc135618a P f3812b4693ca412a9ebd05153fa0161e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3812b4693ca412a9ebd05153fa0161e" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 40683 } } peers { permanent_uuid: "d262cd4649d64d90a2bcfc3e73ac8e3c" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 34885 } } peers { permanent_uuid: "9bdb12b7a2984ad6bae08231e419279a" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 32785 } }
I20260808 14:53:25.121934 12593 leader_election.cc:288] T 4ebf4627c4724a45b76109afc135618a P f3812b4693ca412a9ebd05153fa0161e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d262cd4649d64d90a2bcfc3e73ac8e3c (127.26.206.195:34885), 9bdb12b7a2984ad6bae08231e419279a (127.26.206.194:32785)
W20260808 14:53:25.122823 12154 leader_election.cc:341] T 4ebf4627c4724a45b76109afc135618a P f3812b4693ca412a9ebd05153fa0161e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d262cd4649d64d90a2bcfc3e73ac8e3c (127.26.206.195:34885): Not found: Tablet not found: 4ebf4627c4724a45b76109afc135618a
W20260808 14:53:25.123005 12155 leader_election.cc:341] T 4ebf4627c4724a45b76109afc135618a P f3812b4693ca412a9ebd05153fa0161e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 9bdb12b7a2984ad6bae08231e419279a (127.26.206.194:32785): Not found: Tablet not found: 4ebf4627c4724a45b76109afc135618a
I20260808 14:53:25.123165 12155 leader_election.cc:302] T 4ebf4627c4724a45b76109afc135618a P f3812b4693ca412a9ebd05153fa0161e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3812b4693ca412a9ebd05153fa0161e; no voters: 9bdb12b7a2984ad6bae08231e419279a, d262cd4649d64d90a2bcfc3e73ac8e3c
I20260808 14:53:25.123409 12593 raft_consensus.cc:2726] T 4ebf4627c4724a45b76109afc135618a P f3812b4693ca412a9ebd05153fa0161e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 14:53:25.264696 12594 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:25.263724 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:40593 (local address 127.26.206.194:38295)
0808 14:53:25.264343 (+ 619us) negotiation.cc:107] Waiting for socket to connect
0808 14:53:25.264486 (+ 143us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:40593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":478,"thread_start_us":310,"threads_started":1}
I20260808 14:53:25.717557 12596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:25.716708 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:40593 (local address 127.26.206.195:55307)
0808 14:53:25.717244 (+ 536us) negotiation.cc:107] Waiting for socket to connect
0808 14:53:25.717324 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:40593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":446,"thread_start_us":303,"threads_started":1}
I20260808 14:53:25.816192 12597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:25.815350 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:40593 (local address 127.26.206.193:34943)
0808 14:53:25.815898 (+ 548us) negotiation.cc:107] Waiting for socket to connect
0808 14:53:25.815998 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:40593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":406,"thread_start_us":320,"threads_started":1}
I20260808 14:53:26.266531 12599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:26.265530 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:40593 (local address 127.26.206.194:47307)
0808 14:53:26.266178 (+ 648us) negotiation.cc:107] Waiting for socket to connect
0808 14:53:26.266291 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:40593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":523,"thread_start_us":288,"threads_started":1}
I20260808 14:53:26.719228 12600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:26.718478 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:40593 (local address 127.26.206.195:40447)
0808 14:53:26.718972 (+ 494us) negotiation.cc:107] Waiting for socket to connect
0808 14:53:26.719052 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:40593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":397,"thread_start_us":244,"threads_started":1}
I20260808 14:53:26.817667 12601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:26.816956 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:40593 (local address 127.26.206.193:53193)
0808 14:53:26.817426 (+ 470us) negotiation.cc:107] Waiting for socket to connect
0808 14:53:26.817508 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:40593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":376,"thread_start_us":255,"threads_started":1}
I20260808 14:53:27.268072 12602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:27.267370 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:40593 (local address 127.26.206.194:57573)
0808 14:53:27.267825 (+ 455us) negotiation.cc:107] Waiting for socket to connect
0808 14:53:27.267903 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:40593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":349,"thread_start_us":249,"threads_started":1}
I20260808 14:53:27.720700 12603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:27.720032 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:40593 (local address 127.26.206.195:54335)
0808 14:53:27.720448 (+ 416us) negotiation.cc:107] Waiting for socket to connect
0808 14:53:27.720523 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:40593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":330,"thread_start_us":233,"threads_started":1}
I20260808 14:53:27.819211 12604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:27.818547 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:40593 (local address 127.26.206.193:32921)
0808 14:53:27.818965 (+ 418us) negotiation.cc:107] Waiting for socket to connect
0808 14:53:27.819042 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:40593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":326,"thread_start_us":219,"threads_started":1}
I20260808 14:53:28.269634 12605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:28.268922 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:40593 (local address 127.26.206.194:34145)
0808 14:53:28.269364 (+ 442us) negotiation.cc:107] Waiting for socket to connect
0808 14:53:28.269460 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:40593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":327,"thread_start_us":213,"threads_started":1}
I20260808 14:53:28.722536 12606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:28.721764 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:40593 (local address 127.26.206.195:51591)
0808 14:53:28.722256 (+ 492us) negotiation.cc:107] Waiting for socket to connect
0808 14:53:28.722351 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:40593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":370,"thread_start_us":217,"threads_started":1}
I20260808 14:53:28.821022 12607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:28.820208 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:40593 (local address 127.26.206.193:60799)
0808 14:53:28.820756 (+ 548us) negotiation.cc:107] Waiting for socket to connect
0808 14:53:28.820845 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:40593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":442,"thread_start_us":329,"threads_started":1}
I20260808 14:53:29.271276 12608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:29.270564 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:40593 (local address 127.26.206.194:42179)
0808 14:53:29.271003 (+ 439us) negotiation.cc:107] Waiting for socket to connect
0808 14:53:29.271082 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:40593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":349,"thread_start_us":252,"threads_started":1}
I20260808 14:53:29.724500 12609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:29.723789 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:40593 (local address 127.26.206.195:42275)
0808 14:53:29.724241 (+ 452us) negotiation.cc:107] Waiting for socket to connect
0808 14:53:29.724323 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:40593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":359,"thread_start_us":239,"threads_started":1}
I20260808 14:53:29.822633 12610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:29.821880 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:40593 (local address 127.26.206.193:50995)
0808 14:53:29.822370 (+ 490us) negotiation.cc:107] Waiting for socket to connect
0808 14:53:29.822450 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:40593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":397,"thread_start_us":269,"threads_started":1}
I20260808 14:53:29.878468 12611 raft_consensus.cc:482] T 4ebf4627c4724a45b76109afc135618a P f3812b4693ca412a9ebd05153fa0161e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:53:29.878691 12611 raft_consensus.cc:504] T 4ebf4627c4724a45b76109afc135618a P f3812b4693ca412a9ebd05153fa0161e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3812b4693ca412a9ebd05153fa0161e" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 40683 } } peers { permanent_uuid: "d262cd4649d64d90a2bcfc3e73ac8e3c" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 34885 } } peers { permanent_uuid: "9bdb12b7a2984ad6bae08231e419279a" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 32785 } }
I20260808 14:53:29.879505 12611 leader_election.cc:288] T 4ebf4627c4724a45b76109afc135618a P f3812b4693ca412a9ebd05153fa0161e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d262cd4649d64d90a2bcfc3e73ac8e3c (127.26.206.195:34885), 9bdb12b7a2984ad6bae08231e419279a (127.26.206.194:32785)
W20260808 14:53:29.880501 12154 leader_election.cc:341] T 4ebf4627c4724a45b76109afc135618a P f3812b4693ca412a9ebd05153fa0161e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d262cd4649d64d90a2bcfc3e73ac8e3c (127.26.206.195:34885): Not found: Tablet not found: 4ebf4627c4724a45b76109afc135618a
W20260808 14:53:29.880672 12155 leader_election.cc:341] T 4ebf4627c4724a45b76109afc135618a P f3812b4693ca412a9ebd05153fa0161e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 9bdb12b7a2984ad6bae08231e419279a (127.26.206.194:32785): Not found: Tablet not found: 4ebf4627c4724a45b76109afc135618a
I20260808 14:53:29.880812 12155 leader_election.cc:302] T 4ebf4627c4724a45b76109afc135618a P f3812b4693ca412a9ebd05153fa0161e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3812b4693ca412a9ebd05153fa0161e; no voters: 9bdb12b7a2984ad6bae08231e419279a, d262cd4649d64d90a2bcfc3e73ac8e3c
I20260808 14:53:29.881089 12611 raft_consensus.cc:2726] T 4ebf4627c4724a45b76109afc135618a P f3812b4693ca412a9ebd05153fa0161e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 14:53:30.272943 12612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:30.272170 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:40593 (local address 127.26.206.194:56079)
0808 14:53:30.272689 (+ 519us) negotiation.cc:107] Waiting for socket to connect
0808 14:53:30.272783 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:40593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":420,"thread_start_us":299,"threads_started":1}
I20260808 14:53:30.726150 12613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:30.725458 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:40593 (local address 127.26.206.195:39329)
0808 14:53:30.725906 (+ 448us) negotiation.cc:107] Waiting for socket to connect
0808 14:53:30.725989 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:40593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":342,"thread_start_us":218,"threads_started":1}
I20260808 14:53:30.824256 12614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:30.823493 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:40593 (local address 127.26.206.193:34843)
0808 14:53:30.823990 (+ 497us) negotiation.cc:107] Waiting for socket to connect
0808 14:53:30.824071 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:40593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":406,"thread_start_us":308,"threads_started":1}
I20260808 14:53:31.274607 12615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:31.273871 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:40593 (local address 127.26.206.194:34861)
0808 14:53:31.274321 (+ 450us) negotiation.cc:107] Waiting for socket to connect
0808 14:53:31.274401 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:40593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":343,"thread_start_us":231,"threads_started":1}
I20260808 14:53:31.727799 12616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:31.727076 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:40593 (local address 127.26.206.195:34849)
0808 14:53:31.727519 (+ 443us) negotiation.cc:107] Waiting for socket to connect
0808 14:53:31.727616 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:40593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":337,"thread_start_us":222,"threads_started":1}
I20260808 14:53:31.825759 12617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:31.825071 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:40593 (local address 127.26.206.193:32913)
0808 14:53:31.825502 (+ 431us) negotiation.cc:107] Waiting for socket to connect
0808 14:53:31.825594 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:40593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":333,"thread_start_us":231,"threads_started":1}
I20260808 14:53:32.276365 12618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:32.275637 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:40593 (local address 127.26.206.194:33985)
0808 14:53:32.276084 (+ 447us) negotiation.cc:107] Waiting for socket to connect
0808 14:53:32.276191 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:40593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":354,"thread_start_us":237,"threads_started":1}
I20260808 14:53:32.729526 12619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:32.728721 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:40593 (local address 127.26.206.195:34305)
0808 14:53:32.729234 (+ 513us) negotiation.cc:107] Waiting for socket to connect
0808 14:53:32.729336 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:40593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":402,"thread_start_us":276,"threads_started":1}
I20260808 14:53:32.827517 12620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:32.826788 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:40593 (local address 127.26.206.193:58039)
0808 14:53:32.827239 (+ 451us) negotiation.cc:107] Waiting for socket to connect
0808 14:53:32.827338 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:40593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":354,"thread_start_us":235,"threads_started":1}
I20260808 14:53:33.278033 12621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:33.277305 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:40593 (local address 127.26.206.194:51089)
0808 14:53:33.277732 (+ 427us) negotiation.cc:107] Waiting for socket to connect
0808 14:53:33.277823 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:40593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":337,"thread_start_us":230,"threads_started":1}
I20260808 14:53:33.578251 12622 raft_consensus.cc:482] T 4ebf4627c4724a45b76109afc135618a P f3812b4693ca412a9ebd05153fa0161e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:53:33.578480 12622 raft_consensus.cc:504] T 4ebf4627c4724a45b76109afc135618a P f3812b4693ca412a9ebd05153fa0161e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3812b4693ca412a9ebd05153fa0161e" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 40683 } } peers { permanent_uuid: "d262cd4649d64d90a2bcfc3e73ac8e3c" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 34885 } } peers { permanent_uuid: "9bdb12b7a2984ad6bae08231e419279a" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 32785 } }
I20260808 14:53:33.579106 12622 leader_election.cc:288] T 4ebf4627c4724a45b76109afc135618a P f3812b4693ca412a9ebd05153fa0161e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d262cd4649d64d90a2bcfc3e73ac8e3c (127.26.206.195:34885), 9bdb12b7a2984ad6bae08231e419279a (127.26.206.194:32785)
W20260808 14:53:33.580154 12154 leader_election.cc:341] T 4ebf4627c4724a45b76109afc135618a P f3812b4693ca412a9ebd05153fa0161e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d262cd4649d64d90a2bcfc3e73ac8e3c (127.26.206.195:34885): Not found: Tablet not found: 4ebf4627c4724a45b76109afc135618a
W20260808 14:53:33.580376 12155 leader_election.cc:341] T 4ebf4627c4724a45b76109afc135618a P f3812b4693ca412a9ebd05153fa0161e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 9bdb12b7a2984ad6bae08231e419279a (127.26.206.194:32785): Not found: Tablet not found: 4ebf4627c4724a45b76109afc135618a
I20260808 14:53:33.580545 12155 leader_election.cc:302] T 4ebf4627c4724a45b76109afc135618a P f3812b4693ca412a9ebd05153fa0161e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3812b4693ca412a9ebd05153fa0161e; no voters: 9bdb12b7a2984ad6bae08231e419279a, d262cd4649d64d90a2bcfc3e73ac8e3c
I20260808 14:53:33.580827 12622 raft_consensus.cc:2726] T 4ebf4627c4724a45b76109afc135618a P f3812b4693ca412a9ebd05153fa0161e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 14:53:33.731348 12623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:33.730588 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:40593 (local address 127.26.206.195:37723)
0808 14:53:33.731052 (+ 464us) negotiation.cc:107] Waiting for socket to connect
0808 14:53:33.731143 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:40593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":372,"thread_start_us":247,"threads_started":1}
I20260808 14:53:33.829555 12624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:33.828740 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:40593 (local address 127.26.206.193:57707)
0808 14:53:33.829224 (+ 484us) negotiation.cc:107] Waiting for socket to connect
0808 14:53:33.829377 (+ 153us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:40593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":381,"thread_start_us":256,"threads_started":1}
I20260808 14:53:34.279878 12625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:34.279075 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:40593 (local address 127.26.206.194:41247)
0808 14:53:34.279544 (+ 469us) negotiation.cc:107] Waiting for socket to connect
0808 14:53:34.279698 (+ 154us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:40593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":371,"thread_start_us":244,"threads_started":1}
I20260808 14:53:34.714406 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 12095
I20260808 14:53:34.729825 12626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:34.715477 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37932 (local address 127.26.206.193:40683)
0808 14:53:34.716107 (+ 630us) server_negotiation.cc:206] Beginning negotiation
0808 14:53:34.716119 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 14:53:34.716800 (+ 681us) server_negotiation.cc:407] Connection header received
0808 14:53:34.716995 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:53:34.717006 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:53:34.717359 (+ 353us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:53:34.717552 (+ 193us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:53:34.719057 (+ 1505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:34.720076 (+ 1019us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:34.721256 (+ 1180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:34.721787 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:34.721882 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:53:34.724453 (+ 2571us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:53:34.724464 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:53:34.724477 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:53:34.724512 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:53:34.727210 (+ 2698us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:53:34.728004 (+ 794us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:53:34.728011 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:53:34.728013 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:53:34.728152 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:53:34.728508 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:53:34.728512 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:53:34.728514 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:53:34.728851 (+ 337us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:53:34.729087 (+ 236us) server_negotiation.cc:1035] Waiting for connection context
0808 14:53:34.729357 (+ 270us) server_negotiation.cc:299] Negotiation successful
0808 14:53:34.729553 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":413,"thread_start_us":369,"threads_started":1}
I20260808 14:53:34.731046 12272 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:53:34.733506 12628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:34.732672 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:40593 (local address 127.26.206.195:35015)
0808 14:53:34.733155 (+ 483us) negotiation.cc:107] Waiting for socket to connect
0808 14:53:34.733305 (+ 150us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:40593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":371,"thread_start_us":260,"threads_started":1}
I20260808 14:53:34.821372 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 12095
I20260808 14:53:34.843796 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 12281
I20260808 14:53:34.857615 12629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:34.844652 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57642 (local address 127.26.206.194:32785)
0808 14:53:34.845203 (+ 551us) server_negotiation.cc:206] Beginning negotiation
0808 14:53:34.845207 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:53:34.845223 (+ 16us) server_negotiation.cc:407] Connection header received
0808 14:53:34.845277 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:53:34.845281 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:53:34.845350 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:53:34.845489 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:53:34.846920 (+ 1431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:34.847847 (+ 927us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:34.849101 (+ 1254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:34.849512 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:34.849645 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:53:34.852377 (+ 2732us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:53:34.852382 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:53:34.852385 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:53:34.852416 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:53:34.854921 (+ 2505us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:53:34.855603 (+ 682us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:53:34.855611 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:53:34.855615 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:53:34.855779 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:53:34.856179 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:53:34.856185 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:53:34.856188 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:53:34.856451 (+ 263us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:53:34.856745 (+ 294us) server_negotiation.cc:1035] Waiting for connection context
0808 14:53:34.857015 (+ 270us) server_negotiation.cc:299] Negotiation successful
0808 14:53:34.857236 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":456,"thread_start_us":314,"threads_started":1}
I20260808 14:53:34.858340 12416 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:53:34.941205 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 12281
I20260808 14:53:34.963179 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 12425
I20260808 14:53:34.978252 12631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:34.964348 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60478 (local address 127.26.206.195:34885)
0808 14:53:34.965032 (+ 684us) server_negotiation.cc:206] Beginning negotiation
0808 14:53:34.965037 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:53:34.965056 (+ 19us) server_negotiation.cc:407] Connection header received
0808 14:53:34.965110 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:53:34.965114 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:53:34.965183 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:53:34.965286 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:53:34.966735 (+ 1449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:34.967488 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:34.968842 (+ 1354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:34.969276 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:34.969379 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:53:34.972248 (+ 2869us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:53:34.972253 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:53:34.972256 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:53:34.972293 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:53:34.975132 (+ 2839us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:53:34.975941 (+ 809us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:53:34.975946 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:53:34.975949 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:53:34.976129 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:53:34.976503 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:53:34.976507 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:53:34.976509 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:53:34.976843 (+ 334us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:53:34.977073 (+ 230us) server_negotiation.cc:1035] Waiting for connection context
0808 14:53:34.977567 (+ 494us) server_negotiation.cc:299] Negotiation successful
0808 14:53:34.977766 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":535,"thread_start_us":250,"threads_started":1}
I20260808 14:53:34.979195 12560 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:53:35.066243 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 12425
2026-08-08T14:53:35Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (24626 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:53:35 dist-test-slave-6k22 krb5kdc[12635](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:53:35 dist-test-slave-6k22 krb5kdc[12635](info): set up 2 sockets
Aug 08 14:53:35 dist-test-slave-6k22 krb5kdc[12635](info): commencing operation
krb5kdc: starting...
W20260808 14:53:36.239811 27451 mini_kdc.cc:121] Time spent starting KDC: real 1.128s user 0.000s sys 0.037s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/krb5kdc/test-user.keytab.
Aug 08 14:53:36 dist-test-slave-6k22 krb5kdc[12635](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200816, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:53:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:53:36Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.206.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.206.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.206.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.254.keytab.
Entry for principal kudu/127.26.206.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.254.keytab.
I20260808 14:53:36.515152 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.206.254:36303
--webserver_interface=127.26.206.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.254.keytab
--principal=kudu/127.26.206.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.206.212:36399
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.206.254:36303
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:53:36.842767 12652 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:53:36.843087 12652 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:53:36.843276 12652 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:53:36.850364 12652 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260808 14:53:36.850498 12652 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260808 14:53:36.850589 12652 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260808 14:53:36.850749 12652 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:53:36.850852 12652 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:53:36.850972 12652 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:53:36.851061 12652 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:53:36.851143 12652 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:53:36.860769 12652 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:36399
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.26.206.254:36303
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.254.keytab
--principal=kudu/127.26.206.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.206.254:36303
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.206.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:53:36.861976 12652 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:53:36.863281 12652 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:53:36.875645 12658 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:53:36.875501 12659 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:53:36.875507 12661 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:53:36.876101 12652 server_base.cc:1034] running on GCE node
I20260808 14:53:36.877115 12652 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:53:36.878365 12652 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:53:36.879667 12652 hybrid_clock.cc:648] HybridClock initialized: now 1786200816879587 us; error 31 us; skew 500 ppm
I20260808 14:53:36.879987 12652 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:53:36 dist-test-slave-6k22 krb5kdc[12635](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200816, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:53:36.883209 12652 init.cc:377] Logged in from keytab as kudu/127.26.206.254@KRBTEST.COM (short username kudu)
I20260808 14:53:36.884696 12652 webserver.cc:460] Webserver started at http://127.26.206.254:37771/ using document root <none> and password file <none>
I20260808 14:53:36.885371 12652 fs_manager.cc:359] Metadata directory not provided
I20260808 14:53:36.885506 12652 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:53:36.885835 12652 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:53:36.888861 12652 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/master-0/data/instance:
uuid: "2211e587c1c44266be6a99f6db814787"
format_stamp: "Formatted at 2026-08-08 14:53:36 on dist-test-slave-6k22"
server_key: "fc866055898221106e04ef19453febe9"
server_key_iv: "7b1e1461341348ed7294e1755b32f607"
server_key_version: "encryptionkey@0"
I20260808 14:53:36.889681 12652 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/master-0/wal/instance:
uuid: "2211e587c1c44266be6a99f6db814787"
format_stamp: "Formatted at 2026-08-08 14:53:36 on dist-test-slave-6k22"
server_key: "fc866055898221106e04ef19453febe9"
server_key_iv: "7b1e1461341348ed7294e1755b32f607"
server_key_version: "encryptionkey@0"
I20260808 14:53:36.894670 12652 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.005s
I20260808 14:53:36.898075 12668 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:53:36.899411 12652 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 14:53:36.899690 12652 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/master-0/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/master-0/wal
uuid: "2211e587c1c44266be6a99f6db814787"
format_stamp: "Formatted at 2026-08-08 14:53:36 on dist-test-slave-6k22"
server_key: "fc866055898221106e04ef19453febe9"
server_key_iv: "7b1e1461341348ed7294e1755b32f607"
server_key_version: "encryptionkey@0"
I20260808 14:53:36.899935 12652 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:53:36.928718 12652 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:53:36.933085 12652 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:53:36.933374 12652 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:53:36.952255 12652 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.254:36303
I20260808 14:53:36.952291 12726 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.254:36303 every 8 connection(s)
I20260808 14:53:36.953627 12652 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
I20260808 14:53:36.957150 12728 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:53:36.961416 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 12652
I20260808 14:53:36.961663 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/master-0/wal/instance
I20260808 14:53:36.962539 27451 external_mini_cluster.cc:1428] Setting key d6ac4a7fa3a80b3a442ec5336f15c1c3
I20260808 14:53:36.968880 12728 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2211e587c1c44266be6a99f6db814787: Bootstrap starting.
I20260808 14:53:36.972548 12728 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2211e587c1c44266be6a99f6db814787: Neither blocks nor log segments found. Creating new log.
I20260808 14:53:36.973713 12728 log.cc:824] T 00000000000000000000000000000000 P 2211e587c1c44266be6a99f6db814787: Log is configured to *not* fsync() on all Append() calls
I20260808 14:53:36.977144 12728 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2211e587c1c44266be6a99f6db814787: No bootstrap required, opened a new log
Aug 08 14:53:36 dist-test-slave-6k22 krb5kdc[12635](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200816, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.206.254@KRBTEST.COM
I20260808 14:53:36.985149 12728 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2211e587c1c44266be6a99f6db814787 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2211e587c1c44266be6a99f6db814787" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 36303 } }
I20260808 14:53:36.985526 12728 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2211e587c1c44266be6a99f6db814787 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:53:36.985651 12728 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2211e587c1c44266be6a99f6db814787 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2211e587c1c44266be6a99f6db814787, State: Initialized, Role: FOLLOWER
I20260808 14:53:36.986330 12728 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2211e587c1c44266be6a99f6db814787 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2211e587c1c44266be6a99f6db814787" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 36303 } }
I20260808 14:53:36.986583 12728 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2211e587c1c44266be6a99f6db814787 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:53:36.986773 12728 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2211e587c1c44266be6a99f6db814787 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:53:36.986948 12728 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2211e587c1c44266be6a99f6db814787 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:53:36.987308 12731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:36.964787 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35816 (local address 127.26.206.254:36303)
0808 14:53:36.965573 (+ 786us) server_negotiation.cc:206] Beginning negotiation
0808 14:53:36.965583 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 14:53:36.965626 (+ 43us) server_negotiation.cc:407] Connection header received
0808 14:53:36.967335 (+ 1709us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:53:36.967355 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:53:36.967769 (+ 414us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:53:36.968074 (+ 305us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:53:36.969957 (+ 1883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:36.971333 (+ 1376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:36.973334 (+ 2001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:36.974032 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:36.974231 (+ 199us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:53:36.979142 (+ 4911us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:53:36.979149 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:53:36.979162 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:53:36.979212 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:53:36.982432 (+ 3220us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:53:36.983266 (+ 834us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:53:36.983276 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:53:36.983283 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:53:36.983509 (+ 226us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:53:36.984119 (+ 610us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:53:36.984125 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:53:36.984129 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:53:36.984673 (+ 544us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:53:36.985010 (+ 337us) server_negotiation.cc:1035] Waiting for connection context
0808 14:53:36.985543 (+ 533us) server_negotiation.cc:299] Negotiation successful
0808 14:53:36.986036 (+ 493us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":582,"thread_start_us":400,"threads_started":1}
I20260808 14:53:36.989491 12728 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2211e587c1c44266be6a99f6db814787 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2211e587c1c44266be6a99f6db814787" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 36303 } }
I20260808 14:53:36.990029 12728 leader_election.cc:302] T 00000000000000000000000000000000 P 2211e587c1c44266be6a99f6db814787 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2211e587c1c44266be6a99f6db814787; no voters:
I20260808 14:53:36.990633 12728 leader_election.cc:288] T 00000000000000000000000000000000 P 2211e587c1c44266be6a99f6db814787 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:53:36.990832 12735 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2211e587c1c44266be6a99f6db814787 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:53:36.991600 12735 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2211e587c1c44266be6a99f6db814787 [term 1 LEADER]: Becoming Leader. State: Replica: 2211e587c1c44266be6a99f6db814787, State: Running, Role: LEADER
I20260808 14:53:36.992216 12735 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2211e587c1c44266be6a99f6db814787 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2211e587c1c44266be6a99f6db814787" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 36303 } }
I20260808 14:53:36.992627 12728 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2211e587c1c44266be6a99f6db814787 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:53:36.995831 12736 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2211e587c1c44266be6a99f6db814787 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2211e587c1c44266be6a99f6db814787" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2211e587c1c44266be6a99f6db814787" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 36303 } } }
I20260808 14:53:36.996181 12736 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2211e587c1c44266be6a99f6db814787 [sys.catalog]: This master's current role is: LEADER
I20260808 14:53:36.996616 12737 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2211e587c1c44266be6a99f6db814787 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2211e587c1c44266be6a99f6db814787. Latest consensus state: current_term: 1 leader_uuid: "2211e587c1c44266be6a99f6db814787" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2211e587c1c44266be6a99f6db814787" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 36303 } } }
I20260808 14:53:36.996984 12737 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2211e587c1c44266be6a99f6db814787 [sys.catalog]: This master's current role is: LEADER
I20260808 14:53:37.000648 12746 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:53:37.006975 12746 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:53:37.016044 12746 catalog_manager.cc:1347] Generated new cluster ID: e74b98014925407387ddd1325de18488
I20260808 14:53:37.016155 12746 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:53:37.030129 12746 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:53:37.031332 12746 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:53:37.043232 12746 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2211e587c1c44266be6a99f6db814787: Generated new TSK 0
I20260808 14:53:37.044067 12746 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.206.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.206.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.206.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.193.keytab.
Entry for principal kudu/127.26.206.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.193.keytab.
I20260808 14:53:37.123219 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.206.193:0
--local_ip_for_outbound_sockets=127.26.206.193
--webserver_interface=127.26.206.193
--webserver_port=0
--tserver_master_addrs=127.26.206.254:36303
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.193.keytab
--principal=kudu/127.26.206.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.206.212:36399
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:53:37.455322 12760 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:53:37.455642 12760 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:53:37.455755 12760 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:53:37.462800 12760 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:53:37.462898 12760 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:53:37.463002 12760 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.206.193
I20260808 14:53:37.472771 12760 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:36399
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.193.keytab
--principal=kudu/127.26.206.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.206.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.206.193
--webserver_port=0
--tserver_master_addrs=127.26.206.254:36303
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.206.193
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:53:37.473901 12760 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:53:37.475122 12760 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:53:37.488544 12766 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:53:37.488613 12765 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:53:37.488528 12768 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:53:37.489795 12760 server_base.cc:1034] running on GCE node
I20260808 14:53:37.490458 12760 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:53:37.491336 12760 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:53:37.492528 12760 hybrid_clock.cc:648] HybridClock initialized: now 1786200817492482 us; error 38 us; skew 500 ppm
I20260808 14:53:37.492834 12760 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:53:37 dist-test-slave-6k22 krb5kdc[12635](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200817, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:53:37.495922 12760 init.cc:377] Logged in from keytab as kudu/127.26.206.193@KRBTEST.COM (short username kudu)
I20260808 14:53:37.497298 12760 webserver.cc:460] Webserver started at http://127.26.206.193:36641/ using document root <none> and password file <none>
I20260808 14:53:37.497957 12760 fs_manager.cc:359] Metadata directory not provided
I20260808 14:53:37.498123 12760 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:53:37.498502 12760 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:53:37.501291 12760 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-0/data/instance:
uuid: "574da58b8d344a59b3948d30570aed1f"
format_stamp: "Formatted at 2026-08-08 14:53:37 on dist-test-slave-6k22"
server_key: "c317065575b8cc521f210c52419bce58"
server_key_iv: "0a8e0c1a9e80b8d068e8487e255aa77d"
server_key_version: "encryptionkey@0"
I20260808 14:53:37.501993 12760 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-0/wal/instance:
uuid: "574da58b8d344a59b3948d30570aed1f"
format_stamp: "Formatted at 2026-08-08 14:53:37 on dist-test-slave-6k22"
server_key: "c317065575b8cc521f210c52419bce58"
server_key_iv: "0a8e0c1a9e80b8d068e8487e255aa77d"
server_key_version: "encryptionkey@0"
I20260808 14:53:37.506978 12760 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.004s
I20260808 14:53:37.510264 12776 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:53:37.511546 12760 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 14:53:37.511770 12760 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-0/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-0/wal
uuid: "574da58b8d344a59b3948d30570aed1f"
format_stamp: "Formatted at 2026-08-08 14:53:37 on dist-test-slave-6k22"
server_key: "c317065575b8cc521f210c52419bce58"
server_key_iv: "0a8e0c1a9e80b8d068e8487e255aa77d"
server_key_version: "encryptionkey@0"
I20260808 14:53:37.511948 12760 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:53:37.534077 12760 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:53:37.537911 12760 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:53:37.538138 12760 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:53:37.539044 12760 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:53:37.540287 12760 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:53:37.540362 12760 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:53:37.540467 12760 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:53:37.540510 12760 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:53:37.573334 12760 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.193:42847
I20260808 14:53:37.573421 12900 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.193:42847 every 8 connection(s)
I20260808 14:53:37.574641 12760 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-0/data/info.pb
I20260808 14:53:37.579689 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 12760
I20260808 14:53:37.579906 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-0/wal/instance
I20260808 14:53:37.580677 27451 external_mini_cluster.cc:1428] Setting key e93d2c7f5f92e678350b26786bb1e472
Aug 08 14:53:37 dist-test-slave-6k22 krb5kdc[12635](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200817, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.193@KRBTEST.COM for kudu/127.26.206.254@KRBTEST.COM
I20260808 14:53:37.594825 12903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:37.577191 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.193:60725 (local address 127.26.206.254:36303)
0808 14:53:37.577665 (+ 474us) server_negotiation.cc:206] Beginning negotiation
0808 14:53:37.577671 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:53:37.578630 (+ 959us) server_negotiation.cc:407] Connection header received
0808 14:53:37.580576 (+ 1946us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:53:37.580583 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:53:37.580676 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:53:37.580809 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:53:37.582444 (+ 1635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:37.583210 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:37.584838 (+ 1628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:37.585286 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:37.585438 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:53:37.589033 (+ 3595us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:53:37.589038 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:53:37.589041 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:53:37.589072 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:53:37.591736 (+ 2664us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:53:37.592506 (+ 770us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:53:37.592512 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:53:37.592522 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:53:37.592636 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:53:37.593085 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:53:37.593089 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:53:37.593090 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:53:37.593332 (+ 242us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:53:37.593507 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0808 14:53:37.594179 (+ 672us) server_negotiation.cc:299] Negotiation successful
0808 14:53:37.594400 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":352,"thread_start_us":221,"threads_started":1}
I20260808 14:53:37.595889 12904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:37.577755 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:36303 (local address 127.26.206.193:60725)
0808 14:53:37.578461 (+ 706us) negotiation.cc:107] Waiting for socket to connect
0808 14:53:37.578510 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0808 14:53:37.580283 (+ 1773us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:53:37.581031 (+ 748us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:53:37.581038 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:53:37.581698 (+ 660us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:53:37.582260 (+ 562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:53:37.582277 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:53:37.583396 (+ 1119us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:53:37.583401 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:53:37.584680 (+ 1279us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:53:37.584693 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:53:37.585512 (+ 819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:53:37.585521 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:53:37.585775 (+ 254us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:53:37.586471 (+ 696us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:53:37.586493 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:53:37.588825 (+ 2332us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:53:37.591873 (+ 3048us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:53:37.591882 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:53:37.591896 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:53:37.592397 (+ 501us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:53:37.592758 (+ 361us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:53:37.592763 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:53:37.592767 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:53:37.592960 (+ 193us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:53:37.593459 (+ 499us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:53:37.593466 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:53:37.593788 (+ 322us) client_negotiation.cc:769] Sending connection context
0808 14:53:37.594069 (+ 281us) client_negotiation.cc:240] Negotiation successful
0808 14:53:37.594663 (+ 594us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":451,"thread_start_us":262,"threads_started":1}
I20260808 14:53:37.597416 12901 heartbeater.cc:347] Connected to a master server at 127.26.206.254:36303
I20260808 14:53:37.597698 12901 heartbeater.cc:464] Registering TS with master...
I20260808 14:53:37.598349 12901 heartbeater.cc:511] Master 127.26.206.254:36303 requested a full tablet report, sending...
I20260808 14:53:37.600467 12687 ts_manager.cc:194] Registered new tserver with Master: 574da58b8d344a59b3948d30570aed1f (127.26.206.193:42847)
I20260808 14:53:37.601878 12687 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.206.193@KRBTEST.COM'} at 127.26.206.193:60725
WARNING: no policy specified for kudu/127.26.206.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.206.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.206.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.194.keytab.
Entry for principal kudu/127.26.206.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.194.keytab.
I20260808 14:53:37.644091 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.206.194:0
--local_ip_for_outbound_sockets=127.26.206.194
--webserver_interface=127.26.206.194
--webserver_port=0
--tserver_master_addrs=127.26.206.254:36303
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.194.keytab
--principal=kudu/127.26.206.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.206.212:36399
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:53:37.983011 12907 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:53:37.983366 12907 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:53:37.983541 12907 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:53:37.991307 12907 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:53:37.991463 12907 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:53:37.991704 12907 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.206.194
I20260808 14:53:38.001879 12907 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:36399
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.194.keytab
--principal=kudu/127.26.206.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.206.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.206.194
--webserver_port=0
--tserver_master_addrs=127.26.206.254:36303
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.206.194
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:53:38.003317 12907 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:53:38.004809 12907 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:53:38.017987 12913 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:53:38.018055 12914 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:53:38.018085 12916 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:53:38.019375 12907 server_base.cc:1034] running on GCE node
I20260808 14:53:38.020119 12907 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:53:38.021184 12907 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:53:38.022428 12907 hybrid_clock.cc:648] HybridClock initialized: now 1786200818022372 us; error 39 us; skew 500 ppm
I20260808 14:53:38.022761 12907 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:53:38 dist-test-slave-6k22 krb5kdc[12635](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200818, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:53:38.031746 12907 init.cc:377] Logged in from keytab as kudu/127.26.206.194@KRBTEST.COM (short username kudu)
I20260808 14:53:38.033274 12907 webserver.cc:460] Webserver started at http://127.26.206.194:35861/ using document root <none> and password file <none>
I20260808 14:53:38.033980 12907 fs_manager.cc:359] Metadata directory not provided
I20260808 14:53:38.034142 12907 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:53:38.034488 12907 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:53:38.038280 12907 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-1/data/instance:
uuid: "7756a98e892e47e48747ae56f59a0f18"
format_stamp: "Formatted at 2026-08-08 14:53:38 on dist-test-slave-6k22"
server_key: "321066ae9e0ab22a5fb571ce6ae33065"
server_key_iv: "e15868717a4ae6b560b88356de9ee4b1"
server_key_version: "encryptionkey@0"
I20260808 14:53:38.039191 12907 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-1/wal/instance:
uuid: "7756a98e892e47e48747ae56f59a0f18"
format_stamp: "Formatted at 2026-08-08 14:53:38 on dist-test-slave-6k22"
server_key: "321066ae9e0ab22a5fb571ce6ae33065"
server_key_iv: "e15868717a4ae6b560b88356de9ee4b1"
server_key_version: "encryptionkey@0"
I20260808 14:53:38.044724 12907 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260808 14:53:38.048240 12925 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:53:38.049566 12907 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 14:53:38.049729 12907 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-1/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-1/wal
uuid: "7756a98e892e47e48747ae56f59a0f18"
format_stamp: "Formatted at 2026-08-08 14:53:38 on dist-test-slave-6k22"
server_key: "321066ae9e0ab22a5fb571ce6ae33065"
server_key_iv: "e15868717a4ae6b560b88356de9ee4b1"
server_key_version: "encryptionkey@0"
I20260808 14:53:38.049938 12907 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:53:38.071985 12907 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:53:38.075846 12907 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:53:38.076135 12907 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:53:38.077085 12907 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:53:38.078331 12907 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:53:38.078480 12907 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:53:38.078631 12907 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:53:38.078706 12907 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:53:38.112771 12907 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.194:36053
I20260808 14:53:38.112855 13049 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.194:36053 every 8 connection(s)
I20260808 14:53:38.114029 12907 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-1/data/info.pb
I20260808 14:53:38.122578 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 12907
I20260808 14:53:38.122786 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-1/wal/instance
I20260808 14:53:38.123229 27451 external_mini_cluster.cc:1428] Setting key 183a4c84b4209800759f5be440c91a4f
Aug 08 14:53:38 dist-test-slave-6k22 krb5kdc[12635](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200818, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.194@KRBTEST.COM for kudu/127.26.206.254@KRBTEST.COM
I20260808 14:53:38.135488 13052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:38.116860 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.194:34891 (local address 127.26.206.254:36303)
0808 14:53:38.117322 (+ 462us) server_negotiation.cc:206] Beginning negotiation
0808 14:53:38.117326 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:53:38.118049 (+ 723us) server_negotiation.cc:407] Connection header received
0808 14:53:38.119971 (+ 1922us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:53:38.119979 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:53:38.120075 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:53:38.120200 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:53:38.121636 (+ 1436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:38.122373 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:38.124257 (+ 1884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:38.124870 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:38.124987 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:53:38.129400 (+ 4413us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:53:38.129405 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:53:38.129408 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:53:38.129439 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:53:38.132237 (+ 2798us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:53:38.133219 (+ 982us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:53:38.133224 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:53:38.133226 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:53:38.133354 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:53:38.133859 (+ 505us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:53:38.133862 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:53:38.133864 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:53:38.134111 (+ 247us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:53:38.134232 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0808 14:53:38.135057 (+ 825us) server_negotiation.cc:299] Negotiation successful
0808 14:53:38.135235 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":368,"thread_start_us":245,"threads_started":1}
I20260808 14:53:38.136869 13053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:38.117178 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:36303 (local address 127.26.206.194:34891)
0808 14:53:38.117898 (+ 720us) negotiation.cc:107] Waiting for socket to connect
0808 14:53:38.117934 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0808 14:53:38.119696 (+ 1762us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:53:38.120418 (+ 722us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:53:38.120426 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:53:38.120922 (+ 496us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:53:38.121467 (+ 545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:53:38.121484 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:53:38.122531 (+ 1047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:53:38.122535 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:53:38.124091 (+ 1556us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:53:38.124120 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:53:38.125129 (+ 1009us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:53:38.125138 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:53:38.125427 (+ 289us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:53:38.126138 (+ 711us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:53:38.126168 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:53:38.129147 (+ 2979us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:53:38.132370 (+ 3223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:53:38.132380 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:53:38.132397 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:53:38.133074 (+ 677us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:53:38.133466 (+ 392us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:53:38.133473 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:53:38.133480 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:53:38.133737 (+ 257us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:53:38.134243 (+ 506us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:53:38.134252 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:53:38.134680 (+ 428us) client_negotiation.cc:769] Sending connection context
0808 14:53:38.134964 (+ 284us) client_negotiation.cc:240] Negotiation successful
0808 14:53:38.135504 (+ 540us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":509,"thread_start_us":295,"threads_started":1}
I20260808 14:53:38.138321 13050 heartbeater.cc:347] Connected to a master server at 127.26.206.254:36303
I20260808 14:53:38.138700 13050 heartbeater.cc:464] Registering TS with master...
I20260808 14:53:38.139637 13050 heartbeater.cc:511] Master 127.26.206.254:36303 requested a full tablet report, sending...
I20260808 14:53:38.141189 12687 ts_manager.cc:194] Registered new tserver with Master: 7756a98e892e47e48747ae56f59a0f18 (127.26.206.194:36053)
I20260808 14:53:38.141992 12687 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.206.194@KRBTEST.COM'} at 127.26.206.194:34891
WARNING: no policy specified for kudu/127.26.206.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.206.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.206.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.195.keytab.
Entry for principal kudu/127.26.206.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.195.keytab.
I20260808 14:53:38.190327 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.206.195:0
--local_ip_for_outbound_sockets=127.26.206.195
--webserver_interface=127.26.206.195
--webserver_port=0
--tserver_master_addrs=127.26.206.254:36303
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.195.keytab
--principal=kudu/127.26.206.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.206.212:36399
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:53:38.522701 13056 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:53:38.523003 13056 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:53:38.523186 13056 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:53:38.530256 13056 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:53:38.530400 13056 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:53:38.530592 13056 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.206.195
I20260808 14:53:38.540220 13056 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:36399
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.195.keytab
--principal=kudu/127.26.206.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.206.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.206.195
--webserver_port=0
--tserver_master_addrs=127.26.206.254:36303
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.206.195
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:53:38.541436 13056 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:53:38.542727 13056 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:53:38.556195 13061 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:53:38.556146 13064 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:53:38.556133 13062 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:53:38.557101 13056 server_base.cc:1034] running on GCE node
I20260808 14:53:38.557710 13056 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:53:38.558619 13056 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:53:38.559826 13056 hybrid_clock.cc:648] HybridClock initialized: now 1786200818559782 us; error 34 us; skew 500 ppm
I20260808 14:53:38.560155 13056 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:53:38 dist-test-slave-6k22 krb5kdc[12635](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200818, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:53:38.563498 13056 init.cc:377] Logged in from keytab as kudu/127.26.206.195@KRBTEST.COM (short username kudu)
I20260808 14:53:38.564860 13056 webserver.cc:460] Webserver started at http://127.26.206.195:42867/ using document root <none> and password file <none>
I20260808 14:53:38.565534 13056 fs_manager.cc:359] Metadata directory not provided
I20260808 14:53:38.565681 13056 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:53:38.566087 13056 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:53:38.569331 13056 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-2/data/instance:
uuid: "46283576054b4c8396f1ceb328b1c2c5"
format_stamp: "Formatted at 2026-08-08 14:53:38 on dist-test-slave-6k22"
server_key: "5823795a141ba1cae57b057b91012e95"
server_key_iv: "171a337823b6e8fd6e4943f99a67744f"
server_key_version: "encryptionkey@0"
I20260808 14:53:38.570011 13056 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-2/wal/instance:
uuid: "46283576054b4c8396f1ceb328b1c2c5"
format_stamp: "Formatted at 2026-08-08 14:53:38 on dist-test-slave-6k22"
server_key: "5823795a141ba1cae57b057b91012e95"
server_key_iv: "171a337823b6e8fd6e4943f99a67744f"
server_key_version: "encryptionkey@0"
I20260808 14:53:38.575119 13056 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260808 14:53:38.578689 13072 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:53:38.579991 13056 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 14:53:38.580152 13056 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-2/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-2/wal
uuid: "46283576054b4c8396f1ceb328b1c2c5"
format_stamp: "Formatted at 2026-08-08 14:53:38 on dist-test-slave-6k22"
server_key: "5823795a141ba1cae57b057b91012e95"
server_key_iv: "171a337823b6e8fd6e4943f99a67744f"
server_key_version: "encryptionkey@0"
I20260808 14:53:38.580366 13056 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:53:38.603641 13056 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:53:38.604969 12901 heartbeater.cc:503] Master 127.26.206.254:36303 was elected leader, sending a full tablet report...
I20260808 14:53:38.608438 13056 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:53:38.608740 13056 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:53:38.609668 13056 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:53:38.610994 13056 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:53:38.611106 13056 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:53:38.611272 13056 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:53:38.611346 13056 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:53:38.643545 13056 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.195:35273
I20260808 14:53:38.643658 13198 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.195:35273 every 8 connection(s)
I20260808 14:53:38.644886 13056 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-2/data/info.pb
I20260808 14:53:38.646622 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 13056
I20260808 14:53:38.646832 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-2/wal/instance
I20260808 14:53:38.647403 27451 external_mini_cluster.cc:1428] Setting key 720953703e318be0cf512f51bb2b04bf
Aug 08 14:53:38 dist-test-slave-6k22 krb5kdc[12635](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200818, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.195@KRBTEST.COM for kudu/127.26.206.254@KRBTEST.COM
I20260808 14:53:38.667608 13201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:38.647967 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.195:48355 (local address 127.26.206.254:36303)
0808 14:53:38.648571 (+ 604us) server_negotiation.cc:206] Beginning negotiation
0808 14:53:38.648577 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:53:38.649743 (+ 1166us) server_negotiation.cc:407] Connection header received
0808 14:53:38.652174 (+ 2431us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:53:38.652180 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:53:38.652295 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:53:38.652426 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:53:38.654138 (+ 1712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:38.655019 (+ 881us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:38.656721 (+ 1702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:38.657178 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:38.657329 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:53:38.661036 (+ 3707us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:53:38.661043 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:53:38.661056 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:53:38.661096 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:53:38.664266 (+ 3170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:53:38.665066 (+ 800us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:53:38.665078 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:53:38.665080 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:53:38.665216 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:53:38.665722 (+ 506us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:53:38.665728 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:53:38.665731 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:53:38.666000 (+ 269us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:53:38.666195 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0808 14:53:38.666906 (+ 711us) server_negotiation.cc:299] Negotiation successful
0808 14:53:38.667129 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":460,"thread_start_us":287,"threads_started":1}
I20260808 14:53:38.668514 13202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:38.648534 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:36303 (local address 127.26.206.195:48355)
0808 14:53:38.649524 (+ 990us) negotiation.cc:107] Waiting for socket to connect
0808 14:53:38.649587 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0808 14:53:38.651889 (+ 2302us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:53:38.652682 (+ 793us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:53:38.652690 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:53:38.653291 (+ 601us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:53:38.653959 (+ 668us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:53:38.653980 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:53:38.655189 (+ 1209us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:53:38.655202 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:53:38.656546 (+ 1344us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:53:38.656559 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:53:38.657424 (+ 865us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:53:38.657432 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:53:38.657700 (+ 268us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:53:38.658451 (+ 751us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:53:38.658474 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:53:38.660817 (+ 2343us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:53:38.664428 (+ 3611us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:53:38.664438 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:53:38.664454 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:53:38.664920 (+ 466us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:53:38.665354 (+ 434us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:53:38.665359 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:53:38.665363 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:53:38.665578 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:53:38.666150 (+ 572us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:53:38.666159 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:53:38.666506 (+ 347us) client_negotiation.cc:769] Sending connection context
0808 14:53:38.666789 (+ 283us) client_negotiation.cc:240] Negotiation successful
0808 14:53:38.667304 (+ 515us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":666,"thread_start_us":364,"threads_started":1}
I20260808 14:53:38.669894 13199 heartbeater.cc:347] Connected to a master server at 127.26.206.254:36303
I20260808 14:53:38.670179 13199 heartbeater.cc:464] Registering TS with master...
I20260808 14:53:38.670917 13199 heartbeater.cc:511] Master 127.26.206.254:36303 requested a full tablet report, sending...
I20260808 14:53:38.672492 12687 ts_manager.cc:194] Registered new tserver with Master: 46283576054b4c8396f1ceb328b1c2c5 (127.26.206.195:35273)
I20260808 14:53:38.673362 12687 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.206.195@KRBTEST.COM'} at 127.26.206.195:48355
I20260808 14:53:38.676033 27451 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 14:53:38.693799 13201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:38.680544 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33166 (local address 127.26.206.254:36303)
0808 14:53:38.680707 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0808 14:53:38.680713 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:53:38.681180 (+ 467us) server_negotiation.cc:407] Connection header received
0808 14:53:38.681395 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:53:38.681400 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:53:38.681459 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:53:38.681559 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:53:38.683013 (+ 1454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:38.683877 (+ 864us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:38.685301 (+ 1424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:38.685692 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:38.685824 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:53:38.688324 (+ 2500us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:53:38.688333 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:53:38.688340 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:53:38.688375 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:53:38.690796 (+ 2421us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:53:38.691512 (+ 716us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:53:38.691519 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:53:38.691523 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:53:38.691708 (+ 185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:53:38.692170 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:53:38.692176 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:53:38.692179 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:53:38.692612 (+ 433us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:53:38.692901 (+ 289us) server_negotiation.cc:1035] Waiting for connection context
0808 14:53:38.693241 (+ 340us) server_negotiation.cc:299] Negotiation successful
0808 14:53:38.693472 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260808 14:53:38.697889 12687 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33166:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:53:38.705453 12687 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:53:38.738478 13215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:38.717912 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51208 (local address 127.26.206.193:42847)
0808 14:53:38.729583 (+ 11671us) server_negotiation.cc:206] Beginning negotiation
0808 14:53:38.729620 (+ 37us) server_negotiation.cc:399] Waiting for connection header
0808 14:53:38.729668 (+ 48us) server_negotiation.cc:407] Connection header received
0808 14:53:38.729793 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:53:38.729802 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:53:38.730104 (+ 302us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:53:38.730343 (+ 239us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:53:38.731030 (+ 687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:38.732756 (+ 1726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:38.735651 (+ 2895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:38.737172 (+ 1521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:38.737372 (+ 200us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:53:38.737559 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0808 14:53:38.737921 (+ 362us) server_negotiation.cc:299] Negotiation successful
0808 14:53:38.738102 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11462,"thread_start_us":11280,"threads_started":1}
I20260808 14:53:38.738474 13214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:38.717496 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.193:42847 (local address 127.0.0.1:51208)
0808 14:53:38.718378 (+ 882us) negotiation.cc:107] Waiting for socket to connect
0808 14:53:38.718445 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0808 14:53:38.718624 (+ 179us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:53:38.730401 (+ 11777us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:53:38.730408 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:53:38.730491 (+ 83us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:53:38.730856 (+ 365us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:53:38.730865 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:53:38.732911 (+ 2046us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:53:38.732917 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:53:38.735456 (+ 2539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:53:38.735472 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:53:38.737416 (+ 1944us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:53:38.737422 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:53:38.737632 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:53:38.737691 (+ 59us) client_negotiation.cc:769] Sending connection context
0808 14:53:38.737854 (+ 163us) client_negotiation.cc:240] Negotiation successful
0808 14:53:38.738051 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":630,"thread_start_us":12626,"threads_started":1}
I20260808 14:53:38.740521 13213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:38.717695 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.195:35273 (local address 127.0.0.1:35930)
0808 14:53:38.729861 (+ 12166us) negotiation.cc:107] Waiting for socket to connect
0808 14:53:38.729880 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 14:53:38.730020 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:53:38.732772 (+ 2752us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:53:38.732776 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:53:38.732807 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:53:38.733249 (+ 442us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:53:38.733262 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:53:38.735540 (+ 2278us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:53:38.735545 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:53:38.737773 (+ 2228us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:53:38.737787 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:53:38.739646 (+ 1859us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:53:38.739654 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:53:38.739821 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:53:38.739855 (+ 34us) client_negotiation.cc:769] Sending connection context
0808 14:53:38.739952 (+ 97us) client_negotiation.cc:240] Negotiation successful
0808 14:53:38.740080 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12049,"mutex_wait_us":31,"thread_start_us":943,"threads_started":1}
I20260808 14:53:38.741080 13216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:38.718328 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35930 (local address 127.26.206.195:35273)
0808 14:53:38.732142 (+ 13814us) server_negotiation.cc:206] Beginning negotiation
0808 14:53:38.732152 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 14:53:38.732187 (+ 35us) server_negotiation.cc:407] Connection header received
0808 14:53:38.732279 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:53:38.732286 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:53:38.732541 (+ 255us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:53:38.733487 (+ 946us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:53:38.733799 (+ 312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:38.735378 (+ 1579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:38.737979 (+ 2601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:38.739417 (+ 1438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:38.739625 (+ 208us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:53:38.739811 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0808 14:53:38.740609 (+ 798us) server_negotiation.cc:299] Negotiation successful
0808 14:53:38.740797 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13639,"thread_start_us":14257,"threads_started":1}
I20260808 14:53:38.741331 13217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:38.719318 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.194:36053 (local address 127.0.0.1:49698)
0808 14:53:38.731443 (+ 12125us) negotiation.cc:107] Waiting for socket to connect
0808 14:53:38.731463 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 14:53:38.731594 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:53:38.733707 (+ 2113us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:53:38.733711 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:53:38.733736 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:53:38.734211 (+ 475us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:53:38.734220 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:53:38.736063 (+ 1843us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:53:38.736071 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:53:38.737769 (+ 1698us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:53:38.737783 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:53:38.740391 (+ 2608us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:53:38.740399 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:53:38.740582 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:53:38.740731 (+ 149us) client_negotiation.cc:769] Sending connection context
0808 14:53:38.740831 (+ 100us) client_negotiation.cc:240] Negotiation successful
0808 14:53:38.740971 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12004,"mutex_wait_us":1,"thread_start_us":11863,"threads_started":1}
I20260808 14:53:38.742033 13218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:38.719635 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49698 (local address 127.26.206.194:36053)
0808 14:53:38.733263 (+ 13628us) server_negotiation.cc:206] Beginning negotiation
0808 14:53:38.733269 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:53:38.733292 (+ 23us) server_negotiation.cc:407] Connection header received
0808 14:53:38.733364 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:53:38.733368 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:53:38.733518 (+ 150us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:53:38.733715 (+ 197us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:53:38.734407 (+ 692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:38.735912 (+ 1505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:38.737936 (+ 2024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:38.740150 (+ 2214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:38.740323 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:53:38.740486 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0808 14:53:38.741543 (+ 1057us) server_negotiation.cc:299] Negotiation successful
0808 14:53:38.741710 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13488,"thread_start_us":13348,"threads_started":1}
I20260808 14:53:38.742969 12827 tablet_service.cc:1467] Processing CreateTablet for tablet 9bbfb89126ce4ee49c92cbffa484543e (DEFAULT_TABLE table=test-table [id=85214c7772064ffaa94a58b93cf0f98c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:53:38.744463 12827 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9bbfb89126ce4ee49c92cbffa484543e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:53:38.744743 13124 tablet_service.cc:1467] Processing CreateTablet for tablet 9bbfb89126ce4ee49c92cbffa484543e (DEFAULT_TABLE table=test-table [id=85214c7772064ffaa94a58b93cf0f98c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:53:38.745582 12978 tablet_service.cc:1467] Processing CreateTablet for tablet 9bbfb89126ce4ee49c92cbffa484543e (DEFAULT_TABLE table=test-table [id=85214c7772064ffaa94a58b93cf0f98c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:53:38.746169 13124 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9bbfb89126ce4ee49c92cbffa484543e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:53:38.746869 12978 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9bbfb89126ce4ee49c92cbffa484543e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:53:38.756557 13219 tablet_bootstrap.cc:492] T 9bbfb89126ce4ee49c92cbffa484543e P 574da58b8d344a59b3948d30570aed1f: Bootstrap starting.
I20260808 14:53:38.759707 13219 tablet_bootstrap.cc:654] T 9bbfb89126ce4ee49c92cbffa484543e P 574da58b8d344a59b3948d30570aed1f: Neither blocks nor log segments found. Creating new log.
I20260808 14:53:38.760607 13220 tablet_bootstrap.cc:492] T 9bbfb89126ce4ee49c92cbffa484543e P 46283576054b4c8396f1ceb328b1c2c5: Bootstrap starting.
I20260808 14:53:38.761893 13219 log.cc:824] T 9bbfb89126ce4ee49c92cbffa484543e P 574da58b8d344a59b3948d30570aed1f: Log is configured to *not* fsync() on all Append() calls
I20260808 14:53:38.762575 13221 tablet_bootstrap.cc:492] T 9bbfb89126ce4ee49c92cbffa484543e P 7756a98e892e47e48747ae56f59a0f18: Bootstrap starting.
I20260808 14:53:38.764328 13220 tablet_bootstrap.cc:654] T 9bbfb89126ce4ee49c92cbffa484543e P 46283576054b4c8396f1ceb328b1c2c5: Neither blocks nor log segments found. Creating new log.
I20260808 14:53:38.765597 13221 tablet_bootstrap.cc:654] T 9bbfb89126ce4ee49c92cbffa484543e P 7756a98e892e47e48747ae56f59a0f18: Neither blocks nor log segments found. Creating new log.
I20260808 14:53:38.765586 13220 log.cc:824] T 9bbfb89126ce4ee49c92cbffa484543e P 46283576054b4c8396f1ceb328b1c2c5: Log is configured to *not* fsync() on all Append() calls
I20260808 14:53:38.766396 13219 tablet_bootstrap.cc:492] T 9bbfb89126ce4ee49c92cbffa484543e P 574da58b8d344a59b3948d30570aed1f: No bootstrap required, opened a new log
I20260808 14:53:38.766672 13219 ts_tablet_manager.cc:1397] T 9bbfb89126ce4ee49c92cbffa484543e P 574da58b8d344a59b3948d30570aed1f: Time spent bootstrapping tablet: real 0.010s user 0.005s sys 0.002s
I20260808 14:53:38.766762 13221 log.cc:824] T 9bbfb89126ce4ee49c92cbffa484543e P 7756a98e892e47e48747ae56f59a0f18: Log is configured to *not* fsync() on all Append() calls
I20260808 14:53:38.768500 13220 tablet_bootstrap.cc:492] T 9bbfb89126ce4ee49c92cbffa484543e P 46283576054b4c8396f1ceb328b1c2c5: No bootstrap required, opened a new log
I20260808 14:53:38.768751 13220 ts_tablet_manager.cc:1397] T 9bbfb89126ce4ee49c92cbffa484543e P 46283576054b4c8396f1ceb328b1c2c5: Time spent bootstrapping tablet: real 0.008s user 0.007s sys 0.000s
I20260808 14:53:38.769738 13221 tablet_bootstrap.cc:492] T 9bbfb89126ce4ee49c92cbffa484543e P 7756a98e892e47e48747ae56f59a0f18: No bootstrap required, opened a new log
I20260808 14:53:38.770025 13221 ts_tablet_manager.cc:1397] T 9bbfb89126ce4ee49c92cbffa484543e P 7756a98e892e47e48747ae56f59a0f18: Time spent bootstrapping tablet: real 0.008s user 0.007s sys 0.000s
I20260808 14:53:38.774397 13219 raft_consensus.cc:348] T 9bbfb89126ce4ee49c92cbffa484543e P 574da58b8d344a59b3948d30570aed1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "574da58b8d344a59b3948d30570aed1f" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 42847 } } peers { permanent_uuid: "46283576054b4c8396f1ceb328b1c2c5" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 35273 } } peers { permanent_uuid: "7756a98e892e47e48747ae56f59a0f18" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 36053 } }
I20260808 14:53:38.774734 13219 raft_consensus.cc:374] T 9bbfb89126ce4ee49c92cbffa484543e P 574da58b8d344a59b3948d30570aed1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:53:38.774863 13219 raft_consensus.cc:729] T 9bbfb89126ce4ee49c92cbffa484543e P 574da58b8d344a59b3948d30570aed1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 574da58b8d344a59b3948d30570aed1f, State: Initialized, Role: FOLLOWER
I20260808 14:53:38.775449 13219 consensus_queue.cc:260] T 9bbfb89126ce4ee49c92cbffa484543e P 574da58b8d344a59b3948d30570aed1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "574da58b8d344a59b3948d30570aed1f" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 42847 } } peers { permanent_uuid: "46283576054b4c8396f1ceb328b1c2c5" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 35273 } } peers { permanent_uuid: "7756a98e892e47e48747ae56f59a0f18" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 36053 } }
I20260808 14:53:38.777264 13219 ts_tablet_manager.cc:1428] T 9bbfb89126ce4ee49c92cbffa484543e P 574da58b8d344a59b3948d30570aed1f: Time spent starting tablet: real 0.010s user 0.006s sys 0.006s
I20260808 14:53:38.779385 13220 raft_consensus.cc:348] T 9bbfb89126ce4ee49c92cbffa484543e P 46283576054b4c8396f1ceb328b1c2c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "574da58b8d344a59b3948d30570aed1f" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 42847 } } peers { permanent_uuid: "46283576054b4c8396f1ceb328b1c2c5" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 35273 } } peers { permanent_uuid: "7756a98e892e47e48747ae56f59a0f18" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 36053 } }
I20260808 14:53:38.779906 13220 raft_consensus.cc:374] T 9bbfb89126ce4ee49c92cbffa484543e P 46283576054b4c8396f1ceb328b1c2c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:53:38.780048 13220 raft_consensus.cc:729] T 9bbfb89126ce4ee49c92cbffa484543e P 46283576054b4c8396f1ceb328b1c2c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46283576054b4c8396f1ceb328b1c2c5, State: Initialized, Role: FOLLOWER
I20260808 14:53:38.780488 13221 raft_consensus.cc:348] T 9bbfb89126ce4ee49c92cbffa484543e P 7756a98e892e47e48747ae56f59a0f18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "574da58b8d344a59b3948d30570aed1f" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 42847 } } peers { permanent_uuid: "46283576054b4c8396f1ceb328b1c2c5" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 35273 } } peers { permanent_uuid: "7756a98e892e47e48747ae56f59a0f18" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 36053 } }
I20260808 14:53:38.780952 13221 raft_consensus.cc:374] T 9bbfb89126ce4ee49c92cbffa484543e P 7756a98e892e47e48747ae56f59a0f18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:53:38.780813 13220 consensus_queue.cc:260] T 9bbfb89126ce4ee49c92cbffa484543e P 46283576054b4c8396f1ceb328b1c2c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "574da58b8d344a59b3948d30570aed1f" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 42847 } } peers { permanent_uuid: "46283576054b4c8396f1ceb328b1c2c5" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 35273 } } peers { permanent_uuid: "7756a98e892e47e48747ae56f59a0f18" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 36053 } }
I20260808 14:53:38.781116 13221 raft_consensus.cc:729] T 9bbfb89126ce4ee49c92cbffa484543e P 7756a98e892e47e48747ae56f59a0f18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7756a98e892e47e48747ae56f59a0f18, State: Initialized, Role: FOLLOWER
I20260808 14:53:38.781817 13221 consensus_queue.cc:260] T 9bbfb89126ce4ee49c92cbffa484543e P 7756a98e892e47e48747ae56f59a0f18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "574da58b8d344a59b3948d30570aed1f" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 42847 } } peers { permanent_uuid: "46283576054b4c8396f1ceb328b1c2c5" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 35273 } } peers { permanent_uuid: "7756a98e892e47e48747ae56f59a0f18" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 36053 } }
I20260808 14:53:38.782233 13199 heartbeater.cc:503] Master 127.26.206.254:36303 was elected leader, sending a full tablet report...
I20260808 14:53:38.782596 13220 ts_tablet_manager.cc:1428] T 9bbfb89126ce4ee49c92cbffa484543e P 46283576054b4c8396f1ceb328b1c2c5: Time spent starting tablet: real 0.014s user 0.012s sys 0.000s
I20260808 14:53:38.782935 13050 heartbeater.cc:503] Master 127.26.206.254:36303 was elected leader, sending a full tablet report...
I20260808 14:53:38.783648 13221 ts_tablet_manager.cc:1428] T 9bbfb89126ce4ee49c92cbffa484543e P 7756a98e892e47e48747ae56f59a0f18: Time spent starting tablet: real 0.013s user 0.003s sys 0.010s
I20260808 14:53:38.823290 13227 raft_consensus.cc:482] T 9bbfb89126ce4ee49c92cbffa484543e P 46283576054b4c8396f1ceb328b1c2c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:53:38.823642 13227 raft_consensus.cc:504] T 9bbfb89126ce4ee49c92cbffa484543e P 46283576054b4c8396f1ceb328b1c2c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "574da58b8d344a59b3948d30570aed1f" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 42847 } } peers { permanent_uuid: "46283576054b4c8396f1ceb328b1c2c5" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 35273 } } peers { permanent_uuid: "7756a98e892e47e48747ae56f59a0f18" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 36053 } }
I20260808 14:53:38.825403 13227 leader_election.cc:288] T 9bbfb89126ce4ee49c92cbffa484543e P 46283576054b4c8396f1ceb328b1c2c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 574da58b8d344a59b3948d30570aed1f (127.26.206.193:42847), 7756a98e892e47e48747ae56f59a0f18 (127.26.206.194:36053)
W20260808 14:53:38.827215 12902 tablet.cc:2369] T 9bbfb89126ce4ee49c92cbffa484543e P 574da58b8d344a59b3948d30570aed1f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:53:38.832253 13218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:38.825941 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.195:37887 (local address 127.26.206.194:36053)
0808 14:53:38.826144 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0808 14:53:38.826151 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:53:38.826413 (+ 262us) server_negotiation.cc:407] Connection header received
0808 14:53:38.826631 (+ 218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:53:38.826635 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:53:38.826713 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:53:38.826792 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:53:38.827300 (+ 508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:38.828262 (+ 962us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:38.830257 (+ 1995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:38.831344 (+ 1087us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:38.831489 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:53:38.831583 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0808 14:53:38.831880 (+ 297us) server_negotiation.cc:299] Negotiation successful
0808 14:53:38.832001 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260808 14:53:38.832353 13202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:38.825938 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.194:36053 (local address 127.26.206.195:37887)
0808 14:53:38.826264 (+ 326us) negotiation.cc:107] Waiting for socket to connect
0808 14:53:38.826302 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 14:53:38.826463 (+ 161us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:53:38.826842 (+ 379us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:53:38.826848 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:53:38.826951 (+ 103us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:53:38.827117 (+ 166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:53:38.827125 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:53:38.828476 (+ 1351us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:53:38.828484 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:53:38.830049 (+ 1565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:53:38.830062 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:53:38.831508 (+ 1446us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:53:38.831514 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:53:38.831716 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:53:38.831740 (+ 24us) client_negotiation.cc:769] Sending connection context
0808 14:53:38.831854 (+ 114us) client_negotiation.cc:240] Negotiation successful
0808 14:53:38.831992 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":209,"mutex_wait_us":2,"spinlock_wait_cycles":34688}
I20260808 14:53:38.832794 13215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:38.826007 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.195:38381 (local address 127.26.206.193:42847)
0808 14:53:38.826228 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0808 14:53:38.826236 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:53:38.826871 (+ 635us) server_negotiation.cc:407] Connection header received
0808 14:53:38.827012 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:53:38.827017 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:53:38.827092 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:53:38.827200 (+ 108us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:53:38.827873 (+ 673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:38.828633 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:38.830552 (+ 1919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:38.831795 (+ 1243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:38.831991 (+ 196us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:53:38.832072 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0808 14:53:38.832390 (+ 318us) server_negotiation.cc:299] Negotiation successful
0808 14:53:38.832523 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260808 14:53:38.832940 13229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:38.825991 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.193:42847 (local address 127.26.206.195:38381)
0808 14:53:38.826742 (+ 751us) negotiation.cc:107] Waiting for socket to connect
0808 14:53:38.826754 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 14:53:38.826887 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:53:38.827231 (+ 344us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:53:38.827237 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:53:38.827263 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:53:38.827665 (+ 402us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:53:38.827678 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:53:38.828797 (+ 1119us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:53:38.828803 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:53:38.830368 (+ 1565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:53:38.830384 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:53:38.832019 (+ 1635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:53:38.832026 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:53:38.832208 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:53:38.832234 (+ 26us) client_negotiation.cc:769] Sending connection context
0808 14:53:38.832365 (+ 131us) client_negotiation.cc:240] Negotiation successful
0808 14:53:38.832494 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":643,"mutex_wait_us":45,"thread_start_us":416,"threads_started":1}
I20260808 14:53:38.833487 12999 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bbfb89126ce4ee49c92cbffa484543e" candidate_uuid: "46283576054b4c8396f1ceb328b1c2c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7756a98e892e47e48747ae56f59a0f18" is_pre_election: true
I20260808 14:53:38.834057 12999 raft_consensus.cc:2454] T 9bbfb89126ce4ee49c92cbffa484543e P 7756a98e892e47e48747ae56f59a0f18 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46283576054b4c8396f1ceb328b1c2c5 in term 0.
I20260808 14:53:38.834177 12851 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bbfb89126ce4ee49c92cbffa484543e" candidate_uuid: "46283576054b4c8396f1ceb328b1c2c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "574da58b8d344a59b3948d30570aed1f" is_pre_election: true
I20260808 14:53:38.834805 13074 leader_election.cc:302] T 9bbfb89126ce4ee49c92cbffa484543e P 46283576054b4c8396f1ceb328b1c2c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46283576054b4c8396f1ceb328b1c2c5, 7756a98e892e47e48747ae56f59a0f18; no voters:
I20260808 14:53:38.834802 12851 raft_consensus.cc:2454] T 9bbfb89126ce4ee49c92cbffa484543e P 574da58b8d344a59b3948d30570aed1f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46283576054b4c8396f1ceb328b1c2c5 in term 0.
I20260808 14:53:38.835188 13227 raft_consensus.cc:2781] T 9bbfb89126ce4ee49c92cbffa484543e P 46283576054b4c8396f1ceb328b1c2c5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:53:38.835390 13227 raft_consensus.cc:482] T 9bbfb89126ce4ee49c92cbffa484543e P 46283576054b4c8396f1ceb328b1c2c5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:53:38.835526 13227 raft_consensus.cc:3037] T 9bbfb89126ce4ee49c92cbffa484543e P 46283576054b4c8396f1ceb328b1c2c5 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:53:38.837958 13227 raft_consensus.cc:504] T 9bbfb89126ce4ee49c92cbffa484543e P 46283576054b4c8396f1ceb328b1c2c5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "574da58b8d344a59b3948d30570aed1f" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 42847 } } peers { permanent_uuid: "46283576054b4c8396f1ceb328b1c2c5" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 35273 } } peers { permanent_uuid: "7756a98e892e47e48747ae56f59a0f18" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 36053 } }
I20260808 14:53:38.838673 13227 leader_election.cc:288] T 9bbfb89126ce4ee49c92cbffa484543e P 46283576054b4c8396f1ceb328b1c2c5 [CANDIDATE]: Term 1 election: Requested vote from peers 574da58b8d344a59b3948d30570aed1f (127.26.206.193:42847), 7756a98e892e47e48747ae56f59a0f18 (127.26.206.194:36053)
I20260808 14:53:38.839039 12851 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bbfb89126ce4ee49c92cbffa484543e" candidate_uuid: "46283576054b4c8396f1ceb328b1c2c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "574da58b8d344a59b3948d30570aed1f"
I20260808 14:53:38.839212 12999 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bbfb89126ce4ee49c92cbffa484543e" candidate_uuid: "46283576054b4c8396f1ceb328b1c2c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7756a98e892e47e48747ae56f59a0f18"
I20260808 14:53:38.839267 12851 raft_consensus.cc:3037] T 9bbfb89126ce4ee49c92cbffa484543e P 574da58b8d344a59b3948d30570aed1f [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:53:38.839442 12999 raft_consensus.cc:3037] T 9bbfb89126ce4ee49c92cbffa484543e P 7756a98e892e47e48747ae56f59a0f18 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:53:38.842764 12851 raft_consensus.cc:2454] T 9bbfb89126ce4ee49c92cbffa484543e P 574da58b8d344a59b3948d30570aed1f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46283576054b4c8396f1ceb328b1c2c5 in term 1.
I20260808 14:53:38.842909 12999 raft_consensus.cc:2454] T 9bbfb89126ce4ee49c92cbffa484543e P 7756a98e892e47e48747ae56f59a0f18 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46283576054b4c8396f1ceb328b1c2c5 in term 1.
I20260808 14:53:38.843225 13076 leader_election.cc:302] T 9bbfb89126ce4ee49c92cbffa484543e P 46283576054b4c8396f1ceb328b1c2c5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46283576054b4c8396f1ceb328b1c2c5, 574da58b8d344a59b3948d30570aed1f; no voters:
I20260808 14:53:38.843605 13227 raft_consensus.cc:2781] T 9bbfb89126ce4ee49c92cbffa484543e P 46283576054b4c8396f1ceb328b1c2c5 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:53:38.844099 13227 raft_consensus.cc:686] T 9bbfb89126ce4ee49c92cbffa484543e P 46283576054b4c8396f1ceb328b1c2c5 [term 1 LEADER]: Becoming Leader. State: Replica: 46283576054b4c8396f1ceb328b1c2c5, State: Running, Role: LEADER
I20260808 14:53:38.844594 13227 consensus_queue.cc:237] T 9bbfb89126ce4ee49c92cbffa484543e P 46283576054b4c8396f1ceb328b1c2c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "574da58b8d344a59b3948d30570aed1f" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 42847 } } peers { permanent_uuid: "46283576054b4c8396f1ceb328b1c2c5" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 35273 } } peers { permanent_uuid: "7756a98e892e47e48747ae56f59a0f18" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 36053 } }
I20260808 14:53:38.849418 12686 catalog_manager.cc:5495] T 9bbfb89126ce4ee49c92cbffa484543e P 46283576054b4c8396f1ceb328b1c2c5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 46283576054b4c8396f1ceb328b1c2c5 (127.26.206.195). New cstate: current_term: 1 leader_uuid: "46283576054b4c8396f1ceb328b1c2c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "574da58b8d344a59b3948d30570aed1f" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 42847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46283576054b4c8396f1ceb328b1c2c5" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7756a98e892e47e48747ae56f59a0f18" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 36053 } health_report { overall_health: UNKNOWN } } }
W20260808 14:53:38.866248 13051 tablet.cc:2369] T 9bbfb89126ce4ee49c92cbffa484543e P 7756a98e892e47e48747ae56f59a0f18: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:53:38.867379 13216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:38.861730 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35936 (local address 127.26.206.195:35273)
0808 14:53:38.861914 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0808 14:53:38.861918 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:53:38.862021 (+ 103us) server_negotiation.cc:407] Connection header received
0808 14:53:38.862178 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:53:38.862181 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:53:38.862257 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:53:38.862377 (+ 120us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:53:38.862746 (+ 369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:38.863826 (+ 1080us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:38.865236 (+ 1410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:38.865632 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:38.865720 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:53:38.866262 (+ 542us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:53:38.866790 (+ 528us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:53:38.866948 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0808 14:53:38.867036 (+ 88us) server_negotiation.cc:299] Negotiation successful
0808 14:53:38.867114 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260808 14:53:38.875418 12999 raft_consensus.cc:1261] T 9bbfb89126ce4ee49c92cbffa484543e P 7756a98e892e47e48747ae56f59a0f18 [term 1 FOLLOWER]: Refusing update from remote peer 46283576054b4c8396f1ceb328b1c2c5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:53:38.875418 12851 raft_consensus.cc:1261] T 9bbfb89126ce4ee49c92cbffa484543e P 574da58b8d344a59b3948d30570aed1f [term 1 FOLLOWER]: Refusing update from remote peer 46283576054b4c8396f1ceb328b1c2c5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:53:38.876487 13231 consensus_queue.cc:1035] T 9bbfb89126ce4ee49c92cbffa484543e P 46283576054b4c8396f1ceb328b1c2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "574da58b8d344a59b3948d30570aed1f" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 42847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:53:38.876873 13227 consensus_queue.cc:1035] T 9bbfb89126ce4ee49c92cbffa484543e P 46283576054b4c8396f1ceb328b1c2c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7756a98e892e47e48747ae56f59a0f18" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 36053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:53:38.891896 13234 mvcc.cc:205] Tried to move back new op lower bound from 7316278554102591488 to 7316278553991086080. Current Snapshot: MvccSnapshot[applied={T|T < 7316278554102591488}]
I20260808 14:53:38.896821 13235 mvcc.cc:205] Tried to move back new op lower bound from 7316278554102591488 to 7316278553991086080. Current Snapshot: MvccSnapshot[applied={T|T < 7316278554102591488}]
I20260808 14:53:38.905120 12686 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33166:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:53:38.905396 12686 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33166:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:53:38.908888 12686 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2211e587c1c44266be6a99f6db814787: Sending DeleteTablet for 3 replicas of tablet 9bbfb89126ce4ee49c92cbffa484543e
I20260808 14:53:38.910188 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 12760
I20260808 14:53:38.910076 12827 tablet_service.cc:1514] Processing DeleteTablet for tablet 9bbfb89126ce4ee49c92cbffa484543e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:53:38 UTC) from {username='kudu', principal='kudu/127.26.206.254@KRBTEST.COM'} at 127.0.0.1:51208
I20260808 14:53:38.910352 13124 tablet_service.cc:1514] Processing DeleteTablet for tablet 9bbfb89126ce4ee49c92cbffa484543e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:53:38 UTC) from {username='kudu', principal='kudu/127.26.206.254@KRBTEST.COM'} at 127.0.0.1:35930
I20260808 14:53:38.910363 12978 tablet_service.cc:1514] Processing DeleteTablet for tablet 9bbfb89126ce4ee49c92cbffa484543e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:53:38 UTC) from {username='kudu', principal='kudu/127.26.206.254@KRBTEST.COM'} at 127.0.0.1:49698
I20260808 14:53:38.922958 13244 tablet_replica.cc:330] T 9bbfb89126ce4ee49c92cbffa484543e P 46283576054b4c8396f1ceb328b1c2c5: stopping tablet replica
I20260808 14:53:38.924376 13244 raft_consensus.cc:2229] T 9bbfb89126ce4ee49c92cbffa484543e P 46283576054b4c8396f1ceb328b1c2c5 [term 1 LEADER]: Raft consensus shutting down.
I20260808 14:53:38.925976 13244 raft_consensus.cc:2258] T 9bbfb89126ce4ee49c92cbffa484543e P 46283576054b4c8396f1ceb328b1c2c5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:53:38.929705 13244 ts_tablet_manager.cc:1905] T 9bbfb89126ce4ee49c92cbffa484543e P 46283576054b4c8396f1ceb328b1c2c5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:53:38.930879 13243 tablet_replica.cc:330] T 9bbfb89126ce4ee49c92cbffa484543e P 574da58b8d344a59b3948d30570aed1f: stopping tablet replica
I20260808 14:53:38.931708 13245 tablet_replica.cc:330] T 9bbfb89126ce4ee49c92cbffa484543e P 7756a98e892e47e48747ae56f59a0f18: stopping tablet replica
I20260808 14:53:38.932264 13243 raft_consensus.cc:2229] T 9bbfb89126ce4ee49c92cbffa484543e P 574da58b8d344a59b3948d30570aed1f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:53:38.932780 13245 raft_consensus.cc:2229] T 9bbfb89126ce4ee49c92cbffa484543e P 7756a98e892e47e48747ae56f59a0f18 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:53:38.933290 13245 raft_consensus.cc:2258] T 9bbfb89126ce4ee49c92cbffa484543e P 7756a98e892e47e48747ae56f59a0f18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:53:38.933959 13243 raft_consensus.cc:2258] T 9bbfb89126ce4ee49c92cbffa484543e P 574da58b8d344a59b3948d30570aed1f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:53:38.936244 13243 ts_tablet_manager.cc:1905] T 9bbfb89126ce4ee49c92cbffa484543e P 574da58b8d344a59b3948d30570aed1f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:53:38.938829 13244 ts_tablet_manager.cc:1918] T 9bbfb89126ce4ee49c92cbffa484543e P 46283576054b4c8396f1ceb328b1c2c5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:53:38.939013 13244 log.cc:1196] T 9bbfb89126ce4ee49c92cbffa484543e P 46283576054b4c8396f1ceb328b1c2c5: Deleting WAL directory at /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-2/wal/wals/9bbfb89126ce4ee49c92cbffa484543e
I20260808 14:53:38.939625 13244 ts_tablet_manager.cc:1939] T 9bbfb89126ce4ee49c92cbffa484543e P 46283576054b4c8396f1ceb328b1c2c5: Deleting consensus metadata
I20260808 14:53:38.940335 13245 ts_tablet_manager.cc:1905] T 9bbfb89126ce4ee49c92cbffa484543e P 7756a98e892e47e48747ae56f59a0f18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:53:38.941452 12670 catalog_manager.cc:4841] TS 46283576054b4c8396f1ceb328b1c2c5 (127.26.206.195:35273): tablet 9bbfb89126ce4ee49c92cbffa484543e (table test-table [id=85214c7772064ffaa94a58b93cf0f98c]) successfully deleted
Aug 08 14:53:38 dist-test-slave-6k22 krb5kdc[12635](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200816, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.206.193@KRBTEST.COM
I20260808 14:53:38.946069 13243 ts_tablet_manager.cc:1918] T 9bbfb89126ce4ee49c92cbffa484543e P 574da58b8d344a59b3948d30570aed1f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:53:38.946228 13243 log.cc:1196] T 9bbfb89126ce4ee49c92cbffa484543e P 574da58b8d344a59b3948d30570aed1f: Deleting WAL directory at /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-0/wal/wals/9bbfb89126ce4ee49c92cbffa484543e
I20260808 14:53:38.946763 13243 ts_tablet_manager.cc:1939] T 9bbfb89126ce4ee49c92cbffa484543e P 574da58b8d344a59b3948d30570aed1f: Deleting consensus metadata
I20260808 14:53:38.947808 13245 ts_tablet_manager.cc:1918] T 9bbfb89126ce4ee49c92cbffa484543e P 7756a98e892e47e48747ae56f59a0f18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:53:38.947959 13245 log.cc:1196] T 9bbfb89126ce4ee49c92cbffa484543e P 7756a98e892e47e48747ae56f59a0f18: Deleting WAL directory at /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-1/wal/wals/9bbfb89126ce4ee49c92cbffa484543e
I20260808 14:53:38.948521 13245 ts_tablet_manager.cc:1939] T 9bbfb89126ce4ee49c92cbffa484543e P 7756a98e892e47e48747ae56f59a0f18: Deleting consensus metadata
I20260808 14:53:38.948688 12672 catalog_manager.cc:4841] TS 574da58b8d344a59b3948d30570aed1f (127.26.206.193:42847): tablet 9bbfb89126ce4ee49c92cbffa484543e (table test-table [id=85214c7772064ffaa94a58b93cf0f98c]) successfully deleted
I20260808 14:53:38.949852 12670 catalog_manager.cc:4841] TS 7756a98e892e47e48747ae56f59a0f18 (127.26.206.194:36053): tablet 9bbfb89126ce4ee49c92cbffa484543e (table test-table [id=85214c7772064ffaa94a58b93cf0f98c]) successfully deleted
I20260808 14:53:38.953410 13215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:38.911051 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51218 (local address 127.26.206.193:42847)
0808 14:53:38.911234 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0808 14:53:38.911241 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:53:38.932978 (+ 21737us) server_negotiation.cc:407] Connection header received
0808 14:53:38.933250 (+ 272us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:53:38.933256 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:53:38.933339 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:53:38.933453 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:53:38.935461 (+ 2008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:38.936624 (+ 1163us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:38.938092 (+ 1468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:38.938788 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:38.938921 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:53:38.945263 (+ 6342us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:53:38.945278 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:53:38.945295 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:53:38.945339 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:53:38.950079 (+ 4740us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:53:38.950968 (+ 889us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:53:38.950977 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:53:38.950981 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:53:38.951138 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:53:38.951529 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:53:38.951535 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:53:38.951538 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:53:38.952058 (+ 520us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:53:38.952369 (+ 311us) server_negotiation.cc:1035] Waiting for connection context
0808 14:53:38.952744 (+ 375us) server_negotiation.cc:299] Negotiation successful
0808 14:53:38.952979 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260808 14:53:38.954197 12896 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:53:39.067073 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 12760
I20260808 14:53:39.096406 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 12907
Aug 08 14:53:39 dist-test-slave-6k22 krb5kdc[12635](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200816, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.206.194@KRBTEST.COM
I20260808 14:53:39.113204 13218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:39.097264 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49710 (local address 127.26.206.194:36053)
0808 14:53:39.097439 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0808 14:53:39.097445 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:53:39.097527 (+ 82us) server_negotiation.cc:407] Connection header received
0808 14:53:39.097739 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:53:39.097744 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:53:39.097831 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:53:39.097942 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:53:39.099232 (+ 1290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:39.100065 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:39.101487 (+ 1422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:39.101891 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:39.102029 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:53:39.106470 (+ 4441us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:53:39.106488 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:53:39.106507 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:53:39.106549 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:53:39.110108 (+ 3559us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:53:39.110764 (+ 656us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:53:39.110774 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:53:39.110778 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:53:39.110932 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:53:39.111288 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:53:39.111294 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:53:39.111298 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:53:39.111829 (+ 531us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:53:39.112154 (+ 325us) server_negotiation.cc:1035] Waiting for connection context
0808 14:53:39.112588 (+ 434us) server_negotiation.cc:299] Negotiation successful
0808 14:53:39.112803 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260808 14:53:39.113921 13045 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:53:39.208700 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 12907
I20260808 14:53:39.231148 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 13056
Aug 08 14:53:39 dist-test-slave-6k22 krb5kdc[12635](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200816, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.206.195@KRBTEST.COM
I20260808 14:53:39.250659 13216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:53:39.232155 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35952 (local address 127.26.206.195:35273)
0808 14:53:39.232358 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0808 14:53:39.232365 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:53:39.232391 (+ 26us) server_negotiation.cc:407] Connection header received
0808 14:53:39.232598 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:53:39.232606 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:53:39.232709 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:53:39.232841 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:53:39.234339 (+ 1498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:39.235620 (+ 1281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:39.237015 (+ 1395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:53:39.237710 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:53:39.237838 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:53:39.243283 (+ 5445us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:53:39.243297 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:53:39.243317 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:53:39.243357 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:53:39.247388 (+ 4031us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:53:39.248223 (+ 835us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:53:39.248243 (+ 20us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:53:39.248247 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:53:39.248456 (+ 209us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:53:39.248906 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:53:39.248913 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:53:39.248917 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:53:39.249408 (+ 491us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:53:39.249746 (+ 338us) server_negotiation.cc:1035] Waiting for connection context
0808 14:53:39.249985 (+ 239us) server_negotiation.cc:299] Negotiation successful
0808 14:53:39.250209 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260808 14:53:39.251435 13194 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:53:39.374804 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 13056
I20260808 14:53:39.397521 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 12652
I20260808 14:53:39.398751 12722 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:53:39.508599 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 12652
I20260808 14:53:59.534157 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.206.254:36303
--webserver_interface=127.26.206.254
--webserver_port=37771
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.254.keytab
--principal=kudu/127.26.206.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.206.212:36399
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.206.254:36303
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:53:59.869604 13252 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:53:59.869973 13252 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:53:59.870139 13252 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:53:59.877200 13252 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260808 14:53:59.877334 13252 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260808 14:53:59.877436 13252 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260808 14:53:59.877529 13252 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:53:59.877609 13252 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:53:59.877712 13252 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:53:59.877797 13252 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:53:59.877888 13252 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:53:59.887507 13252 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:36399
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.26.206.254:36303
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.254.keytab
--principal=kudu/127.26.206.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.206.254:36303
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.206.254
--webserver_port=37771
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:53:59.888783 13252 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:53:59.890033 13252 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:53:59.914831 13261 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:53:59.914892 13264 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:53:59.914872 13262 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:53:59.915593 13252 server_base.cc:1034] running on GCE node
I20260808 14:53:59.916802 13252 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:53:59.918371 13252 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:53:59.919693 13252 hybrid_clock.cc:648] HybridClock initialized: now 1786200839919627 us; error 60 us; skew 500 ppm
I20260808 14:53:59.920084 13252 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:53:59 dist-test-slave-6k22 krb5kdc[12635](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200839, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:53:59.936100 13252 init.cc:377] Logged in from keytab as kudu/127.26.206.254@KRBTEST.COM (short username kudu)
I20260808 14:53:59.937783 13252 webserver.cc:460] Webserver started at http://127.26.206.254:37771/ using document root <none> and password file <none>
I20260808 14:53:59.938647 13252 fs_manager.cc:359] Metadata directory not provided
I20260808 14:53:59.938802 13252 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:53:59.945153 13252 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.001s sys 0.004s
I20260808 14:53:59.948128 13271 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:53:59.949514 13252 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 14:53:59.949708 13252 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/master-0/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/master-0/wal
uuid: "2211e587c1c44266be6a99f6db814787"
format_stamp: "Formatted at 2026-08-08 14:53:36 on dist-test-slave-6k22"
server_key: "fc866055898221106e04ef19453febe9"
server_key_iv: "7b1e1461341348ed7294e1755b32f607"
server_key_version: "encryptionkey@0"
I20260808 14:53:59.950791 13252 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:53:59.972748 13252 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:53:59.976946 13252 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:53:59.977304 13252 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:53:59.997162 13252 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.254:36303
I20260808 14:53:59.997195 13326 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.254:36303 every 8 connection(s)
I20260808 14:53:59.998836 13252 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
I20260808 14:54:00.003908 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 13252
I20260808 14:54:00.005004 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.206.193:42847
--local_ip_for_outbound_sockets=127.26.206.193
--tserver_master_addrs=127.26.206.254:36303
--webserver_port=36641
--webserver_interface=127.26.206.193
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.193.keytab
--principal=kudu/127.26.206.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.206.212:36399
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 14:54:00.006971 13327 sys_catalog.cc:263] Verifying existing consensus state
I20260808 14:54:00.012287 13327 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2211e587c1c44266be6a99f6db814787: Bootstrap starting.
I20260808 14:54:00.034034 13327 log.cc:824] T 00000000000000000000000000000000 P 2211e587c1c44266be6a99f6db814787: Log is configured to *not* fsync() on all Append() calls
I20260808 14:54:00.046360 13327 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2211e587c1c44266be6a99f6db814787: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 14:54:00.046917 13327 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2211e587c1c44266be6a99f6db814787: Bootstrap complete.
I20260808 14:54:00.056917 13327 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2211e587c1c44266be6a99f6db814787 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2211e587c1c44266be6a99f6db814787" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 36303 } }
I20260808 14:54:00.057752 13327 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2211e587c1c44266be6a99f6db814787 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2211e587c1c44266be6a99f6db814787, State: Initialized, Role: FOLLOWER
I20260808 14:54:00.058472 13327 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2211e587c1c44266be6a99f6db814787 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2211e587c1c44266be6a99f6db814787" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 36303 } }
I20260808 14:54:00.058741 13327 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2211e587c1c44266be6a99f6db814787 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:54:00.058876 13327 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2211e587c1c44266be6a99f6db814787 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:54:00.059069 13327 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2211e587c1c44266be6a99f6db814787 [term 1 FOLLOWER]: Advancing to term 2
I20260808 14:54:00.062887 13327 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2211e587c1c44266be6a99f6db814787 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2211e587c1c44266be6a99f6db814787" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 36303 } }
I20260808 14:54:00.063403 13327 leader_election.cc:302] T 00000000000000000000000000000000 P 2211e587c1c44266be6a99f6db814787 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2211e587c1c44266be6a99f6db814787; no voters:
I20260808 14:54:00.064150 13327 leader_election.cc:288] T 00000000000000000000000000000000 P 2211e587c1c44266be6a99f6db814787 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260808 14:54:00.064297 13333 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2211e587c1c44266be6a99f6db814787 [term 2 FOLLOWER]: Leader election won for term 2
I20260808 14:54:00.065788 13333 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2211e587c1c44266be6a99f6db814787 [term 2 LEADER]: Becoming Leader. State: Replica: 2211e587c1c44266be6a99f6db814787, State: Running, Role: LEADER
I20260808 14:54:00.066313 13333 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2211e587c1c44266be6a99f6db814787 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2211e587c1c44266be6a99f6db814787" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 36303 } }
I20260808 14:54:00.066581 13327 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2211e587c1c44266be6a99f6db814787 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:54:00.068856 13336 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2211e587c1c44266be6a99f6db814787 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2211e587c1c44266be6a99f6db814787. Latest consensus state: current_term: 2 leader_uuid: "2211e587c1c44266be6a99f6db814787" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2211e587c1c44266be6a99f6db814787" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 36303 } } }
I20260808 14:54:00.069247 13336 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2211e587c1c44266be6a99f6db814787 [sys.catalog]: This master's current role is: LEADER
I20260808 14:54:00.069682 13335 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2211e587c1c44266be6a99f6db814787 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "2211e587c1c44266be6a99f6db814787" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2211e587c1c44266be6a99f6db814787" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 36303 } } }
I20260808 14:54:00.069975 13335 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2211e587c1c44266be6a99f6db814787 [sys.catalog]: This master's current role is: LEADER
I20260808 14:54:00.079994 13340 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:54:00.089949 13340 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:54:00.091466 13340 catalog_manager.cc:1259] Loaded cluster ID: e74b98014925407387ddd1325de18488
I20260808 14:54:00.091624 13340 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:54:00.095640 13340 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:54:00.097209 13340 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 2211e587c1c44266be6a99f6db814787: Loaded TSK: 0
I20260808 14:54:00.178584 13340 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2211e587c1c44266be6a99f6db814787: Generated new TSK 1
I20260808 14:54:00.179008 13340 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 14:54:00.454375 13331 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:54:00.454691 13331 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:54:00.454826 13331 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:54:00.466197 13331 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:54:00.466346 13331 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:54:00.466517 13331 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.206.193
I20260808 14:54:00.482643 13331 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:36399
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.193.keytab
--principal=kudu/127.26.206.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.206.193:42847
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.206.193
--webserver_port=36641
--tserver_master_addrs=127.26.206.254:36303
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.206.193
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:54:00.484254 13331 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:54:00.485958 13331 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:54:00.508175 13358 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:54:00.508466 13359 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:54:00.512861 13331 server_base.cc:1034] running on GCE node
W20260808 14:54:00.513643 13361 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:54:00.514482 13331 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:54:00.515746 13331 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:54:00.517002 13331 hybrid_clock.cc:648] HybridClock initialized: now 1786200840516944 us; error 46 us; skew 500 ppm
I20260808 14:54:00.517374 13331 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:54:00 dist-test-slave-6k22 krb5kdc[12635](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200840, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:54:00.521742 13331 init.cc:377] Logged in from keytab as kudu/127.26.206.193@KRBTEST.COM (short username kudu)
I20260808 14:54:00.528795 13331 webserver.cc:460] Webserver started at http://127.26.206.193:36641/ using document root <none> and password file <none>
I20260808 14:54:00.529736 13331 fs_manager.cc:359] Metadata directory not provided
I20260808 14:54:00.529899 13331 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:54:00.537547 13331 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.003s sys 0.001s
I20260808 14:54:00.541220 13368 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:54:00.542956 13331 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260808 14:54:00.543121 13331 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-0/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-0/wal
uuid: "574da58b8d344a59b3948d30570aed1f"
format_stamp: "Formatted at 2026-08-08 14:53:37 on dist-test-slave-6k22"
server_key: "c317065575b8cc521f210c52419bce58"
server_key_iv: "0a8e0c1a9e80b8d068e8487e255aa77d"
server_key_version: "encryptionkey@0"
I20260808 14:54:00.544481 13331 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:54:00.569360 13331 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:54:00.575064 13331 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:54:00.575371 13331 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:54:00.576629 13331 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:54:00.578428 13331 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:54:00.578570 13331 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:54:00.578688 13331 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:54:00.578770 13331 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:54:00.618616 13331 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.193:42847
I20260808 14:54:00.618678 13490 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.193:42847 every 8 connection(s)
I20260808 14:54:00.620532 13331 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-0/data/info.pb
I20260808 14:54:00.629223 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 13331
I20260808 14:54:00.630064 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.206.194:36053
--local_ip_for_outbound_sockets=127.26.206.194
--tserver_master_addrs=127.26.206.254:36303
--webserver_port=35861
--webserver_interface=127.26.206.194
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.194.keytab
--principal=kudu/127.26.206.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.206.212:36399
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 14:54:00 dist-test-slave-6k22 krb5kdc[12635](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200840, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.193@KRBTEST.COM for kudu/127.26.206.254@KRBTEST.COM
I20260808 14:54:00.645812 13493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:00.623635 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.193:40481 (local address 127.26.206.254:36303)
0808 14:54:00.624323 (+ 688us) server_negotiation.cc:206] Beginning negotiation
0808 14:54:00.624333 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 14:54:00.625103 (+ 770us) server_negotiation.cc:407] Connection header received
0808 14:54:00.627484 (+ 2381us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:54:00.627500 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:54:00.627910 (+ 410us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:54:00.628307 (+ 397us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:54:00.629991 (+ 1684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:00.631410 (+ 1419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:00.633030 (+ 1620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:00.633702 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:00.633922 (+ 220us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:00.637497 (+ 3575us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:54:00.637504 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:54:00.637518 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:54:00.637554 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:54:00.640841 (+ 3287us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:54:00.641626 (+ 785us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:54:00.641633 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:54:00.641638 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:54:00.641806 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:54:00.642305 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:54:00.642309 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:54:00.642317 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:54:00.643007 (+ 690us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:54:00.643239 (+ 232us) server_negotiation.cc:1035] Waiting for connection context
0808 14:54:00.644272 (+ 1033us) server_negotiation.cc:299] Negotiation successful
0808 14:54:00.644744 (+ 472us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":494,"thread_start_us":333,"threads_started":1}
I20260808 14:54:00.645979 13494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:00.623997 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:36303 (local address 127.26.206.193:40481)
0808 14:54:00.624831 (+ 834us) negotiation.cc:107] Waiting for socket to connect
0808 14:54:00.624874 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 14:54:00.626694 (+ 1820us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:54:00.628462 (+ 1768us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:54:00.628481 (+ 19us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:54:00.629164 (+ 683us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:54:00.629785 (+ 621us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:54:00.629803 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:54:00.631629 (+ 1826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:54:00.631633 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:54:00.632881 (+ 1248us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:54:00.632893 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:54:00.633955 (+ 1062us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:54:00.633962 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:54:00.634252 (+ 290us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:00.634935 (+ 683us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:54:00.634957 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:54:00.637201 (+ 2244us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:54:00.641025 (+ 3824us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:54:00.641033 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:54:00.641047 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:54:00.641474 (+ 427us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:54:00.641966 (+ 492us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:54:00.641971 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:54:00.641974 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:54:00.642173 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:54:00.643196 (+ 1023us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:54:00.643206 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:54:00.643659 (+ 453us) client_negotiation.cc:769] Sending connection context
0808 14:54:00.643994 (+ 335us) client_negotiation.cc:240] Negotiation successful
0808 14:54:00.644567 (+ 573us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":581,"thread_start_us":398,"threads_started":1}
I20260808 14:54:00.649823 13491 heartbeater.cc:347] Connected to a master server at 127.26.206.254:36303
I20260808 14:54:00.650188 13491 heartbeater.cc:464] Registering TS with master...
I20260808 14:54:00.651067 13491 heartbeater.cc:511] Master 127.26.206.254:36303 requested a full tablet report, sending...
I20260808 14:54:00.653756 13290 ts_manager.cc:194] Registered new tserver with Master: 574da58b8d344a59b3948d30570aed1f (127.26.206.193:42847)
I20260808 14:54:00.656010 13290 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.206.193@KRBTEST.COM'} at 127.26.206.193:40481
W20260808 14:54:00.972486 13495 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:54:00.972785 13495 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:54:00.972963 13495 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:54:00.980170 13495 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:54:00.980309 13495 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:54:00.980495 13495 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.206.194
I20260808 14:54:00.989900 13495 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:36399
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.194.keytab
--principal=kudu/127.26.206.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.206.194:36053
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.206.194
--webserver_port=35861
--tserver_master_addrs=127.26.206.254:36303
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.206.194
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:54:00.991151 13495 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:54:00.992463 13495 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:54:01.006067 13501 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:54:01.006158 13500 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:54:01.006824 13503 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:54:01.008922 13495 server_base.cc:1034] running on GCE node
I20260808 14:54:01.009596 13495 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:54:01.010628 13495 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:54:01.011869 13495 hybrid_clock.cc:648] HybridClock initialized: now 1786200841011809 us; error 47 us; skew 500 ppm
I20260808 14:54:01.012234 13495 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:54:01 dist-test-slave-6k22 krb5kdc[12635](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200841, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:54:01.016222 13495 init.cc:377] Logged in from keytab as kudu/127.26.206.194@KRBTEST.COM (short username kudu)
I20260808 14:54:01.017802 13495 webserver.cc:460] Webserver started at http://127.26.206.194:35861/ using document root <none> and password file <none>
I20260808 14:54:01.018482 13495 fs_manager.cc:359] Metadata directory not provided
I20260808 14:54:01.018626 13495 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:54:01.024053 13495 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.001s
I20260808 14:54:01.026710 13510 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:54:01.028141 13495 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 14:54:01.028311 13495 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-1/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-1/wal
uuid: "7756a98e892e47e48747ae56f59a0f18"
format_stamp: "Formatted at 2026-08-08 14:53:38 on dist-test-slave-6k22"
server_key: "321066ae9e0ab22a5fb571ce6ae33065"
server_key_iv: "e15868717a4ae6b560b88356de9ee4b1"
server_key_version: "encryptionkey@0"
I20260808 14:54:01.029279 13495 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:54:01.056329 13495 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:54:01.060797 13495 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:54:01.061115 13495 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:54:01.062152 13495 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:54:01.063491 13495 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:54:01.063639 13495 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260808 14:54:01.063776 13495 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:54:01.063865 13495 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:54:01.098078 13495 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.194:36053
I20260808 14:54:01.098160 13628 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.194:36053 every 8 connection(s)
I20260808 14:54:01.099512 13495 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-1/data/info.pb
I20260808 14:54:01.104882 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 13495
I20260808 14:54:01.105542 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.206.195:35273
--local_ip_for_outbound_sockets=127.26.206.195
--tserver_master_addrs=127.26.206.254:36303
--webserver_port=42867
--webserver_interface=127.26.206.195
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.195.keytab
--principal=kudu/127.26.206.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.206.212:36399
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 14:54:01 dist-test-slave-6k22 krb5kdc[12635](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200841, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.194@KRBTEST.COM for kudu/127.26.206.254@KRBTEST.COM
I20260808 14:54:01.119801 13493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:01.102145 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.194:51431 (local address 127.26.206.254:36303)
0808 14:54:01.102331 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0808 14:54:01.102336 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:54:01.103405 (+ 1069us) server_negotiation.cc:407] Connection header received
0808 14:54:01.105404 (+ 1999us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:54:01.105410 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:54:01.105514 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:54:01.105626 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:54:01.107055 (+ 1429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:01.107853 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:01.109375 (+ 1522us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:01.109836 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:01.109986 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:01.113641 (+ 3655us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:54:01.113646 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:54:01.113649 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:54:01.113681 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:54:01.116396 (+ 2715us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:54:01.117301 (+ 905us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:54:01.117305 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:54:01.117307 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:54:01.117430 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:54:01.117929 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:54:01.117932 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:54:01.117934 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:54:01.118204 (+ 270us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:54:01.118321 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0808 14:54:01.119227 (+ 906us) server_negotiation.cc:299] Negotiation successful
0808 14:54:01.119428 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260808 14:54:01.121222 13631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:01.102571 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:36303 (local address 127.26.206.194:51431)
0808 14:54:01.103232 (+ 661us) negotiation.cc:107] Waiting for socket to connect
0808 14:54:01.103285 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0808 14:54:01.105135 (+ 1850us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:54:01.105865 (+ 730us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:54:01.105873 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:54:01.106362 (+ 489us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:54:01.106878 (+ 516us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:54:01.106906 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:54:01.108015 (+ 1109us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:54:01.108027 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:54:01.109222 (+ 1195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:54:01.109233 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:54:01.110082 (+ 849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:54:01.110089 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:54:01.110338 (+ 249us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:01.111230 (+ 892us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:54:01.111251 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:54:01.113424 (+ 2173us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:54:01.116539 (+ 3115us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:54:01.116548 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:54:01.116562 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:54:01.117155 (+ 593us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:54:01.117545 (+ 390us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:54:01.117551 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:54:01.117556 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:54:01.117806 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:54:01.118350 (+ 544us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:54:01.118360 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:54:01.118793 (+ 433us) client_negotiation.cc:769] Sending connection context
0808 14:54:01.119098 (+ 305us) client_negotiation.cc:240] Negotiation successful
0808 14:54:01.119685 (+ 587us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":440,"thread_start_us":260,"threads_started":1}
I20260808 14:54:01.122773 13629 heartbeater.cc:347] Connected to a master server at 127.26.206.254:36303
I20260808 14:54:01.123070 13629 heartbeater.cc:464] Registering TS with master...
I20260808 14:54:01.123811 13629 heartbeater.cc:511] Master 127.26.206.254:36303 requested a full tablet report, sending...
I20260808 14:54:01.125635 13290 ts_manager.cc:194] Registered new tserver with Master: 7756a98e892e47e48747ae56f59a0f18 (127.26.206.194:36053)
I20260808 14:54:01.126871 13290 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.206.194@KRBTEST.COM'} at 127.26.206.194:51431
W20260808 14:54:01.442003 13632 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:54:01.442271 13632 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:54:01.442365 13632 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:54:01.449491 13632 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:54:01.449595 13632 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:54:01.449714 13632 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.206.195
I20260808 14:54:01.459128 13632 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:36399
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.195.keytab
--principal=kudu/127.26.206.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.206.195:35273
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.206.195
--webserver_port=42867
--tserver_master_addrs=127.26.206.254:36303
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.206.195
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:54:01.460424 13632 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:54:01.461659 13632 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:54:01.475113 13639 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:54:01.475374 13638 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:54:01.475358 13642 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:54:01.476194 13632 server_base.cc:1034] running on GCE node
I20260808 14:54:01.476852 13632 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:54:01.477874 13632 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:54:01.479112 13632 hybrid_clock.cc:648] HybridClock initialized: now 1786200841479058 us; error 46 us; skew 500 ppm
I20260808 14:54:01.479434 13632 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:54:01 dist-test-slave-6k22 krb5kdc[12635](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200841, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:54:01.482708 13632 init.cc:377] Logged in from keytab as kudu/127.26.206.195@KRBTEST.COM (short username kudu)
I20260808 14:54:01.484320 13632 webserver.cc:460] Webserver started at http://127.26.206.195:42867/ using document root <none> and password file <none>
I20260808 14:54:01.485029 13632 fs_manager.cc:359] Metadata directory not provided
I20260808 14:54:01.485205 13632 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:54:01.490787 13632 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 14:54:01.493580 13650 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:54:01.494938 13632 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260808 14:54:01.495119 13632 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-2/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-2/wal
uuid: "46283576054b4c8396f1ceb328b1c2c5"
format_stamp: "Formatted at 2026-08-08 14:53:38 on dist-test-slave-6k22"
server_key: "5823795a141ba1cae57b057b91012e95"
server_key_iv: "171a337823b6e8fd6e4943f99a67744f"
server_key_version: "encryptionkey@0"
I20260808 14:54:01.496165 13632 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:54:01.533303 13632 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:54:01.537792 13632 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:54:01.538060 13632 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:54:01.539033 13632 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:54:01.540519 13632 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:54:01.540640 13632 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:54:01.540783 13632 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:54:01.540874 13632 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:54:01.574559 13632 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.195:35273
I20260808 14:54:01.574667 13770 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.195:35273 every 8 connection(s)
I20260808 14:54:01.576077 13632 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-2/data/info.pb
I20260808 14:54:01.578774 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 13632
Aug 08 14:54:01 dist-test-slave-6k22 krb5kdc[12635](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200841, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.195@KRBTEST.COM for kudu/127.26.206.254@KRBTEST.COM
I20260808 14:54:01.595749 13775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:01.580113 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52130 (local address 127.26.206.254:36303)
0808 14:54:01.580910 (+ 797us) server_negotiation.cc:206] Beginning negotiation
0808 14:54:01.580914 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:54:01.580929 (+ 15us) server_negotiation.cc:407] Connection header received
0808 14:54:01.580980 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:54:01.580983 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:54:01.581040 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:54:01.581130 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:54:01.583306 (+ 2176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:01.584096 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:01.585686 (+ 1590us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:01.586075 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:01.586165 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:01.589571 (+ 3406us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:54:01.589575 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:54:01.589578 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:54:01.589606 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:54:01.593073 (+ 3467us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:54:01.593720 (+ 647us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:54:01.593726 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:54:01.593729 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:54:01.593905 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:54:01.594258 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:54:01.594263 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:54:01.594266 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:54:01.594638 (+ 372us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:54:01.594939 (+ 301us) server_negotiation.cc:1035] Waiting for connection context
0808 14:54:01.595133 (+ 194us) server_negotiation.cc:299] Negotiation successful
0808 14:54:01.595382 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":703,"thread_start_us":599,"threads_started":1}
I20260808 14:54:01.598436 13493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:01.578736 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.195:49981 (local address 127.26.206.254:36303)
0808 14:54:01.578966 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0808 14:54:01.578972 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:54:01.580336 (+ 1364us) server_negotiation.cc:407] Connection header received
0808 14:54:01.582939 (+ 2603us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:54:01.582942 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:54:01.582989 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:54:01.583062 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:54:01.584796 (+ 1734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:01.585458 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:01.587486 (+ 2028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:01.587918 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:01.588013 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:01.591593 (+ 3580us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:54:01.591601 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:54:01.591607 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:54:01.591654 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:54:01.595262 (+ 3608us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:54:01.596074 (+ 812us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:54:01.596085 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:54:01.596089 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:54:01.596218 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:54:01.596693 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:54:01.596698 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:54:01.596701 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:54:01.596965 (+ 264us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:54:01.597126 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0808 14:54:01.597885 (+ 759us) server_negotiation.cc:299] Negotiation successful
0808 14:54:01.598086 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260808 14:54:01.599231 13773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:01.579230 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:36303 (local address 127.26.206.195:49981)
0808 14:54:01.580132 (+ 902us) negotiation.cc:107] Waiting for socket to connect
0808 14:54:01.580186 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0808 14:54:01.582651 (+ 2465us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:54:01.583359 (+ 708us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:54:01.583367 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:54:01.583911 (+ 544us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:54:01.584619 (+ 708us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:54:01.584643 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:54:01.585610 (+ 967us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:54:01.585618 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:54:01.587330 (+ 1712us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:54:01.587345 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:54:01.588154 (+ 809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:54:01.588164 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:54:01.588481 (+ 317us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:01.589107 (+ 626us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:54:01.589145 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:54:01.591360 (+ 2215us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:54:01.595405 (+ 4045us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:54:01.595414 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:54:01.595430 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:54:01.595959 (+ 529us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:54:01.596331 (+ 372us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:54:01.596337 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:54:01.596340 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:54:01.596584 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:54:01.597120 (+ 536us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:54:01.597127 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:54:01.597496 (+ 369us) client_negotiation.cc:769] Sending connection context
0808 14:54:01.597721 (+ 225us) client_negotiation.cc:240] Negotiation successful
0808 14:54:01.598153 (+ 432us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":588,"thread_start_us":367,"threads_started":1}
I20260808 14:54:01.600703 13771 heartbeater.cc:347] Connected to a master server at 127.26.206.254:36303
I20260808 14:54:01.601075 13771 heartbeater.cc:464] Registering TS with master...
I20260808 14:54:01.601805 13771 heartbeater.cc:511] Master 127.26.206.254:36303 requested a full tablet report, sending...
I20260808 14:54:01.603081 13290 ts_manager.cc:194] Registered new tserver with Master: 46283576054b4c8396f1ceb328b1c2c5 (127.26.206.195:35273)
I20260808 14:54:01.603896 13290 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.206.195@KRBTEST.COM'} at 127.26.206.195:49981
I20260808 14:54:01.610378 27451 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 14:54:01.616735 13493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:01.611425 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52134 (local address 127.26.206.254:36303)
0808 14:54:01.611630 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0808 14:54:01.611634 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:54:01.612052 (+ 418us) server_negotiation.cc:407] Connection header received
0808 14:54:01.612212 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:54:01.612215 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:54:01.612348 (+ 133us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:54:01.612457 (+ 109us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:54:01.612831 (+ 374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:01.613556 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:01.615077 (+ 1521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:01.615447 (+ 370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:01.615532 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:01.616029 (+ 497us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:54:01.616297 (+ 268us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0808 14:54:01.616568 (+ 271us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:52134: token expired
Metrics: {"server-negotiator.queue_time_us":51}
W20260808 14:54:01.616868 13493 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:52134: token expired
W20260808 14:54:01.617502 13203 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.26.206.254:36303)
I20260808 14:54:01.630849 13493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:01.618070 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52146 (local address 127.26.206.254:36303)
0808 14:54:01.618259 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0808 14:54:01.618264 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:54:01.618351 (+ 87us) server_negotiation.cc:407] Connection header received
0808 14:54:01.618495 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:54:01.618499 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:54:01.618563 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:54:01.618662 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:54:01.620126 (+ 1464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:01.621181 (+ 1055us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:01.622727 (+ 1546us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:01.623127 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:01.623273 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:01.625913 (+ 2640us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:54:01.625918 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:54:01.625921 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:54:01.625951 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:54:01.628239 (+ 2288us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:54:01.628911 (+ 672us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:54:01.628917 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:54:01.628921 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:54:01.629047 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:54:01.629424 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:54:01.629430 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:54:01.629433 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:54:01.629731 (+ 298us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:54:01.630000 (+ 269us) server_negotiation.cc:1035] Waiting for connection context
0808 14:54:01.630299 (+ 299us) server_negotiation.cc:299] Negotiation successful
0808 14:54:01.630530 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260808 14:54:01.634286 13290 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52146:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:54:01.641439 13290 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:54:01.660498 13491 heartbeater.cc:503] Master 127.26.206.254:36303 was elected leader, sending a full tablet report...
I20260808 14:54:01.675308 13786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:01.653371 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47950 (local address 127.26.206.193:42847)
0808 14:54:01.665111 (+ 11740us) server_negotiation.cc:206] Beginning negotiation
0808 14:54:01.665122 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 14:54:01.665985 (+ 863us) server_negotiation.cc:407] Connection header received
0808 14:54:01.666092 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:54:01.666100 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:54:01.666387 (+ 287us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:54:01.667834 (+ 1447us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:54:01.668678 (+ 844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:01.670136 (+ 1458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:01.672975 (+ 2839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:01.674136 (+ 1161us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:01.674354 (+ 218us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:01.674527 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0808 14:54:01.674818 (+ 291us) server_negotiation.cc:299] Negotiation successful
0808 14:54:01.674973 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11526,"thread_start_us":11333,"threads_started":1}
I20260808 14:54:01.675398 13784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:01.652968 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.193:42847 (local address 127.0.0.1:47950)
0808 14:54:01.665500 (+ 12532us) negotiation.cc:107] Waiting for socket to connect
0808 14:54:01.665562 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0808 14:54:01.665787 (+ 225us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:54:01.667471 (+ 1684us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:54:01.667478 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:54:01.667509 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:54:01.668443 (+ 934us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:54:01.668456 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:54:01.670293 (+ 1837us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:54:01.670298 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:54:01.672814 (+ 2516us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:54:01.672826 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:54:01.674374 (+ 1548us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:54:01.674381 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:54:01.674573 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:01.674621 (+ 48us) client_negotiation.cc:769] Sending connection context
0808 14:54:01.674755 (+ 134us) client_negotiation.cc:240] Negotiation successful
0808 14:54:01.674951 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12272,"mutex_wait_us":103,"thread_start_us":12187,"threads_started":1}
I20260808 14:54:01.675871 13785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:01.653192 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.195:35273 (local address 127.0.0.1:46174)
0808 14:54:01.666400 (+ 13208us) negotiation.cc:107] Waiting for socket to connect
0808 14:54:01.666420 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 14:54:01.666655 (+ 235us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:54:01.667624 (+ 969us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:54:01.667628 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:54:01.667648 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:54:01.668448 (+ 800us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:54:01.668468 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:54:01.670303 (+ 1835us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:54:01.670310 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:54:01.672769 (+ 2459us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:54:01.672800 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:54:01.674936 (+ 2136us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:54:01.674943 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:54:01.675144 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:01.675183 (+ 39us) client_negotiation.cc:769] Sending connection context
0808 14:54:01.675273 (+ 90us) client_negotiation.cc:240] Negotiation successful
0808 14:54:01.675400 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13044,"mutex_wait_us":178,"thread_start_us":12907,"threads_started":1}
I20260808 14:54:01.676518 13787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:01.653439 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46174 (local address 127.26.206.195:35273)
0808 14:54:01.664802 (+ 11363us) server_negotiation.cc:206] Beginning negotiation
0808 14:54:01.664812 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 14:54:01.666516 (+ 1704us) server_negotiation.cc:407] Connection header received
0808 14:54:01.666845 (+ 329us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:54:01.666853 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:54:01.667123 (+ 270us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:54:01.667317 (+ 194us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:54:01.668725 (+ 1408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:01.670124 (+ 1399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:01.672992 (+ 2868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:01.674413 (+ 1421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:01.674564 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:01.674714 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0808 14:54:01.676104 (+ 1390us) server_negotiation.cc:299] Negotiation successful
0808 14:54:01.676280 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11156,"thread_start_us":11369,"threads_started":1}
I20260808 14:54:01.678989 13788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:01.666537 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.194:36053 (local address 127.0.0.1:57400)
0808 14:54:01.669367 (+ 2830us) negotiation.cc:107] Waiting for socket to connect
0808 14:54:01.669383 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 14:54:01.669493 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:54:01.670031 (+ 538us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:54:01.670036 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:54:01.670063 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:54:01.670533 (+ 470us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:54:01.670546 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:54:01.672718 (+ 2172us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:54:01.672731 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:54:01.675981 (+ 3250us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:54:01.675994 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:54:01.678063 (+ 2069us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:54:01.678068 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:54:01.678181 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:01.678203 (+ 22us) client_negotiation.cc:769] Sending connection context
0808 14:54:01.678329 (+ 126us) client_negotiation.cc:240] Negotiation successful
0808 14:54:01.678504 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2718,"thread_start_us":1649,"threads_started":1}
I20260808 14:54:01.680019 13790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:01.666799 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57400 (local address 127.26.206.194:36053)
0808 14:54:01.667509 (+ 710us) server_negotiation.cc:206] Beginning negotiation
0808 14:54:01.667520 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 14:54:01.669488 (+ 1968us) server_negotiation.cc:407] Connection header received
0808 14:54:01.669630 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:54:01.669639 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:54:01.669844 (+ 205us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:54:01.670012 (+ 168us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:54:01.670753 (+ 741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:01.672526 (+ 1773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:01.676689 (+ 4163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:01.677849 (+ 1160us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:01.678034 (+ 185us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:01.678180 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0808 14:54:01.679506 (+ 1326us) server_negotiation.cc:299] Negotiation successful
0808 14:54:01.679694 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":508,"thread_start_us":360,"threads_started":1}
I20260808 14:54:01.680365 13703 tablet_service.cc:1467] Processing CreateTablet for tablet a869a41788f442cd93582845e6e5bcd3 (DEFAULT_TABLE table=test-table [id=66ff5a6e16c4433dbc966150cf95d941]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:54:01.680758 13421 tablet_service.cc:1467] Processing CreateTablet for tablet a869a41788f442cd93582845e6e5bcd3 (DEFAULT_TABLE table=test-table [id=66ff5a6e16c4433dbc966150cf95d941]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:54:01.681867 13421 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a869a41788f442cd93582845e6e5bcd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:54:01.681941 13703 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a869a41788f442cd93582845e6e5bcd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:54:01.683447 13560 tablet_service.cc:1467] Processing CreateTablet for tablet a869a41788f442cd93582845e6e5bcd3 (DEFAULT_TABLE table=test-table [id=66ff5a6e16c4433dbc966150cf95d941]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:54:01.684764 13560 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a869a41788f442cd93582845e6e5bcd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:54:01.693655 13791 tablet_bootstrap.cc:492] T a869a41788f442cd93582845e6e5bcd3 P 574da58b8d344a59b3948d30570aed1f: Bootstrap starting.
I20260808 14:54:01.696569 13791 tablet_bootstrap.cc:654] T a869a41788f442cd93582845e6e5bcd3 P 574da58b8d344a59b3948d30570aed1f: Neither blocks nor log segments found. Creating new log.
I20260808 14:54:01.698482 13791 log.cc:824] T a869a41788f442cd93582845e6e5bcd3 P 574da58b8d344a59b3948d30570aed1f: Log is configured to *not* fsync() on all Append() calls
I20260808 14:54:01.701435 13791 tablet_bootstrap.cc:492] T a869a41788f442cd93582845e6e5bcd3 P 574da58b8d344a59b3948d30570aed1f: No bootstrap required, opened a new log
I20260808 14:54:01.701694 13791 ts_tablet_manager.cc:1397] T a869a41788f442cd93582845e6e5bcd3 P 574da58b8d344a59b3948d30570aed1f: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.000s
I20260808 14:54:01.703794 13792 tablet_bootstrap.cc:492] T a869a41788f442cd93582845e6e5bcd3 P 46283576054b4c8396f1ceb328b1c2c5: Bootstrap starting.
I20260808 14:54:01.704288 13794 tablet_bootstrap.cc:492] T a869a41788f442cd93582845e6e5bcd3 P 7756a98e892e47e48747ae56f59a0f18: Bootstrap starting.
I20260808 14:54:01.707381 13792 tablet_bootstrap.cc:654] T a869a41788f442cd93582845e6e5bcd3 P 46283576054b4c8396f1ceb328b1c2c5: Neither blocks nor log segments found. Creating new log.
I20260808 14:54:01.707545 13794 tablet_bootstrap.cc:654] T a869a41788f442cd93582845e6e5bcd3 P 7756a98e892e47e48747ae56f59a0f18: Neither blocks nor log segments found. Creating new log.
I20260808 14:54:01.708618 13794 log.cc:824] T a869a41788f442cd93582845e6e5bcd3 P 7756a98e892e47e48747ae56f59a0f18: Log is configured to *not* fsync() on all Append() calls
I20260808 14:54:01.708698 13792 log.cc:824] T a869a41788f442cd93582845e6e5bcd3 P 46283576054b4c8396f1ceb328b1c2c5: Log is configured to *not* fsync() on all Append() calls
I20260808 14:54:01.711503 13792 tablet_bootstrap.cc:492] T a869a41788f442cd93582845e6e5bcd3 P 46283576054b4c8396f1ceb328b1c2c5: No bootstrap required, opened a new log
I20260808 14:54:01.711795 13794 tablet_bootstrap.cc:492] T a869a41788f442cd93582845e6e5bcd3 P 7756a98e892e47e48747ae56f59a0f18: No bootstrap required, opened a new log
I20260808 14:54:01.711815 13792 ts_tablet_manager.cc:1397] T a869a41788f442cd93582845e6e5bcd3 P 46283576054b4c8396f1ceb328b1c2c5: Time spent bootstrapping tablet: real 0.012s user 0.003s sys 0.005s
I20260808 14:54:01.711513 13791 raft_consensus.cc:348] T a869a41788f442cd93582845e6e5bcd3 P 574da58b8d344a59b3948d30570aed1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "574da58b8d344a59b3948d30570aed1f" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 42847 } } peers { permanent_uuid: "46283576054b4c8396f1ceb328b1c2c5" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 35273 } } peers { permanent_uuid: "7756a98e892e47e48747ae56f59a0f18" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 36053 } }
I20260808 14:54:01.712035 13791 raft_consensus.cc:374] T a869a41788f442cd93582845e6e5bcd3 P 574da58b8d344a59b3948d30570aed1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:54:01.712072 13794 ts_tablet_manager.cc:1397] T a869a41788f442cd93582845e6e5bcd3 P 7756a98e892e47e48747ae56f59a0f18: Time spent bootstrapping tablet: real 0.008s user 0.007s sys 0.000s
I20260808 14:54:01.712157 13791 raft_consensus.cc:729] T a869a41788f442cd93582845e6e5bcd3 P 574da58b8d344a59b3948d30570aed1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 574da58b8d344a59b3948d30570aed1f, State: Initialized, Role: FOLLOWER
I20260808 14:54:01.712811 13791 consensus_queue.cc:260] T a869a41788f442cd93582845e6e5bcd3 P 574da58b8d344a59b3948d30570aed1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "574da58b8d344a59b3948d30570aed1f" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 42847 } } peers { permanent_uuid: "46283576054b4c8396f1ceb328b1c2c5" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 35273 } } peers { permanent_uuid: "7756a98e892e47e48747ae56f59a0f18" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 36053 } }
I20260808 14:54:01.714514 13791 ts_tablet_manager.cc:1428] T a869a41788f442cd93582845e6e5bcd3 P 574da58b8d344a59b3948d30570aed1f: Time spent starting tablet: real 0.013s user 0.014s sys 0.000s
I20260808 14:54:01.722165 13794 raft_consensus.cc:348] T a869a41788f442cd93582845e6e5bcd3 P 7756a98e892e47e48747ae56f59a0f18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "574da58b8d344a59b3948d30570aed1f" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 42847 } } peers { permanent_uuid: "46283576054b4c8396f1ceb328b1c2c5" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 35273 } } peers { permanent_uuid: "7756a98e892e47e48747ae56f59a0f18" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 36053 } }
I20260808 14:54:01.722244 13792 raft_consensus.cc:348] T a869a41788f442cd93582845e6e5bcd3 P 46283576054b4c8396f1ceb328b1c2c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "574da58b8d344a59b3948d30570aed1f" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 42847 } } peers { permanent_uuid: "46283576054b4c8396f1ceb328b1c2c5" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 35273 } } peers { permanent_uuid: "7756a98e892e47e48747ae56f59a0f18" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 36053 } }
I20260808 14:54:01.722580 13794 raft_consensus.cc:374] T a869a41788f442cd93582845e6e5bcd3 P 7756a98e892e47e48747ae56f59a0f18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:54:01.722596 13792 raft_consensus.cc:374] T a869a41788f442cd93582845e6e5bcd3 P 46283576054b4c8396f1ceb328b1c2c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:54:01.722707 13794 raft_consensus.cc:729] T a869a41788f442cd93582845e6e5bcd3 P 7756a98e892e47e48747ae56f59a0f18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7756a98e892e47e48747ae56f59a0f18, State: Initialized, Role: FOLLOWER
I20260808 14:54:01.722729 13792 raft_consensus.cc:729] T a869a41788f442cd93582845e6e5bcd3 P 46283576054b4c8396f1ceb328b1c2c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46283576054b4c8396f1ceb328b1c2c5, State: Initialized, Role: FOLLOWER
I20260808 14:54:01.723269 13794 consensus_queue.cc:260] T a869a41788f442cd93582845e6e5bcd3 P 7756a98e892e47e48747ae56f59a0f18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "574da58b8d344a59b3948d30570aed1f" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 42847 } } peers { permanent_uuid: "46283576054b4c8396f1ceb328b1c2c5" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 35273 } } peers { permanent_uuid: "7756a98e892e47e48747ae56f59a0f18" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 36053 } }
I20260808 14:54:01.723378 13792 consensus_queue.cc:260] T a869a41788f442cd93582845e6e5bcd3 P 46283576054b4c8396f1ceb328b1c2c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "574da58b8d344a59b3948d30570aed1f" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 42847 } } peers { permanent_uuid: "46283576054b4c8396f1ceb328b1c2c5" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 35273 } } peers { permanent_uuid: "7756a98e892e47e48747ae56f59a0f18" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 36053 } }
I20260808 14:54:01.724498 13629 heartbeater.cc:503] Master 127.26.206.254:36303 was elected leader, sending a full tablet report...
I20260808 14:54:01.724529 13771 heartbeater.cc:503] Master 127.26.206.254:36303 was elected leader, sending a full tablet report...
I20260808 14:54:01.725211 13792 ts_tablet_manager.cc:1428] T a869a41788f442cd93582845e6e5bcd3 P 46283576054b4c8396f1ceb328b1c2c5: Time spent starting tablet: real 0.013s user 0.010s sys 0.002s
I20260808 14:54:01.725241 13794 ts_tablet_manager.cc:1428] T a869a41788f442cd93582845e6e5bcd3 P 7756a98e892e47e48747ae56f59a0f18: Time spent starting tablet: real 0.013s user 0.012s sys 0.000s
I20260808 14:54:01.727634 13798 raft_consensus.cc:482] T a869a41788f442cd93582845e6e5bcd3 P 7756a98e892e47e48747ae56f59a0f18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:54:01.727941 13798 raft_consensus.cc:504] T a869a41788f442cd93582845e6e5bcd3 P 7756a98e892e47e48747ae56f59a0f18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "574da58b8d344a59b3948d30570aed1f" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 42847 } } peers { permanent_uuid: "46283576054b4c8396f1ceb328b1c2c5" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 35273 } } peers { permanent_uuid: "7756a98e892e47e48747ae56f59a0f18" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 36053 } }
I20260808 14:54:01.731518 13798 leader_election.cc:288] T a869a41788f442cd93582845e6e5bcd3 P 7756a98e892e47e48747ae56f59a0f18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 574da58b8d344a59b3948d30570aed1f (127.26.206.193:42847), 46283576054b4c8396f1ceb328b1c2c5 (127.26.206.195:35273)
I20260808 14:54:01.737260 13786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:01.730339 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.194:46951 (local address 127.26.206.193:42847)
0808 14:54:01.730585 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0808 14:54:01.730593 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:54:01.731611 (+ 1018us) server_negotiation.cc:407] Connection header received
0808 14:54:01.731862 (+ 251us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:54:01.731868 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:54:01.731940 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:54:01.732015 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:54:01.732966 (+ 951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:01.733847 (+ 881us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:01.735575 (+ 1728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:01.736334 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:01.736510 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:01.736590 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0808 14:54:01.736884 (+ 294us) server_negotiation.cc:299] Negotiation successful
0808 14:54:01.737007 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260808 14:54:01.737321 13801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:01.730206 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.193:42847 (local address 127.26.206.194:46951)
0808 14:54:01.731454 (+ 1248us) negotiation.cc:107] Waiting for socket to connect
0808 14:54:01.731475 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 14:54:01.731662 (+ 187us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:54:01.732270 (+ 608us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:54:01.732273 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:54:01.732346 (+ 73us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:54:01.732831 (+ 485us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:54:01.732846 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:54:01.734010 (+ 1164us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:54:01.734015 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:54:01.735403 (+ 1388us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:54:01.735415 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:54:01.736575 (+ 1160us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:54:01.736582 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:54:01.736720 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:01.736744 (+ 24us) client_negotiation.cc:769] Sending connection context
0808 14:54:01.736846 (+ 102us) client_negotiation.cc:240] Negotiation successful
0808 14:54:01.736966 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1124,"thread_start_us":931,"threads_started":1}
I20260808 14:54:01.738314 13443 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a869a41788f442cd93582845e6e5bcd3" candidate_uuid: "7756a98e892e47e48747ae56f59a0f18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "574da58b8d344a59b3948d30570aed1f" is_pre_election: true
I20260808 14:54:01.738790 13787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:01.731956 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.194:34527 (local address 127.26.206.195:35273)
0808 14:54:01.732162 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0808 14:54:01.732170 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:54:01.733025 (+ 855us) server_negotiation.cc:407] Connection header received
0808 14:54:01.733246 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:54:01.733251 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:54:01.733323 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:54:01.733421 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:54:01.734119 (+ 698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:01.734902 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:01.736769 (+ 1867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:01.737817 (+ 1048us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:01.738000 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:01.738078 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0808 14:54:01.738379 (+ 301us) server_negotiation.cc:299] Negotiation successful
0808 14:54:01.738531 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260808 14:54:01.738927 13802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:01.731997 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.195:35273 (local address 127.26.206.194:34527)
0808 14:54:01.732920 (+ 923us) negotiation.cc:107] Waiting for socket to connect
0808 14:54:01.732936 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 14:54:01.733085 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:54:01.733437 (+ 352us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:54:01.733441 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:54:01.733468 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:54:01.733907 (+ 439us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:54:01.733920 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:54:01.735043 (+ 1123us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:54:01.735050 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:54:01.736607 (+ 1557us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:54:01.736619 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:54:01.738037 (+ 1418us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:54:01.738044 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:54:01.738217 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:01.738242 (+ 25us) client_negotiation.cc:769] Sending connection context
0808 14:54:01.738353 (+ 111us) client_negotiation.cc:240] Negotiation successful
0808 14:54:01.738503 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":748,"mutex_wait_us":2,"thread_start_us":504,"threads_started":1}
I20260808 14:54:01.738819 13443 raft_consensus.cc:2454] T a869a41788f442cd93582845e6e5bcd3 P 574da58b8d344a59b3948d30570aed1f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7756a98e892e47e48747ae56f59a0f18 in term 0.
I20260808 14:54:01.739502 13514 leader_election.cc:302] T a869a41788f442cd93582845e6e5bcd3 P 7756a98e892e47e48747ae56f59a0f18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 574da58b8d344a59b3948d30570aed1f, 7756a98e892e47e48747ae56f59a0f18; no voters:
I20260808 14:54:01.739923 13798 raft_consensus.cc:2781] T a869a41788f442cd93582845e6e5bcd3 P 7756a98e892e47e48747ae56f59a0f18 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:54:01.740042 13798 raft_consensus.cc:482] T a869a41788f442cd93582845e6e5bcd3 P 7756a98e892e47e48747ae56f59a0f18 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:54:01.740154 13798 raft_consensus.cc:3037] T a869a41788f442cd93582845e6e5bcd3 P 7756a98e892e47e48747ae56f59a0f18 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:54:01.739959 13723 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a869a41788f442cd93582845e6e5bcd3" candidate_uuid: "7756a98e892e47e48747ae56f59a0f18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46283576054b4c8396f1ceb328b1c2c5" is_pre_election: true
I20260808 14:54:01.740444 13723 raft_consensus.cc:2454] T a869a41788f442cd93582845e6e5bcd3 P 46283576054b4c8396f1ceb328b1c2c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7756a98e892e47e48747ae56f59a0f18 in term 0.
I20260808 14:54:01.742417 13798 raft_consensus.cc:504] T a869a41788f442cd93582845e6e5bcd3 P 7756a98e892e47e48747ae56f59a0f18 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "574da58b8d344a59b3948d30570aed1f" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 42847 } } peers { permanent_uuid: "46283576054b4c8396f1ceb328b1c2c5" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 35273 } } peers { permanent_uuid: "7756a98e892e47e48747ae56f59a0f18" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 36053 } }
I20260808 14:54:01.743036 13798 leader_election.cc:288] T a869a41788f442cd93582845e6e5bcd3 P 7756a98e892e47e48747ae56f59a0f18 [CANDIDATE]: Term 1 election: Requested vote from peers 574da58b8d344a59b3948d30570aed1f (127.26.206.193:42847), 46283576054b4c8396f1ceb328b1c2c5 (127.26.206.195:35273)
I20260808 14:54:01.743438 13443 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a869a41788f442cd93582845e6e5bcd3" candidate_uuid: "7756a98e892e47e48747ae56f59a0f18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "574da58b8d344a59b3948d30570aed1f"
I20260808 14:54:01.743610 13723 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a869a41788f442cd93582845e6e5bcd3" candidate_uuid: "7756a98e892e47e48747ae56f59a0f18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46283576054b4c8396f1ceb328b1c2c5"
I20260808 14:54:01.743678 13443 raft_consensus.cc:3037] T a869a41788f442cd93582845e6e5bcd3 P 574da58b8d344a59b3948d30570aed1f [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:54:01.743818 13723 raft_consensus.cc:3037] T a869a41788f442cd93582845e6e5bcd3 P 46283576054b4c8396f1ceb328b1c2c5 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:54:01.746970 13443 raft_consensus.cc:2454] T a869a41788f442cd93582845e6e5bcd3 P 574da58b8d344a59b3948d30570aed1f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7756a98e892e47e48747ae56f59a0f18 in term 1.
I20260808 14:54:01.746970 13723 raft_consensus.cc:2454] T a869a41788f442cd93582845e6e5bcd3 P 46283576054b4c8396f1ceb328b1c2c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7756a98e892e47e48747ae56f59a0f18 in term 1.
I20260808 14:54:01.747380 13512 leader_election.cc:302] T a869a41788f442cd93582845e6e5bcd3 P 7756a98e892e47e48747ae56f59a0f18 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46283576054b4c8396f1ceb328b1c2c5, 7756a98e892e47e48747ae56f59a0f18; no voters:
I20260808 14:54:01.747694 13798 raft_consensus.cc:2781] T a869a41788f442cd93582845e6e5bcd3 P 7756a98e892e47e48747ae56f59a0f18 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:54:01.748224 13798 raft_consensus.cc:686] T a869a41788f442cd93582845e6e5bcd3 P 7756a98e892e47e48747ae56f59a0f18 [term 1 LEADER]: Becoming Leader. State: Replica: 7756a98e892e47e48747ae56f59a0f18, State: Running, Role: LEADER
I20260808 14:54:01.748824 13798 consensus_queue.cc:237] T a869a41788f442cd93582845e6e5bcd3 P 7756a98e892e47e48747ae56f59a0f18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "574da58b8d344a59b3948d30570aed1f" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 42847 } } peers { permanent_uuid: "46283576054b4c8396f1ceb328b1c2c5" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 35273 } } peers { permanent_uuid: "7756a98e892e47e48747ae56f59a0f18" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 36053 } }
I20260808 14:54:01.753629 13289 catalog_manager.cc:5495] T a869a41788f442cd93582845e6e5bcd3 P 7756a98e892e47e48747ae56f59a0f18 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7756a98e892e47e48747ae56f59a0f18 (127.26.206.194). New cstate: current_term: 1 leader_uuid: "7756a98e892e47e48747ae56f59a0f18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "574da58b8d344a59b3948d30570aed1f" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 42847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46283576054b4c8396f1ceb328b1c2c5" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7756a98e892e47e48747ae56f59a0f18" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 36053 } health_report { overall_health: HEALTHY } } }
I20260808 14:54:01.777371 13790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:01.772403 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57406 (local address 127.26.206.194:36053)
0808 14:54:01.772568 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0808 14:54:01.772573 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:54:01.772590 (+ 17us) server_negotiation.cc:407] Connection header received
0808 14:54:01.772773 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:54:01.772786 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:54:01.772869 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:54:01.772989 (+ 120us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:54:01.773302 (+ 313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:01.773989 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:01.775300 (+ 1311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:01.775756 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:01.775851 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:01.776276 (+ 425us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:54:01.776754 (+ 478us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:54:01.776890 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0808 14:54:01.776983 (+ 93us) server_negotiation.cc:299] Negotiation successful
0808 14:54:01.777057 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260808 14:54:01.785351 13723 raft_consensus.cc:1261] T a869a41788f442cd93582845e6e5bcd3 P 46283576054b4c8396f1ceb328b1c2c5 [term 1 FOLLOWER]: Refusing update from remote peer 7756a98e892e47e48747ae56f59a0f18: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:54:01.785394 13443 raft_consensus.cc:1261] T a869a41788f442cd93582845e6e5bcd3 P 574da58b8d344a59b3948d30570aed1f [term 1 FOLLOWER]: Refusing update from remote peer 7756a98e892e47e48747ae56f59a0f18: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:54:01.786387 13798 consensus_queue.cc:1035] T a869a41788f442cd93582845e6e5bcd3 P 7756a98e892e47e48747ae56f59a0f18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46283576054b4c8396f1ceb328b1c2c5" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:54:01.786689 13803 consensus_queue.cc:1035] T a869a41788f442cd93582845e6e5bcd3 P 7756a98e892e47e48747ae56f59a0f18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "574da58b8d344a59b3948d30570aed1f" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 42847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:54:01.797272 13806 mvcc.cc:205] Tried to move back new op lower bound from 7316278647942774784 to 7316278647807717376. Current Snapshot: MvccSnapshot[applied={T|T < 7316278647942774784}]
I20260808 14:54:01.812043 13290 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52146:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:54:01.812347 13290 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52146:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:54:01.816004 13290 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2211e587c1c44266be6a99f6db814787: Sending DeleteTablet for 3 replicas of tablet a869a41788f442cd93582845e6e5bcd3
I20260808 14:54:01.817355 13703 tablet_service.cc:1514] Processing DeleteTablet for tablet a869a41788f442cd93582845e6e5bcd3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:54:01 UTC) from {username='kudu', principal='kudu/127.26.206.254@KRBTEST.COM'} at 127.0.0.1:46174
I20260808 14:54:01.817315 13421 tablet_service.cc:1514] Processing DeleteTablet for tablet a869a41788f442cd93582845e6e5bcd3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:54:01 UTC) from {username='kudu', principal='kudu/127.26.206.254@KRBTEST.COM'} at 127.0.0.1:47950
I20260808 14:54:01.817516 13560 tablet_service.cc:1514] Processing DeleteTablet for tablet a869a41788f442cd93582845e6e5bcd3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:54:01 UTC) from {username='kudu', principal='kudu/127.26.206.254@KRBTEST.COM'} at 127.0.0.1:57400
I20260808 14:54:01.818616 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 13331
I20260808 14:54:01.832860 13818 tablet_replica.cc:330] T a869a41788f442cd93582845e6e5bcd3 P 574da58b8d344a59b3948d30570aed1f: stopping tablet replica
I20260808 14:54:01.833576 13819 tablet_replica.cc:330] T a869a41788f442cd93582845e6e5bcd3 P 7756a98e892e47e48747ae56f59a0f18: stopping tablet replica
I20260808 14:54:01.834296 13819 raft_consensus.cc:2229] T a869a41788f442cd93582845e6e5bcd3 P 7756a98e892e47e48747ae56f59a0f18 [term 1 LEADER]: Raft consensus shutting down.
I20260808 14:54:01.834900 13818 raft_consensus.cc:2229] T a869a41788f442cd93582845e6e5bcd3 P 574da58b8d344a59b3948d30570aed1f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:54:01.835788 13819 raft_consensus.cc:2258] T a869a41788f442cd93582845e6e5bcd3 P 7756a98e892e47e48747ae56f59a0f18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:54:01.836475 13818 raft_consensus.cc:2258] T a869a41788f442cd93582845e6e5bcd3 P 574da58b8d344a59b3948d30570aed1f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:54:01.839512 13818 ts_tablet_manager.cc:1905] T a869a41788f442cd93582845e6e5bcd3 P 574da58b8d344a59b3948d30570aed1f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:54:01.845151 13786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:01.819891 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47964 (local address 127.26.206.193:42847)
0808 14:54:01.820129 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0808 14:54:01.820138 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:54:01.820163 (+ 25us) server_negotiation.cc:407] Connection header received
0808 14:54:01.820235 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:54:01.820243 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:54:01.820342 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:54:01.820477 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:54:01.823376 (+ 2899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:01.825013 (+ 1637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:01.827928 (+ 2915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:01.828602 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:01.828738 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:01.835894 (+ 7156us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:54:01.835913 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:54:01.835934 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:54:01.835991 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:54:01.840314 (+ 4323us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:54:01.841347 (+ 1033us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:54:01.841364 (+ 17us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:54:01.841368 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:54:01.841530 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:54:01.842061 (+ 531us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:54:01.842069 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:54:01.842078 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:54:01.842615 (+ 537us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:54:01.842957 (+ 342us) server_negotiation.cc:1035] Waiting for connection context
0808 14:54:01.844388 (+ 1431us) server_negotiation.cc:299] Negotiation successful
0808 14:54:01.844674 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260808 14:54:01.845957 13486 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:54:01.847218 13819 ts_tablet_manager.cc:1905] T a869a41788f442cd93582845e6e5bcd3 P 7756a98e892e47e48747ae56f59a0f18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:54:01.856082 13817 tablet_replica.cc:330] T a869a41788f442cd93582845e6e5bcd3 P 46283576054b4c8396f1ceb328b1c2c5: stopping tablet replica
I20260808 14:54:01.856756 13817 raft_consensus.cc:2229] T a869a41788f442cd93582845e6e5bcd3 P 46283576054b4c8396f1ceb328b1c2c5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:54:01.857300 13817 raft_consensus.cc:2258] T a869a41788f442cd93582845e6e5bcd3 P 46283576054b4c8396f1ceb328b1c2c5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:54:01.858385 13819 ts_tablet_manager.cc:1918] T a869a41788f442cd93582845e6e5bcd3 P 7756a98e892e47e48747ae56f59a0f18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:54:01.858678 13819 log.cc:1196] T a869a41788f442cd93582845e6e5bcd3 P 7756a98e892e47e48747ae56f59a0f18: Deleting WAL directory at /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-1/wal/wals/a869a41788f442cd93582845e6e5bcd3
I20260808 14:54:01.859474 13819 ts_tablet_manager.cc:1939] T a869a41788f442cd93582845e6e5bcd3 P 7756a98e892e47e48747ae56f59a0f18: Deleting consensus metadata
I20260808 14:54:01.859810 13817 ts_tablet_manager.cc:1905] T a869a41788f442cd93582845e6e5bcd3 P 46283576054b4c8396f1ceb328b1c2c5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:54:01.861719 13275 catalog_manager.cc:4841] TS 7756a98e892e47e48747ae56f59a0f18 (127.26.206.194:36053): tablet a869a41788f442cd93582845e6e5bcd3 (table test-table [id=66ff5a6e16c4433dbc966150cf95d941]) successfully deleted
I20260808 14:54:01.865536 13817 ts_tablet_manager.cc:1918] T a869a41788f442cd93582845e6e5bcd3 P 46283576054b4c8396f1ceb328b1c2c5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:54:01.865741 13817 log.cc:1196] T a869a41788f442cd93582845e6e5bcd3 P 46283576054b4c8396f1ceb328b1c2c5: Deleting WAL directory at /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-2/wal/wals/a869a41788f442cd93582845e6e5bcd3
I20260808 14:54:01.866240 13817 ts_tablet_manager.cc:1939] T a869a41788f442cd93582845e6e5bcd3 P 46283576054b4c8396f1ceb328b1c2c5: Deleting consensus metadata
I20260808 14:54:01.867933 13275 catalog_manager.cc:4841] TS 46283576054b4c8396f1ceb328b1c2c5 (127.26.206.195:35273): tablet a869a41788f442cd93582845e6e5bcd3 (table test-table [id=66ff5a6e16c4433dbc966150cf95d941]) successfully deleted
I20260808 14:54:01.996507 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 13331
I20260808 14:54:02.019404 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 13495
W20260808 14:54:02.019322 13277 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.26.206.193:42847 (error 108)
I20260808 14:54:02.022189 13788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:02.021617 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.193:42847 (local address 127.0.0.1:47978)
0808 14:54:02.021883 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0808 14:54:02.021998 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.193:42847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":139}
W20260808 14:54:02.022487 13277 catalog_manager.cc:4584] TS 574da58b8d344a59b3948d30570aed1f (127.26.206.193:42847): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet a869a41788f442cd93582845e6e5bcd3: Network error: Client connection negotiation failed: client connection to 127.26.206.193:42847: connect: Connection refused (error 111)
I20260808 14:54:02.035974 13790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:02.021269 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57416 (local address 127.26.206.194:36053)
0808 14:54:02.021451 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0808 14:54:02.021458 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:54:02.021479 (+ 21us) server_negotiation.cc:407] Connection header received
0808 14:54:02.021549 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:54:02.021554 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:54:02.021650 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:54:02.021754 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:54:02.023749 (+ 1995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:02.024579 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:02.025906 (+ 1327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:02.026329 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:02.026495 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:02.029297 (+ 2802us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:54:02.029310 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:54:02.029324 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:54:02.029362 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:54:02.032605 (+ 3243us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:54:02.033396 (+ 791us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:54:02.033403 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:54:02.033406 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:54:02.033609 (+ 203us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:54:02.034055 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:54:02.034061 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:54:02.034065 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:54:02.034517 (+ 452us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:54:02.034884 (+ 367us) server_negotiation.cc:1035] Waiting for connection context
0808 14:54:02.035102 (+ 218us) server_negotiation.cc:299] Negotiation successful
0808 14:54:02.035341 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260808 14:54:02.036689 13624 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:54:02.076380 13788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:02.075785 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.193:42847 (local address 127.0.0.1:47986)
0808 14:54:02.076010 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0808 14:54:02.076138 (+ 128us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.193:42847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
I20260808 14:54:02.077453 13788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:02.077041 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.193:42847 (local address 127.0.0.1:48002)
0808 14:54:02.077220 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0808 14:54:02.077312 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.193:42847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
I20260808 14:54:02.137866 13788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:02.137306 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.193:42847 (local address 127.0.0.1:48008)
0808 14:54:02.137555 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0808 14:54:02.137670 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.193:42847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":77}
I20260808 14:54:02.138926 13788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:02.138556 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.193:42847 (local address 127.0.0.1:48014)
0808 14:54:02.138714 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0808 14:54:02.138799 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.193:42847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260808 14:54:02.155989 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 13495
I20260808 14:54:02.180837 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 13632
I20260808 14:54:02.194859 13787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:02.181663 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46176 (local address 127.26.206.195:35273)
0808 14:54:02.181859 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0808 14:54:02.181865 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:54:02.181935 (+ 70us) server_negotiation.cc:407] Connection header received
0808 14:54:02.182158 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:54:02.182168 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:54:02.182233 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:54:02.182346 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:54:02.183863 (+ 1517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:02.184630 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:02.185992 (+ 1362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:02.186508 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:02.186642 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:02.189337 (+ 2695us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:54:02.189351 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:54:02.189367 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:54:02.189402 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:54:02.192121 (+ 2719us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:54:02.192784 (+ 663us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:54:02.192793 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:54:02.192795 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:54:02.192917 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:54:02.193293 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:54:02.193300 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:54:02.193307 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:54:02.193651 (+ 344us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:54:02.193948 (+ 297us) server_negotiation.cc:1035] Waiting for connection context
0808 14:54:02.194319 (+ 371us) server_negotiation.cc:299] Negotiation successful
0808 14:54:02.194549 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260808 14:54:02.195506 13765 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:54:02.219662 13788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:02.219088 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.193:42847 (local address 127.0.0.1:48016)
0808 14:54:02.219307 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0808 14:54:02.219396 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.193:42847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
I20260808 14:54:02.220741 13788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:02.220319 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.193:42847 (local address 127.0.0.1:48028)
0808 14:54:02.220514 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0808 14:54:02.220627 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.193:42847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98}
I20260808 14:54:02.284135 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 13632
I20260808 14:54:02.304157 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 13252
I20260808 14:54:02.305425 13321 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:54:02.422230 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 13252
I20260808 14:54:22.449167 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.206.254:36303
--webserver_interface=127.26.206.254
--webserver_port=37771
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.254.keytab
--principal=kudu/127.26.206.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.206.212:36399
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.206.254:36303
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:54:22.792090 13825 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:54:22.792374 13825 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:54:22.792481 13825 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:54:22.800019 13825 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260808 14:54:22.800115 13825 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260808 14:54:22.800164 13825 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260808 14:54:22.800220 13825 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:54:22.800271 13825 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:54:22.800338 13825 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:54:22.800380 13825 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:54:22.800433 13825 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:54:22.810746 13825 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:36399
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.26.206.254:36303
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.254.keytab
--principal=kudu/127.26.206.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.206.254:36303
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.206.254
--webserver_port=37771
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:54:22.811923 13825 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:54:22.813320 13825 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:54:22.825470 13837 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:54:22.825523 13834 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:54:22.825433 13833 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:54:22.826191 13825 server_base.cc:1034] running on GCE node
I20260808 14:54:22.826937 13825 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:54:22.828323 13825 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:54:22.829542 13825 hybrid_clock.cc:648] HybridClock initialized: now 1786200862829470 us; error 47 us; skew 500 ppm
I20260808 14:54:22.829895 13825 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:54:22 dist-test-slave-6k22 krb5kdc[12635](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200862, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:54:22.838634 13825 init.cc:377] Logged in from keytab as kudu/127.26.206.254@KRBTEST.COM (short username kudu)
I20260808 14:54:22.840081 13825 webserver.cc:460] Webserver started at http://127.26.206.254:37771/ using document root <none> and password file <none>
I20260808 14:54:22.840781 13825 fs_manager.cc:359] Metadata directory not provided
I20260808 14:54:22.840900 13825 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:54:22.846216 13825 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20260808 14:54:22.849072 13844 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:54:22.850281 13825 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 14:54:22.850456 13825 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/master-0/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/master-0/wal
uuid: "2211e587c1c44266be6a99f6db814787"
format_stamp: "Formatted at 2026-08-08 14:53:36 on dist-test-slave-6k22"
server_key: "fc866055898221106e04ef19453febe9"
server_key_iv: "7b1e1461341348ed7294e1755b32f607"
server_key_version: "encryptionkey@0"
I20260808 14:54:22.851375 13825 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:54:22.872964 13825 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:54:22.876783 13825 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:54:22.877023 13825 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:54:22.895207 13825 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.254:36303
I20260808 14:54:22.895292 13896 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.254:36303 every 8 connection(s)
I20260808 14:54:22.896734 13825 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
I20260808 14:54:22.900321 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 13825
I20260808 14:54:22.901600 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.206.193:42847
--local_ip_for_outbound_sockets=127.26.206.193
--tserver_master_addrs=127.26.206.254:36303
--webserver_port=36641
--webserver_interface=127.26.206.193
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.193.keytab
--principal=kudu/127.26.206.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.206.212:36399
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 14:54:22.905402 13897 sys_catalog.cc:263] Verifying existing consensus state
I20260808 14:54:22.910797 13897 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2211e587c1c44266be6a99f6db814787: Bootstrap starting.
I20260808 14:54:22.933399 13897 log.cc:824] T 00000000000000000000000000000000 P 2211e587c1c44266be6a99f6db814787: Log is configured to *not* fsync() on all Append() calls
I20260808 14:54:22.951001 13897 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2211e587c1c44266be6a99f6db814787: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 14:54:22.951738 13897 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2211e587c1c44266be6a99f6db814787: Bootstrap complete.
I20260808 14:54:22.961797 13897 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2211e587c1c44266be6a99f6db814787 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2211e587c1c44266be6a99f6db814787" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 36303 } }
I20260808 14:54:22.962760 13897 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2211e587c1c44266be6a99f6db814787 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2211e587c1c44266be6a99f6db814787, State: Initialized, Role: FOLLOWER
I20260808 14:54:22.963438 13897 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2211e587c1c44266be6a99f6db814787 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2211e587c1c44266be6a99f6db814787" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 36303 } }
I20260808 14:54:22.963729 13897 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2211e587c1c44266be6a99f6db814787 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:54:22.964015 13897 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2211e587c1c44266be6a99f6db814787 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:54:22.964244 13897 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2211e587c1c44266be6a99f6db814787 [term 2 FOLLOWER]: Advancing to term 3
I20260808 14:54:22.968187 13897 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2211e587c1c44266be6a99f6db814787 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2211e587c1c44266be6a99f6db814787" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 36303 } }
I20260808 14:54:22.968683 13897 leader_election.cc:302] T 00000000000000000000000000000000 P 2211e587c1c44266be6a99f6db814787 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2211e587c1c44266be6a99f6db814787; no voters:
I20260808 14:54:22.969434 13897 leader_election.cc:288] T 00000000000000000000000000000000 P 2211e587c1c44266be6a99f6db814787 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260808 14:54:22.969576 13901 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2211e587c1c44266be6a99f6db814787 [term 3 FOLLOWER]: Leader election won for term 3
I20260808 14:54:22.970834 13901 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2211e587c1c44266be6a99f6db814787 [term 3 LEADER]: Becoming Leader. State: Replica: 2211e587c1c44266be6a99f6db814787, State: Running, Role: LEADER
I20260808 14:54:22.971364 13901 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2211e587c1c44266be6a99f6db814787 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2211e587c1c44266be6a99f6db814787" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 36303 } }
I20260808 14:54:22.971773 13897 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2211e587c1c44266be6a99f6db814787 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:54:22.973827 13903 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2211e587c1c44266be6a99f6db814787 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2211e587c1c44266be6a99f6db814787. Latest consensus state: current_term: 3 leader_uuid: "2211e587c1c44266be6a99f6db814787" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2211e587c1c44266be6a99f6db814787" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 36303 } } }
I20260808 14:54:22.974200 13903 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2211e587c1c44266be6a99f6db814787 [sys.catalog]: This master's current role is: LEADER
I20260808 14:54:22.982960 13902 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2211e587c1c44266be6a99f6db814787 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "2211e587c1c44266be6a99f6db814787" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2211e587c1c44266be6a99f6db814787" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 36303 } } }
I20260808 14:54:22.983330 13902 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2211e587c1c44266be6a99f6db814787 [sys.catalog]: This master's current role is: LEADER
I20260808 14:54:22.983752 13906 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:54:22.994704 13906 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:54:22.996755 13906 catalog_manager.cc:1259] Loaded cluster ID: e74b98014925407387ddd1325de18488
I20260808 14:54:22.996855 13906 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:54:23.002471 13906 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:54:23.004640 13906 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 2211e587c1c44266be6a99f6db814787: Loaded TSK: 0
I20260808 14:54:23.004818 13906 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 2211e587c1c44266be6a99f6db814787: Loaded TSK: 1
F20260808 14:54:23.006156 13906 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7ff5b37b29ad google::LogMessage::Fail() at ??:0
@ 0x7ff5b37b588a google::LogMessage::SendToLog() at ??:0
I20260808 14:54:23.012351 13923 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
@ 0x7ff5b37b24de google::LogMessage::Flush() at ??:0
@ 0x7ff5b37b3a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7ff5b75167d2 kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7ff5b750573e kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7ff5c91e11c0 kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7ff5c91e0783 kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7ff5c926c2a7 kudu::master::CatalogManager::PrepareForLeadershipTask()::$_10::operator()() at ??:0
@ 0x7ff5c926c0c4 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x7ff5c92b65e9 std::function<>::operator()() at ??:0
@ 0x7ff5c91e4cdd kudu::master::CatalogManager::PrepareForLeadershipTask()::$_6::operator()() at ??:0
@ 0x7ff5c91e2c36 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7ff5c926a610 kudu::master::CatalogManager::ElectedAsLeaderCb()::$_2::operator()() at ??:0
@ 0x7ff5c926a439 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7ff5b63fe345 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7ff5b640191c kudu::ThreadPool::CreateThread()::$_2::operator()() at ??:0
@ 0x7ff5b6401799 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7ff5b63dceaf kudu::Thread::SuperviseThread() at ??:0
@ 0x7ff5b96b66db start_thread at ??:0
@ 0x7ff5b264c61f clone at ??:0
W20260808 14:54:23.355674 13899 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:54:23.355963 13899 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:54:23.356068 13899 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:54:23.363346 13899 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:54:23.363474 13899 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:54:23.363682 13899 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.206.193
I20260808 14:54:23.373682 13899 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:36399
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.193.keytab
--principal=kudu/127.26.206.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.206.193:42847
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.206.193
--webserver_port=36641
--tserver_master_addrs=127.26.206.254:36303
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.206.193
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:54:23.374913 13899 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:54:23.376297 13899 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:54:23.390301 13951 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:54:23.390266 13952 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:54:23.390352 13954 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:54:23.390914 13899 server_base.cc:1034] running on GCE node
I20260808 14:54:23.391614 13899 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:54:23.392551 13899 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:54:23.393754 13899 hybrid_clock.cc:648] HybridClock initialized: now 1786200863393704 us; error 38 us; skew 500 ppm
I20260808 14:54:23.394042 13899 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:54:23 dist-test-slave-6k22 krb5kdc[12635](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200863, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:54:23.397135 13899 init.cc:377] Logged in from keytab as kudu/127.26.206.193@KRBTEST.COM (short username kudu)
I20260808 14:54:23.398633 13899 webserver.cc:460] Webserver started at http://127.26.206.193:36641/ using document root <none> and password file <none>
I20260808 14:54:23.399304 13899 fs_manager.cc:359] Metadata directory not provided
I20260808 14:54:23.399437 13899 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:54:23.404740 13899 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 14:54:23.407630 13962 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:54:23.409011 13899 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260808 14:54:23.409171 13899 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-0/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-0/wal
uuid: "574da58b8d344a59b3948d30570aed1f"
format_stamp: "Formatted at 2026-08-08 14:53:37 on dist-test-slave-6k22"
server_key: "c317065575b8cc521f210c52419bce58"
server_key_iv: "0a8e0c1a9e80b8d068e8487e255aa77d"
server_key_version: "encryptionkey@0"
I20260808 14:54:23.410106 13899 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:54:23.444070 13899 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:54:23.448504 13899 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:54:23.448796 13899 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:54:23.449792 13899 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:54:23.451615 13969 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
W20260808 14:54:23.456856 13969 ts_tablet_manager.cc:1852] T a869a41788f442cd93582845e6e5bcd3 P 574da58b8d344a59b3948d30570aed1f: Tablet Manager startup: Rolling forward tablet deletion of type TABLET_DATA_DELETED
I20260808 14:54:23.457844 13969 ts_tablet_manager.cc:1905] T a869a41788f442cd93582845e6e5bcd3 P 574da58b8d344a59b3948d30570aed1f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:54:23.465076 13969 ts_tablet_manager.cc:1918] T a869a41788f442cd93582845e6e5bcd3 P 574da58b8d344a59b3948d30570aed1f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:54:23.465301 13969 log.cc:1196] T a869a41788f442cd93582845e6e5bcd3 P 574da58b8d344a59b3948d30570aed1f: Deleting WAL directory at /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-0/wal/wals/a869a41788f442cd93582845e6e5bcd3
I20260808 14:54:23.465790 13969 ts_tablet_manager.cc:1939] T a869a41788f442cd93582845e6e5bcd3 P 574da58b8d344a59b3948d30570aed1f: Deleting consensus metadata
I20260808 14:54:23.466164 13899 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 0 live tablets)
I20260808 14:54:23.466312 13899 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.015s user 0.001s sys 0.000s
I20260808 14:54:23.466465 13899 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:54:23.466557 13899 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:54:23.501206 13899 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.193:42847
I20260808 14:54:23.501298 14080 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.193:42847 every 8 connection(s)
I20260808 14:54:23.502529 13899 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-0/data/info.pb
I20260808 14:54:23.505062 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 13899
I20260808 14:54:23.505726 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.206.194:36053
--local_ip_for_outbound_sockets=127.26.206.194
--tserver_master_addrs=127.26.206.254:36303
--webserver_port=35861
--webserver_interface=127.26.206.194
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.194.keytab
--principal=kudu/127.26.206.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.206.212:36399
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 14:54:23.507520 14084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:23.505515 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:36303 (local address 127.26.206.193:40137)
0808 14:54:23.506360 (+ 845us) negotiation.cc:107] Waiting for socket to connect
0808 14:54:23.506653 (+ 293us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:36303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":565,"thread_start_us":359,"threads_started":1}
W20260808 14:54:23.508142 14081 heartbeater.cc:644] Failed to heartbeat to 127.26.206.254:36303 (0 consecutive failures): Network error: Failed to ping master at 127.26.206.254:36303: Client connection negotiation failed: client connection to 127.26.206.254:36303: connect: Connection refused (error 111)
I20260808 14:54:23.508998 14084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:23.508690 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:36303 (local address 127.26.206.193:56191)
0808 14:54:23.508837 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0808 14:54:23.508901 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:36303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260808 14:54:23.509984 14084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:23.509542 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:36303 (local address 127.26.206.193:60059)
0808 14:54:23.509709 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0808 14:54:23.509818 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:36303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260808 14:54:23.510218 14081 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 14:54:23.848788 14085 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:54:23.849066 14085 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:54:23.849186 14085 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:54:23.856387 14085 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:54:23.856520 14085 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:54:23.856709 14085 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.206.194
I20260808 14:54:23.866364 14085 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:36399
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.194.keytab
--principal=kudu/127.26.206.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.206.194:36053
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.206.194
--webserver_port=35861
--tserver_master_addrs=127.26.206.254:36303
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.206.194
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:54:23.867694 14085 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:54:23.869016 14085 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:54:23.882753 14090 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:54:23.882709 14091 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:54:23.883388 14085 server_base.cc:1034] running on GCE node
W20260808 14:54:23.883460 14093 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:54:23.884166 14085 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:54:23.885082 14085 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:54:23.886310 14085 hybrid_clock.cc:648] HybridClock initialized: now 1786200863886261 us; error 47 us; skew 500 ppm
I20260808 14:54:23.886615 14085 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:54:23 dist-test-slave-6k22 krb5kdc[12635](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200863, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:54:23.889750 14085 init.cc:377] Logged in from keytab as kudu/127.26.206.194@KRBTEST.COM (short username kudu)
I20260808 14:54:23.891196 14085 webserver.cc:460] Webserver started at http://127.26.206.194:35861/ using document root <none> and password file <none>
I20260808 14:54:23.891933 14085 fs_manager.cc:359] Metadata directory not provided
I20260808 14:54:23.892072 14085 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:54:23.897257 14085 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20260808 14:54:23.899971 14101 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:54:23.901290 14085 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260808 14:54:23.901461 14085 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-1/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-1/wal
uuid: "7756a98e892e47e48747ae56f59a0f18"
format_stamp: "Formatted at 2026-08-08 14:53:38 on dist-test-slave-6k22"
server_key: "321066ae9e0ab22a5fb571ce6ae33065"
server_key_iv: "e15868717a4ae6b560b88356de9ee4b1"
server_key_version: "encryptionkey@0"
I20260808 14:54:23.902522 14085 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:54:23.929785 14085 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:54:23.934368 14085 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:54:23.934693 14085 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:54:23.935748 14085 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:54:23.937122 14085 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:54:23.937258 14085 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:54:23.937394 14085 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:54:23.937487 14085 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:54:23.973493 14085 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.194:36053
I20260808 14:54:23.973558 14219 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.194:36053 every 8 connection(s)
I20260808 14:54:23.975065 14085 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-1/data/info.pb
I20260808 14:54:23.975764 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 14085
I20260808 14:54:23.976683 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.206.195:35273
--local_ip_for_outbound_sockets=127.26.206.195
--tserver_master_addrs=127.26.206.254:36303
--webserver_port=42867
--webserver_interface=127.26.206.195
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.195.keytab
--principal=kudu/127.26.206.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.206.212:36399
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 14:54:23.980883 14222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:23.978738 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:36303 (local address 127.26.206.194:42771)
0808 14:54:23.979666 (+ 928us) negotiation.cc:107] Waiting for socket to connect
0808 14:54:23.979990 (+ 324us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:36303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":592,"thread_start_us":383,"threads_started":1}
W20260808 14:54:23.981609 14220 heartbeater.cc:644] Failed to heartbeat to 127.26.206.254:36303 (0 consecutive failures): Network error: Failed to ping master at 127.26.206.254:36303: Client connection negotiation failed: client connection to 127.26.206.254:36303: connect: Connection refused (error 111)
I20260808 14:54:23.982481 14222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:23.982159 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:36303 (local address 127.26.206.194:44235)
0808 14:54:23.982302 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0808 14:54:23.982374 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:36303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260808 14:54:23.983457 14222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:23.983107 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:36303 (local address 127.26.206.194:54983)
0808 14:54:23.983258 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0808 14:54:23.983342 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:36303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
W20260808 14:54:23.983705 14220 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 14:54:24.314553 14223 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:54:24.314821 14223 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:54:24.314925 14223 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:54:24.321936 14223 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:54:24.322036 14223 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:54:24.322150 14223 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.206.195
I20260808 14:54:24.331358 14223 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:36399
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.195.keytab
--principal=kudu/127.26.206.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.206.195:35273
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.206.195
--webserver_port=42867
--tserver_master_addrs=127.26.206.254:36303
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.206.195
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:54:24.332581 14223 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:54:24.333819 14223 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:54:24.346480 14228 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:54:24.346503 14229 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:54:24.346441 14231 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:54:24.347270 14223 server_base.cc:1034] running on GCE node
I20260808 14:54:24.347882 14223 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:54:24.348750 14223 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:54:24.349972 14223 hybrid_clock.cc:648] HybridClock initialized: now 1786200864349936 us; error 44 us; skew 500 ppm
I20260808 14:54:24.350289 14223 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:54:24 dist-test-slave-6k22 krb5kdc[12635](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200864, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:54:24.353412 14223 init.cc:377] Logged in from keytab as kudu/127.26.206.195@KRBTEST.COM (short username kudu)
I20260808 14:54:24.354907 14223 webserver.cc:460] Webserver started at http://127.26.206.195:42867/ using document root <none> and password file <none>
I20260808 14:54:24.355625 14223 fs_manager.cc:359] Metadata directory not provided
I20260808 14:54:24.355767 14223 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:54:24.361248 14223 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.001s
I20260808 14:54:24.363802 14239 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:54:24.365074 14223 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260808 14:54:24.365238 14223 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-2/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-2/wal
uuid: "46283576054b4c8396f1ceb328b1c2c5"
format_stamp: "Formatted at 2026-08-08 14:53:38 on dist-test-slave-6k22"
server_key: "5823795a141ba1cae57b057b91012e95"
server_key_iv: "171a337823b6e8fd6e4943f99a67744f"
server_key_version: "encryptionkey@0"
I20260808 14:54:24.366199 14223 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:54:24.395079 14223 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:54:24.399058 14223 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:54:24.399338 14223 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:54:24.400419 14223 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:54:24.401759 14223 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:54:24.401892 14223 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:54:24.402022 14223 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:54:24.402107 14223 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:54:24.433842 14223 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.195:35273
I20260808 14:54:24.433921 14361 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.195:35273 every 8 connection(s)
I20260808 14:54:24.435199 14223 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200577490656-27451-0/minicluster-data/ts-2/data/info.pb
I20260808 14:54:24.436371 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 14223
I20260808 14:54:24.440056 14365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:24.438248 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:36303 (local address 127.26.206.195:52105)
0808 14:54:24.438965 (+ 717us) negotiation.cc:107] Waiting for socket to connect
0808 14:54:24.439185 (+ 220us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:36303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":480,"thread_start_us":296,"threads_started":1}
W20260808 14:54:24.440670 14362 heartbeater.cc:644] Failed to heartbeat to 127.26.206.254:36303 (0 consecutive failures): Network error: Failed to ping master at 127.26.206.254:36303: Client connection negotiation failed: client connection to 127.26.206.254:36303: connect: Connection refused (error 111)
I20260808 14:54:24.441430 14365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:24.441107 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:36303 (local address 127.26.206.195:52957)
0808 14:54:24.441250 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0808 14:54:24.441312 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:36303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260808 14:54:24.442180 14365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:24.441883 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:36303 (local address 127.26.206.195:53313)
0808 14:54:24.442011 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0808 14:54:24.442084 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:36303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260808 14:54:24.442414 14362 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260808 14:54:24.511626 14366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:24.510805 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:36303 (local address 127.26.206.193:42679)
0808 14:54:24.511246 (+ 441us) negotiation.cc:107] Waiting for socket to connect
0808 14:54:24.511366 (+ 120us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:36303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":347,"thread_start_us":228,"threads_started":1}
I20260808 14:54:24.985031 14367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:24.984226 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:36303 (local address 127.26.206.194:41327)
0808 14:54:24.984709 (+ 483us) negotiation.cc:107] Waiting for socket to connect
0808 14:54:24.984802 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:36303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":384,"thread_start_us":247,"threads_started":1}
I20260808 14:54:25.443681 14368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:25.442898 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:36303 (local address 127.26.206.195:38343)
0808 14:54:25.443312 (+ 414us) negotiation.cc:107] Waiting for socket to connect
0808 14:54:25.443395 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:36303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":307,"thread_start_us":193,"threads_started":1}
I20260808 14:54:25.513032 14369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:25.512409 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:36303 (local address 127.26.206.193:41793)
0808 14:54:25.512813 (+ 404us) negotiation.cc:107] Waiting for socket to connect
0808 14:54:25.512888 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:36303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":318,"thread_start_us":225,"threads_started":1}
I20260808 14:54:25.986950 14370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:25.986094 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:36303 (local address 127.26.206.194:39491)
0808 14:54:25.986680 (+ 586us) negotiation.cc:107] Waiting for socket to connect
0808 14:54:25.986776 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:36303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":454,"thread_start_us":322,"threads_started":1}
I20260808 14:54:26.445333 14371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:26.444571 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:36303 (local address 127.26.206.195:58793)
0808 14:54:26.445096 (+ 525us) negotiation.cc:107] Waiting for socket to connect
0808 14:54:26.445174 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:36303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":430,"thread_start_us":313,"threads_started":1}
I20260808 14:54:26.514482 14372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:26.513786 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:36303 (local address 127.26.206.193:51013)
0808 14:54:26.514233 (+ 447us) negotiation.cc:107] Waiting for socket to connect
0808 14:54:26.514318 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:36303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":357,"thread_start_us":240,"threads_started":1}
I20260808 14:54:26.988723 14373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:26.988005 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:36303 (local address 127.26.206.194:35563)
0808 14:54:26.988463 (+ 458us) negotiation.cc:107] Waiting for socket to connect
0808 14:54:26.988545 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:36303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":358,"thread_start_us":234,"threads_started":1}
I20260808 14:54:27.446949 14374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:27.446257 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:36303 (local address 127.26.206.195:49453)
0808 14:54:27.446702 (+ 445us) negotiation.cc:107] Waiting for socket to connect
0808 14:54:27.446786 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:36303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":343,"thread_start_us":234,"threads_started":1}
I20260808 14:54:27.516073 14375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:27.515347 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:36303 (local address 127.26.206.193:34077)
0808 14:54:27.515831 (+ 484us) negotiation.cc:107] Waiting for socket to connect
0808 14:54:27.515917 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:36303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":378,"thread_start_us":262,"threads_started":1}
I20260808 14:54:27.990401 14376 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:27.989660 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:36303 (local address 127.26.206.194:56535)
0808 14:54:27.990123 (+ 463us) negotiation.cc:107] Waiting for socket to connect
0808 14:54:27.990211 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:36303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":356,"thread_start_us":238,"threads_started":1}
I20260808 14:54:28.448540 14378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:28.447882 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:36303 (local address 127.26.206.195:46875)
0808 14:54:28.448304 (+ 422us) negotiation.cc:107] Waiting for socket to connect
0808 14:54:28.448381 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:36303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":327,"thread_start_us":220,"threads_started":1}
I20260808 14:54:28.517597 14379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:28.516938 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:36303 (local address 127.26.206.193:47009)
0808 14:54:28.517357 (+ 419us) negotiation.cc:107] Waiting for socket to connect
0808 14:54:28.517435 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:36303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":320,"thread_start_us":214,"threads_started":1}
I20260808 14:54:28.992312 14380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:28.991504 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:36303 (local address 127.26.206.194:35071)
0808 14:54:28.992061 (+ 557us) negotiation.cc:107] Waiting for socket to connect
0808 14:54:28.992143 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:36303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":461,"thread_start_us":334,"threads_started":1}
I20260808 14:54:29.450162 14381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:29.449370 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:36303 (local address 127.26.206.195:39161)
0808 14:54:29.449887 (+ 517us) negotiation.cc:107] Waiting for socket to connect
0808 14:54:29.449967 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:36303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":425,"thread_start_us":308,"threads_started":1}
I20260808 14:54:29.519069 14382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:29.518378 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:36303 (local address 127.26.206.193:53027)
0808 14:54:29.518820 (+ 442us) negotiation.cc:107] Waiting for socket to connect
0808 14:54:29.518907 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:36303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":345,"thread_start_us":220,"threads_started":1}
I20260808 14:54:29.993888 14383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:29.993152 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:36303 (local address 127.26.206.194:36211)
0808 14:54:29.993618 (+ 466us) negotiation.cc:107] Waiting for socket to connect
0808 14:54:29.993713 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:36303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":369,"thread_start_us":231,"threads_started":1}
I20260808 14:54:30.451749 14384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:30.450939 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:36303 (local address 127.26.206.195:41817)
0808 14:54:30.451413 (+ 474us) negotiation.cc:107] Waiting for socket to connect
0808 14:54:30.451502 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:36303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":382,"thread_start_us":265,"threads_started":1}
I20260808 14:54:30.520825 14385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:30.520023 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:36303 (local address 127.26.206.193:38291)
0808 14:54:30.520516 (+ 493us) negotiation.cc:107] Waiting for socket to connect
0808 14:54:30.520598 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:36303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":394,"thread_start_us":235,"threads_started":1}
I20260808 14:54:30.995661 14386 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:30.994746 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:36303 (local address 127.26.206.194:35481)
0808 14:54:30.995301 (+ 555us) negotiation.cc:107] Waiting for socket to connect
0808 14:54:30.995384 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:36303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":414,"thread_start_us":248,"threads_started":1}
I20260808 14:54:31.453404 14387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:31.452640 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:36303 (local address 127.26.206.195:38493)
0808 14:54:31.453102 (+ 462us) negotiation.cc:107] Waiting for socket to connect
0808 14:54:31.453185 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:36303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":365,"thread_start_us":219,"threads_started":1}
I20260808 14:54:31.522388 14388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:31.521679 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:36303 (local address 127.26.206.193:37057)
0808 14:54:31.522146 (+ 467us) negotiation.cc:107] Waiting for socket to connect
0808 14:54:31.522231 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:36303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":380,"thread_start_us":285,"threads_started":1}
I20260808 14:54:31.997268 14389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:31.996553 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:36303 (local address 127.26.206.194:54945)
0808 14:54:31.997018 (+ 465us) negotiation.cc:107] Waiting for socket to connect
0808 14:54:31.997104 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:36303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":372,"thread_start_us":260,"threads_started":1}
I20260808 14:54:32.455015 14390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:32.454330 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:36303 (local address 127.26.206.195:57109)
0808 14:54:32.454762 (+ 432us) negotiation.cc:107] Waiting for socket to connect
0808 14:54:32.454849 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:36303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":342,"thread_start_us":231,"threads_started":1}
I20260808 14:54:32.523937 14391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:32.523189 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:36303 (local address 127.26.206.193:50863)
0808 14:54:32.523654 (+ 465us) negotiation.cc:107] Waiting for socket to connect
0808 14:54:32.523757 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:36303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":352,"thread_start_us":229,"threads_started":1}
I20260808 14:54:32.999148 14392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:32.998144 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:36303 (local address 127.26.206.194:44137)
0808 14:54:32.998760 (+ 616us) negotiation.cc:107] Waiting for socket to connect
0808 14:54:32.998875 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:36303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":470,"thread_start_us":312,"threads_started":1}
I20260808 14:54:33.456790 14393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:33.456001 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:36303 (local address 127.26.206.195:43661)
0808 14:54:33.456471 (+ 470us) negotiation.cc:107] Waiting for socket to connect
0808 14:54:33.456590 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:36303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":370,"thread_start_us":222,"threads_started":1}
I20260808 14:54:33.525466 14394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:33.524788 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:36303 (local address 127.26.206.193:56065)
0808 14:54:33.525193 (+ 405us) negotiation.cc:107] Waiting for socket to connect
0808 14:54:33.525279 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:36303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":316,"thread_start_us":218,"threads_started":1}
I20260808 14:54:34.000897 14395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:34.000162 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:36303 (local address 127.26.206.194:54299)
0808 14:54:34.000641 (+ 479us) negotiation.cc:107] Waiting for socket to connect
0808 14:54:34.000721 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:36303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":384,"thread_start_us":288,"threads_started":1}
I20260808 14:54:34.458380 14396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:34.457655 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:36303 (local address 127.26.206.195:55271)
0808 14:54:34.458111 (+ 456us) negotiation.cc:107] Waiting for socket to connect
0808 14:54:34.458209 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:36303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":364,"thread_start_us":258,"threads_started":1}
I20260808 14:54:34.527067 14397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:34.526351 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:36303 (local address 127.26.206.193:41705)
0808 14:54:34.526806 (+ 455us) negotiation.cc:107] Waiting for socket to connect
0808 14:54:34.526886 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:36303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":352,"thread_start_us":253,"threads_started":1}
I20260808 14:54:35.002651 14398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:35.001917 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:36303 (local address 127.26.206.194:39393)
0808 14:54:35.002366 (+ 449us) negotiation.cc:107] Waiting for socket to connect
0808 14:54:35.002461 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:36303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":354,"thread_start_us":224,"threads_started":1}
I20260808 14:54:35.460019 14399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:35.459268 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:36303 (local address 127.26.206.195:35803)
0808 14:54:35.459746 (+ 478us) negotiation.cc:107] Waiting for socket to connect
0808 14:54:35.459845 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:36303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":386,"thread_start_us":221,"threads_started":1}
I20260808 14:54:35.528638 14400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:35.527980 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:36303 (local address 127.26.206.193:53641)
0808 14:54:35.528393 (+ 413us) negotiation.cc:107] Waiting for socket to connect
0808 14:54:35.528472 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:36303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":324,"thread_start_us":222,"threads_started":1}
I20260808 14:54:36.004377 14402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:36.003667 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:36303 (local address 127.26.206.194:38947)
0808 14:54:36.004119 (+ 452us) negotiation.cc:107] Waiting for socket to connect
0808 14:54:36.004206 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:36303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":329,"thread_start_us":219,"threads_started":1}
I20260808 14:54:36.461562 14403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:36.460896 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:36303 (local address 127.26.206.195:49499)
0808 14:54:36.461312 (+ 416us) negotiation.cc:107] Waiting for socket to connect
0808 14:54:36.461390 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:36303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":313,"thread_start_us":216,"threads_started":1}
I20260808 14:54:36.530468 14404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:36.529564 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:36303 (local address 127.26.206.193:34427)
0808 14:54:36.530166 (+ 602us) negotiation.cc:107] Waiting for socket to connect
0808 14:54:36.530279 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:36303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":500,"thread_start_us":295,"threads_started":1}
I20260808 14:54:37.006070 14405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:37.005255 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:36303 (local address 127.26.206.194:58647)
0808 14:54:37.005789 (+ 534us) negotiation.cc:107] Waiting for socket to connect
0808 14:54:37.005886 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:36303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":438,"thread_start_us":275,"threads_started":1}
I20260808 14:54:37.463534 14406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:37.462629 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:36303 (local address 127.26.206.195:37169)
0808 14:54:37.463179 (+ 550us) negotiation.cc:107] Waiting for socket to connect
0808 14:54:37.463321 (+ 142us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:36303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":445,"thread_start_us":282,"threads_started":1}
I20260808 14:54:37.532193 14407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:37.531443 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:36303 (local address 127.26.206.193:55591)
0808 14:54:37.531935 (+ 492us) negotiation.cc:107] Waiting for socket to connect
0808 14:54:37.532015 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:36303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":404,"thread_start_us":298,"threads_started":1}
I20260808 14:54:38.007866 14408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:38.006920 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:36303 (local address 127.26.206.194:50795)
0808 14:54:38.007501 (+ 581us) negotiation.cc:107] Waiting for socket to connect
0808 14:54:38.007642 (+ 141us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:36303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":461,"thread_start_us":358,"threads_started":1}
I20260808 14:54:38.465190 14409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:38.464486 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:36303 (local address 127.26.206.195:41809)
0808 14:54:38.464908 (+ 422us) negotiation.cc:107] Waiting for socket to connect
0808 14:54:38.464990 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:36303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":326,"thread_start_us":218,"threads_started":1}
I20260808 14:54:38.533946 14410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:38.533207 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:36303 (local address 127.26.206.193:35219)
0808 14:54:38.533644 (+ 437us) negotiation.cc:107] Waiting for socket to connect
0808 14:54:38.533738 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:36303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":338,"thread_start_us":220,"threads_started":1}
I20260808 14:54:39.010023 14411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:39.008900 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:36303 (local address 127.26.206.194:56955)
0808 14:54:39.009533 (+ 633us) negotiation.cc:107] Waiting for socket to connect
0808 14:54:39.009700 (+ 167us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:36303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":480,"thread_start_us":320,"threads_started":1}
I20260808 14:54:39.441022 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 13899
I20260808 14:54:39.463361 14412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:39.442138 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53588 (local address 127.26.206.193:42847)
0808 14:54:39.442673 (+ 535us) server_negotiation.cc:206] Beginning negotiation
0808 14:54:39.442686 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 14:54:39.442753 (+ 67us) server_negotiation.cc:407] Connection header received
0808 14:54:39.444806 (+ 2053us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:54:39.444817 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:54:39.445250 (+ 433us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:54:39.445540 (+ 290us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:54:39.446947 (+ 1407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:39.448238 (+ 1291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:39.449533 (+ 1295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:39.450166 (+ 633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:39.450311 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:39.457673 (+ 7362us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:54:39.457681 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:54:39.457695 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:54:39.457731 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:54:39.460604 (+ 2873us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:54:39.461225 (+ 621us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:54:39.461231 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:54:39.461237 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:54:39.461394 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:54:39.461743 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:54:39.461746 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:54:39.461748 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:54:39.462226 (+ 478us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:54:39.462449 (+ 223us) server_negotiation.cc:1035] Waiting for connection context
0808 14:54:39.462766 (+ 317us) server_negotiation.cc:299] Negotiation successful
0808 14:54:39.463081 (+ 315us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":367,"thread_start_us":259,"threads_started":1}
I20260808 14:54:39.464718 14076 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:54:39.467288 14414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:39.466402 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:36303 (local address 127.26.206.195:41327)
0808 14:54:39.466909 (+ 507us) negotiation.cc:107] Waiting for socket to connect
0808 14:54:39.467040 (+ 131us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.254:36303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":373,"thread_start_us":267,"threads_started":1}
I20260808 14:54:39.551820 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 13899
I20260808 14:54:39.572572 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 14085
I20260808 14:54:39.591194 14416 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:39.573521 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35520 (local address 127.26.206.194:36053)
0808 14:54:39.574069 (+ 548us) server_negotiation.cc:206] Beginning negotiation
0808 14:54:39.574083 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 14:54:39.574119 (+ 36us) server_negotiation.cc:407] Connection header received
0808 14:54:39.576323 (+ 2204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:54:39.576337 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:54:39.576855 (+ 518us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:54:39.577199 (+ 344us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:54:39.578745 (+ 1546us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:39.580060 (+ 1315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:39.581334 (+ 1274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:39.582041 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:39.582261 (+ 220us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:39.585015 (+ 2754us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:54:39.585023 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:54:39.585038 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:54:39.585076 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:54:39.587878 (+ 2802us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:54:39.588582 (+ 704us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:54:39.588593 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:54:39.588605 (+ 12us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:54:39.588784 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:54:39.589185 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:54:39.589191 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:54:39.589194 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:54:39.589700 (+ 506us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:54:39.590032 (+ 332us) server_negotiation.cc:1035] Waiting for connection context
0808 14:54:39.590486 (+ 454us) server_negotiation.cc:299] Negotiation successful
0808 14:54:39.590915 (+ 429us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":388,"thread_start_us":268,"threads_started":1}
I20260808 14:54:39.592592 14215 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:54:39.677920 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 14085
I20260808 14:54:39.699085 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 14223
I20260808 14:54:39.717244 14418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:39.700154 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41032 (local address 127.26.206.195:35273)
0808 14:54:39.700751 (+ 597us) server_negotiation.cc:206] Beginning negotiation
0808 14:54:39.700765 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 14:54:39.700819 (+ 54us) server_negotiation.cc:407] Connection header received
0808 14:54:39.702444 (+ 1625us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:54:39.702453 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:54:39.702874 (+ 421us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:54:39.703208 (+ 334us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:54:39.704927 (+ 1719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:39.706115 (+ 1188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:39.707429 (+ 1314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:39.708138 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:39.708327 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:39.711045 (+ 2718us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:54:39.711053 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:54:39.711067 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:54:39.711102 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:54:39.713950 (+ 2848us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:54:39.714633 (+ 683us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:54:39.714646 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:54:39.714652 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:54:39.714819 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:54:39.715204 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:54:39.715210 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:54:39.715213 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:54:39.715774 (+ 561us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:54:39.716096 (+ 322us) server_negotiation.cc:1035] Waiting for connection context
0808 14:54:39.716533 (+ 437us) server_negotiation.cc:299] Negotiation successful
0808 14:54:39.716949 (+ 416us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":446,"thread_start_us":290,"threads_started":1}
I20260808 14:54:39.718650 14357 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:54:39.803022 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 14223
2026-08-08T14:54:39Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (64734 ms)
[----------] 30 tests from SecurityITest (302236 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200577490656-27451-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:54:39 dist-test-slave-6k22 krb5kdc[14422](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:54:39 dist-test-slave-6k22 krb5kdc[14422](info): set up 2 sockets
Aug 08 14:54:39 dist-test-slave-6k22 krb5kdc[14422](info): commencing operation
krb5kdc: starting...
W20260808 14:54:41.049448 27451 mini_kdc.cc:121] Time spent starting KDC: real 1.203s user 0.000s sys 0.042s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200577490656-27451-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200577490656-27451-0/krb5kdc/test-user.keytab.
Aug 08 14:54:41 dist-test-slave-6k22 krb5kdc[14422](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200881, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:54:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:54:41Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.206.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.206.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.206.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.254.keytab.
Entry for principal kudu/127.26.206.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.254.keytab.
I20260808 14:54:41.335026 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200577490656-27451-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200577490656-27451-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200577490656-27451-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.206.254:39155
--webserver_interface=127.26.206.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.254.keytab
--principal=kudu/127.26.206.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.206.212:41447
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.206.254:39155
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:54:41.674068 14436 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:54:41.674396 14436 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:54:41.674579 14436 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:54:41.681838 14436 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:54:41.681984 14436 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:54:41.682096 14436 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:54:41.682209 14436 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:54:41.682281 14436 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:54:41.691892 14436 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:41447
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200577490656-27451-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200577490656-27451-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.206.254:39155
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.254.keytab
--principal=kudu/127.26.206.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.206.254:39155
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.206.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200577490656-27451-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:54:41.693235 14436 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:54:41.694581 14436 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:54:41.706730 14445 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:54:41.706840 14442 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:54:41.706938 14443 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:54:41.707340 14436 server_base.cc:1034] running on GCE node
I20260808 14:54:41.708204 14436 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:54:41.709487 14436 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:54:41.710721 14436 hybrid_clock.cc:648] HybridClock initialized: now 1786200881710640 us; error 34 us; skew 500 ppm
I20260808 14:54:41.711057 14436 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:54:41 dist-test-slave-6k22 krb5kdc[14422](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200881, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:54:41.714167 14436 init.cc:377] Logged in from keytab as kudu/127.26.206.254@KRBTEST.COM (short username kudu)
I20260808 14:54:41.715714 14436 webserver.cc:460] Webserver started at http://127.26.206.254:46021/ using document root <none> and password file <none>
I20260808 14:54:41.716409 14436 fs_manager.cc:359] Metadata directory not provided
I20260808 14:54:41.716516 14436 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:54:41.716764 14436 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:54:41.719743 14436 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200577490656-27451-0/minicluster-data/master-0/data/instance:
uuid: "4ed12729ef804f5686f7568d811cdd7d"
format_stamp: "Formatted at 2026-08-08 14:54:41 on dist-test-slave-6k22"
server_key: "d3c879ddfd2ce4019bfd233802af7902"
server_key_iv: "73ca4e6f915cc296cd3fafeb483d476a"
server_key_version: "encryptionkey@0"
I20260808 14:54:41.720455 14436 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200577490656-27451-0/minicluster-data/master-0/wal/instance:
uuid: "4ed12729ef804f5686f7568d811cdd7d"
format_stamp: "Formatted at 2026-08-08 14:54:41 on dist-test-slave-6k22"
server_key: "d3c879ddfd2ce4019bfd233802af7902"
server_key_iv: "73ca4e6f915cc296cd3fafeb483d476a"
server_key_version: "encryptionkey@0"
I20260808 14:54:41.725625 14436 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260808 14:54:41.728958 14453 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:54:41.730316 14436 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 14:54:41.730500 14436 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200577490656-27451-0/minicluster-data/master-0/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200577490656-27451-0/minicluster-data/master-0/wal
uuid: "4ed12729ef804f5686f7568d811cdd7d"
format_stamp: "Formatted at 2026-08-08 14:54:41 on dist-test-slave-6k22"
server_key: "d3c879ddfd2ce4019bfd233802af7902"
server_key_iv: "73ca4e6f915cc296cd3fafeb483d476a"
server_key_version: "encryptionkey@0"
I20260808 14:54:41.730698 14436 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200577490656-27451-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200577490656-27451-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200577490656-27451-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:54:41.748046 14436 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:54:41.751827 14436 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:54:41.752102 14436 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:54:41.770090 14436 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.254:39155
I20260808 14:54:41.770119 14509 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.254:39155 every 8 connection(s)
I20260808 14:54:41.771411 14436 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
I20260808 14:54:41.772043 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 14436
I20260808 14:54:41.772315 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200577490656-27451-0/minicluster-data/master-0/wal/instance
I20260808 14:54:41.773084 27451 external_mini_cluster.cc:1428] Setting key f9e253f7d706ce2bb1d7091228855328
I20260808 14:54:41.775800 14510 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 08 14:54:41 dist-test-slave-6k22 krb5kdc[14422](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200881, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.206.254@KRBTEST.COM
I20260808 14:54:41.788843 14510 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4ed12729ef804f5686f7568d811cdd7d: Bootstrap starting.
I20260808 14:54:41.792248 14510 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4ed12729ef804f5686f7568d811cdd7d: Neither blocks nor log segments found. Creating new log.
I20260808 14:54:41.793254 14510 log.cc:824] T 00000000000000000000000000000000 P 4ed12729ef804f5686f7568d811cdd7d: Log is configured to *not* fsync() on all Append() calls
I20260808 14:54:41.796113 14510 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4ed12729ef804f5686f7568d811cdd7d: No bootstrap required, opened a new log
I20260808 14:54:41.796255 14514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:41.775006 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45532 (local address 127.26.206.254:39155)
0808 14:54:41.775822 (+ 816us) server_negotiation.cc:206] Beginning negotiation
0808 14:54:41.775833 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 14:54:41.775903 (+ 70us) server_negotiation.cc:407] Connection header received
0808 14:54:41.777537 (+ 1634us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:54:41.777557 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:54:41.777915 (+ 358us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:54:41.778227 (+ 312us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:54:41.780175 (+ 1948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:41.781501 (+ 1326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:41.783467 (+ 1966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:41.784171 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:41.784294 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:41.789107 (+ 4813us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:54:41.789115 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:54:41.789129 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:54:41.789172 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:54:41.792158 (+ 2986us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:54:41.792897 (+ 739us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:54:41.792904 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:54:41.792910 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:54:41.793074 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:54:41.793506 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:54:41.793511 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:54:41.793514 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:54:41.794018 (+ 504us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:54:41.794331 (+ 313us) server_negotiation.cc:1035] Waiting for connection context
0808 14:54:41.794818 (+ 487us) server_negotiation.cc:299] Negotiation successful
0808 14:54:41.795222 (+ 404us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":604,"thread_start_us":378,"threads_started":1}
I20260808 14:54:41.804252 14510 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4ed12729ef804f5686f7568d811cdd7d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ed12729ef804f5686f7568d811cdd7d" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 39155 } }
I20260808 14:54:41.804723 14510 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4ed12729ef804f5686f7568d811cdd7d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:54:41.804867 14510 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4ed12729ef804f5686f7568d811cdd7d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ed12729ef804f5686f7568d811cdd7d, State: Initialized, Role: FOLLOWER
I20260808 14:54:41.805557 14510 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4ed12729ef804f5686f7568d811cdd7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ed12729ef804f5686f7568d811cdd7d" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 39155 } }
I20260808 14:54:41.805881 14510 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4ed12729ef804f5686f7568d811cdd7d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:54:41.806053 14510 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4ed12729ef804f5686f7568d811cdd7d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:54:41.806244 14510 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4ed12729ef804f5686f7568d811cdd7d [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:54:41.808979 14510 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4ed12729ef804f5686f7568d811cdd7d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ed12729ef804f5686f7568d811cdd7d" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 39155 } }
I20260808 14:54:41.809476 14510 leader_election.cc:302] T 00000000000000000000000000000000 P 4ed12729ef804f5686f7568d811cdd7d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4ed12729ef804f5686f7568d811cdd7d; no voters:
I20260808 14:54:41.810128 14510 leader_election.cc:288] T 00000000000000000000000000000000 P 4ed12729ef804f5686f7568d811cdd7d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:54:41.810231 14516 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4ed12729ef804f5686f7568d811cdd7d [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:54:41.811038 14516 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4ed12729ef804f5686f7568d811cdd7d [term 1 LEADER]: Becoming Leader. State: Replica: 4ed12729ef804f5686f7568d811cdd7d, State: Running, Role: LEADER
I20260808 14:54:41.811621 14516 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4ed12729ef804f5686f7568d811cdd7d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ed12729ef804f5686f7568d811cdd7d" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 39155 } }
I20260808 14:54:41.812500 14510 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4ed12729ef804f5686f7568d811cdd7d [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:54:41.814811 14517 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4ed12729ef804f5686f7568d811cdd7d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4ed12729ef804f5686f7568d811cdd7d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ed12729ef804f5686f7568d811cdd7d" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 39155 } } }
I20260808 14:54:41.814692 14518 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4ed12729ef804f5686f7568d811cdd7d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4ed12729ef804f5686f7568d811cdd7d. Latest consensus state: current_term: 1 leader_uuid: "4ed12729ef804f5686f7568d811cdd7d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ed12729ef804f5686f7568d811cdd7d" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 39155 } } }
I20260808 14:54:41.815212 14517 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4ed12729ef804f5686f7568d811cdd7d [sys.catalog]: This master's current role is: LEADER
I20260808 14:54:41.815289 14518 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4ed12729ef804f5686f7568d811cdd7d [sys.catalog]: This master's current role is: LEADER
I20260808 14:54:41.817154 14526 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:54:41.822983 14526 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:54:41.832163 14526 catalog_manager.cc:1347] Generated new cluster ID: 7cfc6966f0c64611886c05b3dd5a3a21
I20260808 14:54:41.832610 14526 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:54:41.854995 14526 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:54:41.856366 14526 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:54:41.867806 14526 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4ed12729ef804f5686f7568d811cdd7d: Generated new TSK 0
I20260808 14:54:41.868649 14526 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.206.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.206.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.206.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.193.keytab.
Entry for principal kudu/127.26.206.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.193.keytab.
I20260808 14:54:41.949162 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200577490656-27451-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200577490656-27451-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200577490656-27451-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200577490656-27451-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.206.193:0
--local_ip_for_outbound_sockets=127.26.206.193
--webserver_interface=127.26.206.193
--webserver_port=0
--tserver_master_addrs=127.26.206.254:39155
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.193.keytab
--principal=kudu/127.26.206.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.206.212:41447
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:54:42.301347 14541 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:54:42.301604 14541 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:54:42.301704 14541 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:54:42.308808 14541 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:54:42.308908 14541 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:54:42.309022 14541 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.206.193
I20260808 14:54:42.318859 14541 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:41447
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200577490656-27451-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200577490656-27451-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.193.keytab
--principal=kudu/127.26.206.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.206.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200577490656-27451-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.206.193
--webserver_port=0
--tserver_master_addrs=127.26.206.254:39155
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.206.193
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200577490656-27451-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:54:42.320079 14541 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:54:42.321363 14541 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:54:42.334308 14547 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:54:42.334283 14549 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:54:42.334447 14546 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:54:42.335057 14541 server_base.cc:1034] running on GCE node
I20260808 14:54:42.335726 14541 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:54:42.336699 14541 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:54:42.337931 14541 hybrid_clock.cc:648] HybridClock initialized: now 1786200882337898 us; error 47 us; skew 500 ppm
I20260808 14:54:42.338236 14541 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:54:42 dist-test-slave-6k22 krb5kdc[14422](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200882, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:54:42.341424 14541 init.cc:377] Logged in from keytab as kudu/127.26.206.193@KRBTEST.COM (short username kudu)
I20260808 14:54:42.342810 14541 webserver.cc:460] Webserver started at http://127.26.206.193:39697/ using document root <none> and password file <none>
I20260808 14:54:42.343472 14541 fs_manager.cc:359] Metadata directory not provided
I20260808 14:54:42.343654 14541 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:54:42.343989 14541 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:54:42.346792 14541 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200577490656-27451-0/minicluster-data/ts-0/data/instance:
uuid: "2ef6e53a7f944f81898a650cf1e20577"
format_stamp: "Formatted at 2026-08-08 14:54:42 on dist-test-slave-6k22"
server_key: "bb674973342e9b01880abf5b9ca1c1e4"
server_key_iv: "23c31119c51d4457313dd2917d6183be"
server_key_version: "encryptionkey@0"
I20260808 14:54:42.347631 14541 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200577490656-27451-0/minicluster-data/ts-0/wal/instance:
uuid: "2ef6e53a7f944f81898a650cf1e20577"
format_stamp: "Formatted at 2026-08-08 14:54:42 on dist-test-slave-6k22"
server_key: "bb674973342e9b01880abf5b9ca1c1e4"
server_key_iv: "23c31119c51d4457313dd2917d6183be"
server_key_version: "encryptionkey@0"
I20260808 14:54:42.352808 14541 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260808 14:54:42.356132 14556 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:54:42.357386 14541 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 14:54:42.357555 14541 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200577490656-27451-0/minicluster-data/ts-0/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200577490656-27451-0/minicluster-data/ts-0/wal
uuid: "2ef6e53a7f944f81898a650cf1e20577"
format_stamp: "Formatted at 2026-08-08 14:54:42 on dist-test-slave-6k22"
server_key: "bb674973342e9b01880abf5b9ca1c1e4"
server_key_iv: "23c31119c51d4457313dd2917d6183be"
server_key_version: "encryptionkey@0"
I20260808 14:54:42.357753 14541 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200577490656-27451-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200577490656-27451-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200577490656-27451-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:54:42.381595 14541 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:54:42.385663 14541 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:54:42.385962 14541 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:54:42.386929 14541 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:54:42.388283 14541 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:54:42.388356 14541 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:54:42.388504 14541 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:54:42.388569 14541 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:54:42.421538 14541 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.193:43767
I20260808 14:54:42.421590 14683 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.193:43767 every 8 connection(s)
I20260808 14:54:42.422818 14541 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200577490656-27451-0/minicluster-data/ts-0/data/info.pb
I20260808 14:54:42.432925 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 14541
I20260808 14:54:42.433145 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200577490656-27451-0/minicluster-data/ts-0/wal/instance
I20260808 14:54:42.433928 27451 external_mini_cluster.cc:1428] Setting key 914d63591e04b12ba2209571b68bebce
Aug 08 14:54:42 dist-test-slave-6k22 krb5kdc[14422](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200882, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.193@KRBTEST.COM for kudu/127.26.206.254@KRBTEST.COM
I20260808 14:54:42.442721 14687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:42.425359 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.193:58291 (local address 127.26.206.254:39155)
0808 14:54:42.425801 (+ 442us) server_negotiation.cc:206] Beginning negotiation
0808 14:54:42.425806 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:54:42.426723 (+ 917us) server_negotiation.cc:407] Connection header received
0808 14:54:42.428646 (+ 1923us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:54:42.428651 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:54:42.428738 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:54:42.428859 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:54:42.430263 (+ 1404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:42.430952 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:42.432522 (+ 1570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:42.432921 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:42.433062 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:42.436910 (+ 3848us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:54:42.436915 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:54:42.436919 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:54:42.436950 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:54:42.439711 (+ 2761us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:54:42.440444 (+ 733us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:54:42.440451 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:54:42.440454 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:54:42.440580 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:54:42.441020 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:54:42.441025 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:54:42.441028 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:54:42.441292 (+ 264us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:54:42.441463 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0808 14:54:42.442140 (+ 677us) server_negotiation.cc:299] Negotiation successful
0808 14:54:42.442367 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":333,"thread_start_us":223,"threads_started":1}
I20260808 14:54:42.443749 14688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:42.425890 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:39155 (local address 127.26.206.193:58291)
0808 14:54:42.426564 (+ 674us) negotiation.cc:107] Waiting for socket to connect
0808 14:54:42.426608 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 14:54:42.428382 (+ 1774us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:54:42.429102 (+ 720us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:54:42.429109 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:54:42.429579 (+ 470us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:54:42.430102 (+ 523us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:54:42.430118 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:54:42.431122 (+ 1004us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:54:42.431125 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:54:42.432358 (+ 1233us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:54:42.432370 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:54:42.433145 (+ 775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:54:42.433153 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:54:42.433395 (+ 242us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:42.434125 (+ 730us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:54:42.434146 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:54:42.436697 (+ 2551us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:54:42.439856 (+ 3159us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:54:42.439864 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:54:42.439879 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:54:42.440313 (+ 434us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:54:42.440703 (+ 390us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:54:42.440708 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:54:42.440712 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:54:42.440897 (+ 185us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:54:42.441435 (+ 538us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:54:42.441442 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:54:42.441764 (+ 322us) client_negotiation.cc:769] Sending connection context
0808 14:54:42.442024 (+ 260us) client_negotiation.cc:240] Negotiation successful
0808 14:54:42.442576 (+ 552us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":457,"thread_start_us":263,"threads_started":1}
I20260808 14:54:42.445401 14684 heartbeater.cc:347] Connected to a master server at 127.26.206.254:39155
I20260808 14:54:42.445724 14684 heartbeater.cc:464] Registering TS with master...
I20260808 14:54:42.446579 14684 heartbeater.cc:511] Master 127.26.206.254:39155 requested a full tablet report, sending...
I20260808 14:54:42.448912 14473 ts_manager.cc:194] Registered new tserver with Master: 2ef6e53a7f944f81898a650cf1e20577 (127.26.206.193:43767)
I20260808 14:54:42.450444 14473 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.206.193@KRBTEST.COM'} at 127.26.206.193:58291
WARNING: no policy specified for kudu/127.26.206.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.206.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.206.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.194.keytab.
Entry for principal kudu/127.26.206.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.194.keytab.
I20260808 14:54:42.500682 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200577490656-27451-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200577490656-27451-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200577490656-27451-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200577490656-27451-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.206.194:0
--local_ip_for_outbound_sockets=127.26.206.194
--webserver_interface=127.26.206.194
--webserver_port=0
--tserver_master_addrs=127.26.206.254:39155
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.194.keytab
--principal=kudu/127.26.206.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.206.212:41447
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:54:42.839422 14692 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:54:42.839818 14692 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:54:42.839995 14692 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:54:42.847328 14692 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:54:42.847465 14692 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:54:42.847684 14692 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.206.194
I20260808 14:54:42.857419 14692 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:41447
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200577490656-27451-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200577490656-27451-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.194.keytab
--principal=kudu/127.26.206.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.206.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200577490656-27451-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.206.194
--webserver_port=0
--tserver_master_addrs=127.26.206.254:39155
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.206.194
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200577490656-27451-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:54:42.858680 14692 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:54:42.860035 14692 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:54:42.872828 14697 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:54:42.872951 14700 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:54:42.872838 14698 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:54:42.873804 14692 server_base.cc:1034] running on GCE node
I20260808 14:54:42.874312 14692 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:54:42.875126 14692 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:54:42.876325 14692 hybrid_clock.cc:648] HybridClock initialized: now 1786200882876270 us; error 51 us; skew 500 ppm
I20260808 14:54:42.876632 14692 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:54:42 dist-test-slave-6k22 krb5kdc[14422](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200882, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:54:42.879833 14692 init.cc:377] Logged in from keytab as kudu/127.26.206.194@KRBTEST.COM (short username kudu)
I20260808 14:54:42.881182 14692 webserver.cc:460] Webserver started at http://127.26.206.194:42799/ using document root <none> and password file <none>
I20260808 14:54:42.881841 14692 fs_manager.cc:359] Metadata directory not provided
I20260808 14:54:42.881970 14692 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:54:42.882288 14692 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:54:42.885046 14692 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200577490656-27451-0/minicluster-data/ts-1/data/instance:
uuid: "a1b1cfec0fae4fd7875feb9481624ad9"
format_stamp: "Formatted at 2026-08-08 14:54:42 on dist-test-slave-6k22"
server_key: "2bf890f000296416a17cd1b4436e5eef"
server_key_iv: "261545afab669d58c6a48b949eebefed"
server_key_version: "encryptionkey@0"
I20260808 14:54:42.885800 14692 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200577490656-27451-0/minicluster-data/ts-1/wal/instance:
uuid: "a1b1cfec0fae4fd7875feb9481624ad9"
format_stamp: "Formatted at 2026-08-08 14:54:42 on dist-test-slave-6k22"
server_key: "2bf890f000296416a17cd1b4436e5eef"
server_key_iv: "261545afab669d58c6a48b949eebefed"
server_key_version: "encryptionkey@0"
I20260808 14:54:42.890785 14692 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260808 14:54:42.894088 14707 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:54:42.895358 14692 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 14:54:42.895526 14692 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200577490656-27451-0/minicluster-data/ts-1/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200577490656-27451-0/minicluster-data/ts-1/wal
uuid: "a1b1cfec0fae4fd7875feb9481624ad9"
format_stamp: "Formatted at 2026-08-08 14:54:42 on dist-test-slave-6k22"
server_key: "2bf890f000296416a17cd1b4436e5eef"
server_key_iv: "261545afab669d58c6a48b949eebefed"
server_key_version: "encryptionkey@0"
I20260808 14:54:42.895779 14692 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200577490656-27451-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200577490656-27451-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200577490656-27451-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:54:42.913604 14692 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:54:42.917902 14692 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:54:42.918200 14692 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:54:42.919261 14692 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:54:42.920625 14692 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:54:42.920730 14692 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:54:42.920879 14692 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:54:42.920951 14692 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:54:42.955297 14692 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.194:43139
I20260808 14:54:42.955386 14827 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.194:43139 every 8 connection(s)
I20260808 14:54:42.956625 14692 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200577490656-27451-0/minicluster-data/ts-1/data/info.pb
I20260808 14:54:42.958290 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 14692
I20260808 14:54:42.958519 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200577490656-27451-0/minicluster-data/ts-1/wal/instance
I20260808 14:54:42.958988 27451 external_mini_cluster.cc:1428] Setting key 01d2bada2a034e3c8b56fb9e694474c5
Aug 08 14:54:42 dist-test-slave-6k22 krb5kdc[14422](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200882, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.194@KRBTEST.COM for kudu/127.26.206.254@KRBTEST.COM
I20260808 14:54:42.977576 14830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:42.959392 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.194:53501 (local address 127.26.206.254:39155)
0808 14:54:42.959950 (+ 558us) server_negotiation.cc:206] Beginning negotiation
0808 14:54:42.959957 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:54:42.960993 (+ 1036us) server_negotiation.cc:407] Connection header received
0808 14:54:42.962948 (+ 1955us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:54:42.962953 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:54:42.963031 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:54:42.963150 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:54:42.964739 (+ 1589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:42.965469 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:42.966964 (+ 1495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:42.967393 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:42.967531 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:42.970891 (+ 3360us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:54:42.970896 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:54:42.970899 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:54:42.970930 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:54:42.973826 (+ 2896us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:54:42.974816 (+ 990us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:54:42.974821 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:54:42.974823 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:54:42.974975 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:54:42.975539 (+ 564us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:54:42.975547 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:54:42.975553 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:54:42.975994 (+ 441us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:54:42.976150 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0808 14:54:42.976815 (+ 665us) server_negotiation.cc:299] Negotiation successful
0808 14:54:42.977096 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":424,"thread_start_us":303,"threads_started":1}
I20260808 14:54:42.978098 14831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:42.959957 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:39155 (local address 127.26.206.194:53501)
0808 14:54:42.960798 (+ 841us) negotiation.cc:107] Waiting for socket to connect
0808 14:54:42.960844 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0808 14:54:42.962699 (+ 1855us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:54:42.963408 (+ 709us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:54:42.963416 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:54:42.963967 (+ 551us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:54:42.964571 (+ 604us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:54:42.964589 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:54:42.965626 (+ 1037us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:54:42.965633 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:54:42.966826 (+ 1193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:54:42.966837 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:54:42.967660 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:54:42.967669 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:54:42.967929 (+ 260us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:42.968618 (+ 689us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:54:42.968645 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:54:42.970667 (+ 2022us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:54:42.973964 (+ 3297us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:54:42.973972 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:54:42.973986 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:54:42.974645 (+ 659us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:54:42.975099 (+ 454us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:54:42.975106 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:54:42.975111 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:54:42.975365 (+ 254us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:54:42.976113 (+ 748us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:54:42.976119 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:54:42.976398 (+ 279us) client_negotiation.cc:769] Sending connection context
0808 14:54:42.976626 (+ 228us) client_negotiation.cc:240] Negotiation successful
0808 14:54:42.977015 (+ 389us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":558,"thread_start_us":347,"threads_started":1}
I20260808 14:54:42.979605 14828 heartbeater.cc:347] Connected to a master server at 127.26.206.254:39155
I20260808 14:54:42.979919 14828 heartbeater.cc:464] Registering TS with master...
I20260808 14:54:42.980736 14828 heartbeater.cc:511] Master 127.26.206.254:39155 requested a full tablet report, sending...
I20260808 14:54:42.982398 14473 ts_manager.cc:194] Registered new tserver with Master: a1b1cfec0fae4fd7875feb9481624ad9 (127.26.206.194:43139)
I20260808 14:54:42.983721 14473 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.206.194@KRBTEST.COM'} at 127.26.206.194:53501
WARNING: no policy specified for kudu/127.26.206.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.206.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.206.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.195.keytab.
Entry for principal kudu/127.26.206.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.195.keytab.
I20260808 14:54:43.028803 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200577490656-27451-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200577490656-27451-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200577490656-27451-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200577490656-27451-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.206.195:0
--local_ip_for_outbound_sockets=127.26.206.195
--webserver_interface=127.26.206.195
--webserver_port=0
--tserver_master_addrs=127.26.206.254:39155
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.195.keytab
--principal=kudu/127.26.206.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.206.212:41447
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:54:43.384029 14835 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:54:43.384294 14835 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:54:43.384387 14835 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:54:43.391491 14835 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:54:43.391642 14835 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:54:43.391835 14835 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.206.195
I20260808 14:54:43.401710 14835 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:41447
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200577490656-27451-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200577490656-27451-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.195.keytab
--principal=kudu/127.26.206.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.206.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200577490656-27451-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.206.195
--webserver_port=0
--tserver_master_addrs=127.26.206.254:39155
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.206.195
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200577490656-27451-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:54:43.402944 14835 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:54:43.404345 14835 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:54:43.417412 14841 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:54:43.417479 14840 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:54:43.417562 14843 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:54:43.422565 14835 server_base.cc:1034] running on GCE node
I20260808 14:54:43.423214 14835 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:54:43.424224 14835 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:54:43.425457 14835 hybrid_clock.cc:648] HybridClock initialized: now 1786200883425401 us; error 46 us; skew 500 ppm
I20260808 14:54:43.425760 14835 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:54:43 dist-test-slave-6k22 krb5kdc[14422](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200883, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:54:43.428865 14835 init.cc:377] Logged in from keytab as kudu/127.26.206.195@KRBTEST.COM (short username kudu)
I20260808 14:54:43.430344 14835 webserver.cc:460] Webserver started at http://127.26.206.195:43851/ using document root <none> and password file <none>
I20260808 14:54:43.430969 14835 fs_manager.cc:359] Metadata directory not provided
I20260808 14:54:43.431066 14835 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:54:43.431304 14835 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:54:43.434128 14835 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200577490656-27451-0/minicluster-data/ts-2/data/instance:
uuid: "99eeafc0fde84458861039b41acbd9ad"
format_stamp: "Formatted at 2026-08-08 14:54:43 on dist-test-slave-6k22"
server_key: "e8ed49b1a7116077d0c0ae8d71d8c58e"
server_key_iv: "13923ef411860b64a34db24a7c0721d9"
server_key_version: "encryptionkey@0"
I20260808 14:54:43.434927 14835 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200577490656-27451-0/minicluster-data/ts-2/wal/instance:
uuid: "99eeafc0fde84458861039b41acbd9ad"
format_stamp: "Formatted at 2026-08-08 14:54:43 on dist-test-slave-6k22"
server_key: "e8ed49b1a7116077d0c0ae8d71d8c58e"
server_key_iv: "13923ef411860b64a34db24a7c0721d9"
server_key_version: "encryptionkey@0"
I20260808 14:54:43.440099 14835 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260808 14:54:43.443404 14850 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:54:43.444682 14835 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 14:54:43.444864 14835 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200577490656-27451-0/minicluster-data/ts-2/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200577490656-27451-0/minicluster-data/ts-2/wal
uuid: "99eeafc0fde84458861039b41acbd9ad"
format_stamp: "Formatted at 2026-08-08 14:54:43 on dist-test-slave-6k22"
server_key: "e8ed49b1a7116077d0c0ae8d71d8c58e"
server_key_iv: "13923ef411860b64a34db24a7c0721d9"
server_key_version: "encryptionkey@0"
I20260808 14:54:43.445048 14835 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200577490656-27451-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200577490656-27451-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200577490656-27451-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:54:43.453938 14684 heartbeater.cc:503] Master 127.26.206.254:39155 was elected leader, sending a full tablet report...
I20260808 14:54:43.457100 14835 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:54:43.460901 14835 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:54:43.461238 14835 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:54:43.462172 14835 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:54:43.463429 14835 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:54:43.463505 14835 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:54:43.463675 14835 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:54:43.463725 14835 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:54:43.497406 14835 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.195:37371
I20260808 14:54:43.497450 14973 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.195:37371 every 8 connection(s)
I20260808 14:54:43.498674 14835 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200577490656-27451-0/minicluster-data/ts-2/data/info.pb
I20260808 14:54:43.508726 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 14835
I20260808 14:54:43.508932 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200577490656-27451-0/minicluster-data/ts-2/wal/instance
I20260808 14:54:43.509596 27451 external_mini_cluster.cc:1428] Setting key c2c7639b8d3b4a5dfaea84a75bf2efa4
Aug 08 14:54:43 dist-test-slave-6k22 krb5kdc[14422](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200883, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.195@KRBTEST.COM for kudu/127.26.206.254@KRBTEST.COM
I20260808 14:54:43.519891 14976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:43.501405 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.195:38439 (local address 127.26.206.254:39155)
0808 14:54:43.501844 (+ 439us) server_negotiation.cc:206] Beginning negotiation
0808 14:54:43.501849 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:54:43.502800 (+ 951us) server_negotiation.cc:407] Connection header received
0808 14:54:43.504923 (+ 2123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:54:43.504929 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:54:43.505018 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:54:43.505138 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:54:43.506592 (+ 1454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:43.507371 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:43.509516 (+ 2145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:43.509969 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:43.510065 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:43.514051 (+ 3986us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:54:43.514055 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:54:43.514059 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:54:43.514099 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:54:43.516883 (+ 2784us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:54:43.517583 (+ 700us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:54:43.517591 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:54:43.517598 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:54:43.517824 (+ 226us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:54:43.518231 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:54:43.518235 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:54:43.518236 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:54:43.518534 (+ 298us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:54:43.518659 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0808 14:54:43.519355 (+ 696us) server_negotiation.cc:299] Negotiation successful
0808 14:54:43.519518 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":328,"thread_start_us":205,"threads_started":1}
I20260808 14:54:43.520718 14977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:43.501939 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:39155 (local address 127.26.206.195:38439)
0808 14:54:43.502642 (+ 703us) negotiation.cc:107] Waiting for socket to connect
0808 14:54:43.502679 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0808 14:54:43.504627 (+ 1948us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:54:43.505367 (+ 740us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:54:43.505375 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:54:43.505867 (+ 492us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:54:43.506410 (+ 543us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:54:43.506426 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:54:43.507534 (+ 1108us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:54:43.507538 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:54:43.509324 (+ 1786us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:54:43.509340 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:54:43.510182 (+ 842us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:54:43.510187 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:54:43.510377 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:43.511115 (+ 738us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:54:43.511136 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:54:43.513856 (+ 2720us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:54:43.517004 (+ 3148us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:54:43.517010 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:54:43.517021 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:54:43.517457 (+ 436us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:54:43.517944 (+ 487us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:54:43.517947 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:54:43.517949 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:54:43.518122 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:54:43.518642 (+ 520us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:54:43.518648 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:54:43.519001 (+ 353us) client_negotiation.cc:769] Sending connection context
0808 14:54:43.519220 (+ 219us) client_negotiation.cc:240] Negotiation successful
0808 14:54:43.519646 (+ 426us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":479,"thread_start_us":279,"threads_started":1}
I20260808 14:54:43.522111 14974 heartbeater.cc:347] Connected to a master server at 127.26.206.254:39155
I20260808 14:54:43.522420 14974 heartbeater.cc:464] Registering TS with master...
I20260808 14:54:43.523087 14974 heartbeater.cc:511] Master 127.26.206.254:39155 requested a full tablet report, sending...
I20260808 14:54:43.524616 14473 ts_manager.cc:194] Registered new tserver with Master: 99eeafc0fde84458861039b41acbd9ad (127.26.206.195:37371)
I20260808 14:54:43.525408 27451 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 14:54:43.525548 14473 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.206.195@KRBTEST.COM'} at 127.26.206.195:38439
I20260808 14:54:43.543068 14976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:43.530764 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45546 (local address 127.26.206.254:39155)
0808 14:54:43.530922 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0808 14:54:43.530926 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:54:43.531468 (+ 542us) server_negotiation.cc:407] Connection header received
0808 14:54:43.531656 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:54:43.531665 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:54:43.531721 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:54:43.531799 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:54:43.533334 (+ 1535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:43.534022 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:43.535459 (+ 1437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:43.535896 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:43.535989 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:43.538293 (+ 2304us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:54:43.538297 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:54:43.538300 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:54:43.538335 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:54:43.540860 (+ 2525us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:54:43.541497 (+ 637us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:54:43.541500 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:54:43.541503 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:54:43.541612 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:54:43.541946 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:54:43.541949 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:54:43.541950 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:54:43.542234 (+ 284us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:54:43.542431 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0808 14:54:43.542702 (+ 271us) server_negotiation.cc:299] Negotiation successful
0808 14:54:43.542855 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260808 14:54:43.546921 14473 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45546:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:54:43.553930 14473 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:54:43.596060 14989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:43.565683 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58542 (local address 127.26.206.195:37371)
0808 14:54:43.588843 (+ 23160us) server_negotiation.cc:206] Beginning negotiation
0808 14:54:43.588853 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 14:54:43.588889 (+ 36us) server_negotiation.cc:407] Connection header received
0808 14:54:43.588984 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:54:43.588994 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:54:43.589255 (+ 261us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:54:43.589475 (+ 220us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:54:43.590352 (+ 877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:43.591705 (+ 1353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:43.593619 (+ 1914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:43.594842 (+ 1223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:43.595057 (+ 215us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:43.595234 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0808 14:54:43.595487 (+ 253us) server_negotiation.cc:299] Negotiation successful
0808 14:54:43.595679 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22976,"thread_start_us":22816,"threads_started":1}
I20260808 14:54:43.596159 14988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:43.565450 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.195:37371 (local address 127.0.0.1:58542)
0808 14:54:43.581642 (+ 16192us) negotiation.cc:107] Waiting for socket to connect
0808 14:54:43.581716 (+ 74us) client_negotiation.cc:174] Beginning negotiation
0808 14:54:43.581961 (+ 245us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:54:43.589777 (+ 7816us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:54:43.589781 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:54:43.589805 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:54:43.590147 (+ 342us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:54:43.590158 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:54:43.591859 (+ 1701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:54:43.591866 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:54:43.593411 (+ 1545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:54:43.593425 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:54:43.595039 (+ 1614us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:54:43.595046 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:54:43.595227 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:43.595292 (+ 65us) client_negotiation.cc:769] Sending connection context
0808 14:54:43.595446 (+ 154us) client_negotiation.cc:240] Negotiation successful
0808 14:54:43.595682 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15833,"mutex_wait_us":42,"thread_start_us":15658,"threads_started":1}
I20260808 14:54:43.596689 14992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:43.565937 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.194:43139 (local address 127.0.0.1:40748)
0808 14:54:43.584867 (+ 18930us) negotiation.cc:107] Waiting for socket to connect
0808 14:54:43.584898 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0808 14:54:43.585055 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:54:43.588251 (+ 3196us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:54:43.588263 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:54:43.588325 (+ 62us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:54:43.588810 (+ 485us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:54:43.588824 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:54:43.590681 (+ 1857us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:54:43.590687 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:54:43.593289 (+ 2602us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:54:43.593306 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:54:43.595626 (+ 2320us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:54:43.595633 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:54:43.595914 (+ 281us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:43.596032 (+ 118us) client_negotiation.cc:769] Sending connection context
0808 14:54:43.596131 (+ 99us) client_negotiation.cc:240] Negotiation successful
0808 14:54:43.596273 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":18748,"mutex_wait_us":149,"thread_start_us":20969,"threads_started":1}
I20260808 14:54:43.596915 14993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:43.568323 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35892 (local address 127.26.206.193:43767)
0808 14:54:43.584302 (+ 15979us) server_negotiation.cc:206] Beginning negotiation
0808 14:54:43.584317 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 14:54:43.587295 (+ 2978us) server_negotiation.cc:407] Connection header received
0808 14:54:43.587631 (+ 336us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:54:43.587646 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:54:43.587943 (+ 297us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:54:43.588126 (+ 183us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:54:43.589281 (+ 1155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:43.590932 (+ 1651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:43.593616 (+ 2684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:43.595034 (+ 1418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:43.595232 (+ 198us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:43.595380 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0808 14:54:43.596384 (+ 1004us) server_negotiation.cc:299] Negotiation successful
0808 14:54:43.596559 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15733,"thread_start_us":15538,"threads_started":1}
I20260808 14:54:43.597111 14991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:43.566112 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40748 (local address 127.26.206.194:43139)
0808 14:54:43.587550 (+ 21438us) server_negotiation.cc:206] Beginning negotiation
0808 14:54:43.587592 (+ 42us) server_negotiation.cc:399] Waiting for connection header
0808 14:54:43.587621 (+ 29us) server_negotiation.cc:407] Connection header received
0808 14:54:43.587709 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:54:43.587715 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:54:43.587928 (+ 213us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:54:43.588142 (+ 214us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:54:43.588988 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:43.590538 (+ 1550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:43.593538 (+ 3000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:43.595046 (+ 1508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:43.595215 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:43.595380 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0808 14:54:43.596649 (+ 1269us) server_negotiation.cc:299] Negotiation successful
0808 14:54:43.596833 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21249,"thread_start_us":21136,"threads_started":1}
I20260808 14:54:43.600586 14901 tablet_service.cc:1467] Processing CreateTablet for tablet 96bdd3e1390b421ca4a9f508ed7585c4 (DEFAULT_TABLE table=test-table [id=a98817918fb74edabb2d4742a04ae0e1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:54:43.600586 14756 tablet_service.cc:1467] Processing CreateTablet for tablet 96bdd3e1390b421ca4a9f508ed7585c4 (DEFAULT_TABLE table=test-table [id=a98817918fb74edabb2d4742a04ae0e1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:54:43.601791 14756 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 96bdd3e1390b421ca4a9f508ed7585c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:54:43.601800 14901 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 96bdd3e1390b421ca4a9f508ed7585c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:54:43.604698 14990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:43.567539 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.193:43767 (local address 127.0.0.1:35892)
0808 14:54:43.587162 (+ 19623us) negotiation.cc:107] Waiting for socket to connect
0808 14:54:43.587184 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 14:54:43.587400 (+ 216us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:54:43.588447 (+ 1047us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:54:43.588453 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:54:43.588489 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:54:43.589049 (+ 560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:54:43.589062 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:54:43.591089 (+ 2027us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:54:43.591094 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:54:43.593431 (+ 2337us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:54:43.593460 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:54:43.595584 (+ 2124us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:54:43.595593 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:54:43.595917 (+ 324us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:43.596039 (+ 122us) client_negotiation.cc:769] Sending connection context
0808 14:54:43.596131 (+ 92us) client_negotiation.cc:240] Negotiation successful
0808 14:54:43.596274 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":19499,"mutex_wait_us":161,"thread_start_us":16911,"threads_started":1}
I20260808 14:54:43.608520 14609 tablet_service.cc:1467] Processing CreateTablet for tablet 96bdd3e1390b421ca4a9f508ed7585c4 (DEFAULT_TABLE table=test-table [id=a98817918fb74edabb2d4742a04ae0e1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:54:43.609962 14609 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 96bdd3e1390b421ca4a9f508ed7585c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:54:43.613343 14994 tablet_bootstrap.cc:492] T 96bdd3e1390b421ca4a9f508ed7585c4 P a1b1cfec0fae4fd7875feb9481624ad9: Bootstrap starting.
I20260808 14:54:43.615211 14995 tablet_bootstrap.cc:492] T 96bdd3e1390b421ca4a9f508ed7585c4 P 99eeafc0fde84458861039b41acbd9ad: Bootstrap starting.
I20260808 14:54:43.617156 14994 tablet_bootstrap.cc:654] T 96bdd3e1390b421ca4a9f508ed7585c4 P a1b1cfec0fae4fd7875feb9481624ad9: Neither blocks nor log segments found. Creating new log.
I20260808 14:54:43.618462 14994 log.cc:824] T 96bdd3e1390b421ca4a9f508ed7585c4 P a1b1cfec0fae4fd7875feb9481624ad9: Log is configured to *not* fsync() on all Append() calls
I20260808 14:54:43.618834 14995 tablet_bootstrap.cc:654] T 96bdd3e1390b421ca4a9f508ed7585c4 P 99eeafc0fde84458861039b41acbd9ad: Neither blocks nor log segments found. Creating new log.
I20260808 14:54:43.620434 14995 log.cc:824] T 96bdd3e1390b421ca4a9f508ed7585c4 P 99eeafc0fde84458861039b41acbd9ad: Log is configured to *not* fsync() on all Append() calls
I20260808 14:54:43.623121 14994 tablet_bootstrap.cc:492] T 96bdd3e1390b421ca4a9f508ed7585c4 P a1b1cfec0fae4fd7875feb9481624ad9: No bootstrap required, opened a new log
I20260808 14:54:43.623472 14999 tablet_bootstrap.cc:492] T 96bdd3e1390b421ca4a9f508ed7585c4 P 2ef6e53a7f944f81898a650cf1e20577: Bootstrap starting.
I20260808 14:54:43.623525 14994 ts_tablet_manager.cc:1397] T 96bdd3e1390b421ca4a9f508ed7585c4 P a1b1cfec0fae4fd7875feb9481624ad9: Time spent bootstrapping tablet: real 0.010s user 0.004s sys 0.005s
I20260808 14:54:43.626389 14999 tablet_bootstrap.cc:654] T 96bdd3e1390b421ca4a9f508ed7585c4 P 2ef6e53a7f944f81898a650cf1e20577: Neither blocks nor log segments found. Creating new log.
I20260808 14:54:43.626397 14995 tablet_bootstrap.cc:492] T 96bdd3e1390b421ca4a9f508ed7585c4 P 99eeafc0fde84458861039b41acbd9ad: No bootstrap required, opened a new log
I20260808 14:54:43.626660 14995 ts_tablet_manager.cc:1397] T 96bdd3e1390b421ca4a9f508ed7585c4 P 99eeafc0fde84458861039b41acbd9ad: Time spent bootstrapping tablet: real 0.012s user 0.006s sys 0.003s
I20260808 14:54:43.627506 14999 log.cc:824] T 96bdd3e1390b421ca4a9f508ed7585c4 P 2ef6e53a7f944f81898a650cf1e20577: Log is configured to *not* fsync() on all Append() calls
I20260808 14:54:43.630097 14999 tablet_bootstrap.cc:492] T 96bdd3e1390b421ca4a9f508ed7585c4 P 2ef6e53a7f944f81898a650cf1e20577: No bootstrap required, opened a new log
I20260808 14:54:43.630357 14999 ts_tablet_manager.cc:1397] T 96bdd3e1390b421ca4a9f508ed7585c4 P 2ef6e53a7f944f81898a650cf1e20577: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260808 14:54:43.634953 14994 raft_consensus.cc:348] T 96bdd3e1390b421ca4a9f508ed7585c4 P a1b1cfec0fae4fd7875feb9481624ad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99eeafc0fde84458861039b41acbd9ad" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 37371 } } peers { permanent_uuid: "a1b1cfec0fae4fd7875feb9481624ad9" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 43139 } } peers { permanent_uuid: "2ef6e53a7f944f81898a650cf1e20577" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 43767 } }
I20260808 14:54:43.635421 14994 raft_consensus.cc:374] T 96bdd3e1390b421ca4a9f508ed7585c4 P a1b1cfec0fae4fd7875feb9481624ad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:54:43.635578 14994 raft_consensus.cc:729] T 96bdd3e1390b421ca4a9f508ed7585c4 P a1b1cfec0fae4fd7875feb9481624ad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1b1cfec0fae4fd7875feb9481624ad9, State: Initialized, Role: FOLLOWER
I20260808 14:54:43.636261 14994 consensus_queue.cc:260] T 96bdd3e1390b421ca4a9f508ed7585c4 P a1b1cfec0fae4fd7875feb9481624ad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99eeafc0fde84458861039b41acbd9ad" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 37371 } } peers { permanent_uuid: "a1b1cfec0fae4fd7875feb9481624ad9" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 43139 } } peers { permanent_uuid: "2ef6e53a7f944f81898a650cf1e20577" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 43767 } }
I20260808 14:54:43.637383 14828 heartbeater.cc:503] Master 127.26.206.254:39155 was elected leader, sending a full tablet report...
I20260808 14:54:43.637527 14995 raft_consensus.cc:348] T 96bdd3e1390b421ca4a9f508ed7585c4 P 99eeafc0fde84458861039b41acbd9ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99eeafc0fde84458861039b41acbd9ad" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 37371 } } peers { permanent_uuid: "a1b1cfec0fae4fd7875feb9481624ad9" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 43139 } } peers { permanent_uuid: "2ef6e53a7f944f81898a650cf1e20577" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 43767 } }
I20260808 14:54:43.637969 14995 raft_consensus.cc:374] T 96bdd3e1390b421ca4a9f508ed7585c4 P 99eeafc0fde84458861039b41acbd9ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:54:43.638073 14995 raft_consensus.cc:729] T 96bdd3e1390b421ca4a9f508ed7585c4 P 99eeafc0fde84458861039b41acbd9ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99eeafc0fde84458861039b41acbd9ad, State: Initialized, Role: FOLLOWER
I20260808 14:54:43.638161 14994 ts_tablet_manager.cc:1428] T 96bdd3e1390b421ca4a9f508ed7585c4 P a1b1cfec0fae4fd7875feb9481624ad9: Time spent starting tablet: real 0.014s user 0.006s sys 0.006s
I20260808 14:54:43.638842 14995 consensus_queue.cc:260] T 96bdd3e1390b421ca4a9f508ed7585c4 P 99eeafc0fde84458861039b41acbd9ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99eeafc0fde84458861039b41acbd9ad" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 37371 } } peers { permanent_uuid: "a1b1cfec0fae4fd7875feb9481624ad9" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 43139 } } peers { permanent_uuid: "2ef6e53a7f944f81898a650cf1e20577" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 43767 } }
I20260808 14:54:43.639505 14999 raft_consensus.cc:348] T 96bdd3e1390b421ca4a9f508ed7585c4 P 2ef6e53a7f944f81898a650cf1e20577 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99eeafc0fde84458861039b41acbd9ad" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 37371 } } peers { permanent_uuid: "a1b1cfec0fae4fd7875feb9481624ad9" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 43139 } } peers { permanent_uuid: "2ef6e53a7f944f81898a650cf1e20577" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 43767 } }
I20260808 14:54:43.640003 14999 raft_consensus.cc:374] T 96bdd3e1390b421ca4a9f508ed7585c4 P 2ef6e53a7f944f81898a650cf1e20577 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:54:43.640110 14999 raft_consensus.cc:729] T 96bdd3e1390b421ca4a9f508ed7585c4 P 2ef6e53a7f944f81898a650cf1e20577 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ef6e53a7f944f81898a650cf1e20577, State: Initialized, Role: FOLLOWER
I20260808 14:54:43.640760 14995 ts_tablet_manager.cc:1428] T 96bdd3e1390b421ca4a9f508ed7585c4 P 99eeafc0fde84458861039b41acbd9ad: Time spent starting tablet: real 0.014s user 0.013s sys 0.002s
I20260808 14:54:43.640703 14999 consensus_queue.cc:260] T 96bdd3e1390b421ca4a9f508ed7585c4 P 2ef6e53a7f944f81898a650cf1e20577 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99eeafc0fde84458861039b41acbd9ad" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 37371 } } peers { permanent_uuid: "a1b1cfec0fae4fd7875feb9481624ad9" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 43139 } } peers { permanent_uuid: "2ef6e53a7f944f81898a650cf1e20577" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 43767 } }
I20260808 14:54:43.641176 14974 heartbeater.cc:503] Master 127.26.206.254:39155 was elected leader, sending a full tablet report...
I20260808 14:54:43.642441 14999 ts_tablet_manager.cc:1428] T 96bdd3e1390b421ca4a9f508ed7585c4 P 2ef6e53a7f944f81898a650cf1e20577: Time spent starting tablet: real 0.012s user 0.013s sys 0.000s
I20260808 14:54:43.664201 15002 raft_consensus.cc:482] T 96bdd3e1390b421ca4a9f508ed7585c4 P 99eeafc0fde84458861039b41acbd9ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:54:43.664495 15002 raft_consensus.cc:504] T 96bdd3e1390b421ca4a9f508ed7585c4 P 99eeafc0fde84458861039b41acbd9ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99eeafc0fde84458861039b41acbd9ad" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 37371 } } peers { permanent_uuid: "a1b1cfec0fae4fd7875feb9481624ad9" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 43139 } } peers { permanent_uuid: "2ef6e53a7f944f81898a650cf1e20577" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 43767 } }
I20260808 14:54:43.666092 15002 leader_election.cc:288] T 96bdd3e1390b421ca4a9f508ed7585c4 P 99eeafc0fde84458861039b41acbd9ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1b1cfec0fae4fd7875feb9481624ad9 (127.26.206.194:43139), 2ef6e53a7f944f81898a650cf1e20577 (127.26.206.193:43767)
I20260808 14:54:43.672231 14991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:43.666531 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.195:58317 (local address 127.26.206.194:43139)
0808 14:54:43.666731 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0808 14:54:43.666739 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:54:43.667066 (+ 327us) server_negotiation.cc:407] Connection header received
0808 14:54:43.667280 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:54:43.667284 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:54:43.667341 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:54:43.667445 (+ 104us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:54:43.667875 (+ 430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:43.668809 (+ 934us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:43.670501 (+ 1692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:43.671278 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:43.671445 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:43.671514 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0808 14:54:43.671847 (+ 333us) server_negotiation.cc:299] Negotiation successful
0808 14:54:43.671970 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260808 14:54:43.672361 14977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:43.666527 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.194:43139 (local address 127.26.206.195:58317)
0808 14:54:43.666941 (+ 414us) negotiation.cc:107] Waiting for socket to connect
0808 14:54:43.666965 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0808 14:54:43.667118 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:54:43.667467 (+ 349us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:54:43.667471 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:54:43.667505 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:54:43.667732 (+ 227us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:54:43.667741 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:54:43.668948 (+ 1207us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:54:43.668959 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:54:43.670345 (+ 1386us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:54:43.670357 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:54:43.671425 (+ 1068us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:54:43.671430 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:54:43.671669 (+ 239us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:43.671697 (+ 28us) client_negotiation.cc:769] Sending connection context
0808 14:54:43.671819 (+ 122us) client_negotiation.cc:240] Negotiation successful
0808 14:54:43.671947 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":231,"mutex_wait_us":26}
I20260808 14:54:43.672421 14993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:43.666558 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.195:49621 (local address 127.26.206.193:43767)
0808 14:54:43.666775 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0808 14:54:43.666783 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:54:43.667427 (+ 644us) server_negotiation.cc:407] Connection header received
0808 14:54:43.667620 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:54:43.667631 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:54:43.667684 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:54:43.667774 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:54:43.668332 (+ 558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:43.669008 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:43.670714 (+ 1706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:43.671478 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:43.671668 (+ 190us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:43.671739 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0808 14:54:43.672006 (+ 267us) server_negotiation.cc:299] Negotiation successful
0808 14:54:43.672132 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260808 14:54:43.672741 15004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:43.666569 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.193:43767 (local address 127.26.206.195:49621)
0808 14:54:43.667323 (+ 754us) negotiation.cc:107] Waiting for socket to connect
0808 14:54:43.667336 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 14:54:43.667464 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:54:43.667799 (+ 335us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:54:43.667803 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:54:43.667826 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:54:43.668158 (+ 332us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:54:43.668166 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:54:43.669172 (+ 1006us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:54:43.669177 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:54:43.670553 (+ 1376us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:54:43.670565 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:54:43.671696 (+ 1131us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:54:43.671702 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:54:43.671853 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:43.671875 (+ 22us) client_negotiation.cc:769] Sending connection context
0808 14:54:43.671980 (+ 105us) client_negotiation.cc:240] Negotiation successful
0808 14:54:43.672177 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":648,"thread_start_us":449,"threads_started":1}
I20260808 14:54:43.673491 14781 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "96bdd3e1390b421ca4a9f508ed7585c4" candidate_uuid: "99eeafc0fde84458861039b41acbd9ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1b1cfec0fae4fd7875feb9481624ad9" is_pre_election: true
I20260808 14:54:43.673621 14634 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "96bdd3e1390b421ca4a9f508ed7585c4" candidate_uuid: "99eeafc0fde84458861039b41acbd9ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ef6e53a7f944f81898a650cf1e20577" is_pre_election: true
I20260808 14:54:43.673982 14781 raft_consensus.cc:2454] T 96bdd3e1390b421ca4a9f508ed7585c4 P a1b1cfec0fae4fd7875feb9481624ad9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99eeafc0fde84458861039b41acbd9ad in term 0.
I20260808 14:54:43.674142 14634 raft_consensus.cc:2454] T 96bdd3e1390b421ca4a9f508ed7585c4 P 2ef6e53a7f944f81898a650cf1e20577 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99eeafc0fde84458861039b41acbd9ad in term 0.
I20260808 14:54:43.674651 14852 leader_election.cc:302] T 96bdd3e1390b421ca4a9f508ed7585c4 P 99eeafc0fde84458861039b41acbd9ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99eeafc0fde84458861039b41acbd9ad, a1b1cfec0fae4fd7875feb9481624ad9; no voters:
I20260808 14:54:43.675034 15002 raft_consensus.cc:2781] T 96bdd3e1390b421ca4a9f508ed7585c4 P 99eeafc0fde84458861039b41acbd9ad [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260808 14:54:43.675100 14686 tablet.cc:2369] T 96bdd3e1390b421ca4a9f508ed7585c4 P 2ef6e53a7f944f81898a650cf1e20577: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:54:43.675194 15002 raft_consensus.cc:482] T 96bdd3e1390b421ca4a9f508ed7585c4 P 99eeafc0fde84458861039b41acbd9ad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:54:43.675300 15002 raft_consensus.cc:3037] T 96bdd3e1390b421ca4a9f508ed7585c4 P 99eeafc0fde84458861039b41acbd9ad [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:54:43.677474 15002 raft_consensus.cc:504] T 96bdd3e1390b421ca4a9f508ed7585c4 P 99eeafc0fde84458861039b41acbd9ad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99eeafc0fde84458861039b41acbd9ad" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 37371 } } peers { permanent_uuid: "a1b1cfec0fae4fd7875feb9481624ad9" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 43139 } } peers { permanent_uuid: "2ef6e53a7f944f81898a650cf1e20577" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 43767 } }
I20260808 14:54:43.678035 15002 leader_election.cc:288] T 96bdd3e1390b421ca4a9f508ed7585c4 P 99eeafc0fde84458861039b41acbd9ad [CANDIDATE]: Term 1 election: Requested vote from peers a1b1cfec0fae4fd7875feb9481624ad9 (127.26.206.194:43139), 2ef6e53a7f944f81898a650cf1e20577 (127.26.206.193:43767)
I20260808 14:54:43.678406 14781 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "96bdd3e1390b421ca4a9f508ed7585c4" candidate_uuid: "99eeafc0fde84458861039b41acbd9ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1b1cfec0fae4fd7875feb9481624ad9"
I20260808 14:54:43.678583 14781 raft_consensus.cc:3037] T 96bdd3e1390b421ca4a9f508ed7585c4 P a1b1cfec0fae4fd7875feb9481624ad9 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:54:43.678574 14634 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "96bdd3e1390b421ca4a9f508ed7585c4" candidate_uuid: "99eeafc0fde84458861039b41acbd9ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ef6e53a7f944f81898a650cf1e20577"
I20260808 14:54:43.678771 14634 raft_consensus.cc:3037] T 96bdd3e1390b421ca4a9f508ed7585c4 P 2ef6e53a7f944f81898a650cf1e20577 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:54:43.681289 14781 raft_consensus.cc:2454] T 96bdd3e1390b421ca4a9f508ed7585c4 P a1b1cfec0fae4fd7875feb9481624ad9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99eeafc0fde84458861039b41acbd9ad in term 1.
I20260808 14:54:43.681324 14634 raft_consensus.cc:2454] T 96bdd3e1390b421ca4a9f508ed7585c4 P 2ef6e53a7f944f81898a650cf1e20577 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99eeafc0fde84458861039b41acbd9ad in term 1.
I20260808 14:54:43.681720 14852 leader_election.cc:302] T 96bdd3e1390b421ca4a9f508ed7585c4 P 99eeafc0fde84458861039b41acbd9ad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99eeafc0fde84458861039b41acbd9ad, a1b1cfec0fae4fd7875feb9481624ad9; no voters:
I20260808 14:54:43.682116 15002 raft_consensus.cc:2781] T 96bdd3e1390b421ca4a9f508ed7585c4 P 99eeafc0fde84458861039b41acbd9ad [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:54:43.682569 15002 raft_consensus.cc:686] T 96bdd3e1390b421ca4a9f508ed7585c4 P 99eeafc0fde84458861039b41acbd9ad [term 1 LEADER]: Becoming Leader. State: Replica: 99eeafc0fde84458861039b41acbd9ad, State: Running, Role: LEADER
I20260808 14:54:43.683087 15002 consensus_queue.cc:237] T 96bdd3e1390b421ca4a9f508ed7585c4 P 99eeafc0fde84458861039b41acbd9ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99eeafc0fde84458861039b41acbd9ad" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 37371 } } peers { permanent_uuid: "a1b1cfec0fae4fd7875feb9481624ad9" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 43139 } } peers { permanent_uuid: "2ef6e53a7f944f81898a650cf1e20577" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 43767 } }
I20260808 14:54:43.687438 14472 catalog_manager.cc:5495] T 96bdd3e1390b421ca4a9f508ed7585c4 P 99eeafc0fde84458861039b41acbd9ad reported cstate change: term changed from 0 to 1, leader changed from <none> to 99eeafc0fde84458861039b41acbd9ad (127.26.206.195). New cstate: current_term: 1 leader_uuid: "99eeafc0fde84458861039b41acbd9ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99eeafc0fde84458861039b41acbd9ad" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 37371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1b1cfec0fae4fd7875feb9481624ad9" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 43139 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2ef6e53a7f944f81898a650cf1e20577" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 43767 } health_report { overall_health: UNKNOWN } } }
W20260808 14:54:43.708725 14829 tablet.cc:2369] T 96bdd3e1390b421ca4a9f508ed7585c4 P a1b1cfec0fae4fd7875feb9481624ad9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:54:43.716209 14989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:43.711106 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58556 (local address 127.26.206.195:37371)
0808 14:54:43.711287 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0808 14:54:43.711292 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:54:43.711308 (+ 16us) server_negotiation.cc:407] Connection header received
0808 14:54:43.711387 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:54:43.711391 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:54:43.711473 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:54:43.711694 (+ 221us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:54:43.712064 (+ 370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:43.712883 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:43.714262 (+ 1379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:43.714659 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:43.714751 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:43.715186 (+ 435us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:54:43.715739 (+ 553us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:54:43.715859 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0808 14:54:43.715955 (+ 96us) server_negotiation.cc:299] Negotiation successful
0808 14:54:43.716018 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260808 14:54:43.724301 14634 raft_consensus.cc:1261] T 96bdd3e1390b421ca4a9f508ed7585c4 P 2ef6e53a7f944f81898a650cf1e20577 [term 1 FOLLOWER]: Refusing update from remote peer 99eeafc0fde84458861039b41acbd9ad: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:54:43.724373 14781 raft_consensus.cc:1261] T 96bdd3e1390b421ca4a9f508ed7585c4 P a1b1cfec0fae4fd7875feb9481624ad9 [term 1 FOLLOWER]: Refusing update from remote peer 99eeafc0fde84458861039b41acbd9ad: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:54:43.725255 15005 consensus_queue.cc:1035] T 96bdd3e1390b421ca4a9f508ed7585c4 P 99eeafc0fde84458861039b41acbd9ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b1cfec0fae4fd7875feb9481624ad9" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 43139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:54:43.725630 15002 consensus_queue.cc:1035] T 96bdd3e1390b421ca4a9f508ed7585c4 P 99eeafc0fde84458861039b41acbd9ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ef6e53a7f944f81898a650cf1e20577" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 43767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:54:43.754426 14472 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45546:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:54:43.754681 14472 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45546:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:54:43.758131 14472 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4ed12729ef804f5686f7568d811cdd7d: Sending DeleteTablet for 3 replicas of tablet 96bdd3e1390b421ca4a9f508ed7585c4
I20260808 14:54:43.759225 14901 tablet_service.cc:1514] Processing DeleteTablet for tablet 96bdd3e1390b421ca4a9f508ed7585c4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:54:43 UTC) from {username='kudu', principal='kudu/127.26.206.254@KRBTEST.COM'} at 127.0.0.1:58542
I20260808 14:54:43.759253 14756 tablet_service.cc:1514] Processing DeleteTablet for tablet 96bdd3e1390b421ca4a9f508ed7585c4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:54:43 UTC) from {username='kudu', principal='kudu/127.26.206.254@KRBTEST.COM'} at 127.0.0.1:40748
I20260808 14:54:43.759521 14609 tablet_service.cc:1514] Processing DeleteTablet for tablet 96bdd3e1390b421ca4a9f508ed7585c4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:54:43 UTC) from {username='kudu', principal='kudu/127.26.206.254@KRBTEST.COM'} at 127.0.0.1:35892
I20260808 14:54:43.760355 15020 tablet_replica.cc:330] T 96bdd3e1390b421ca4a9f508ed7585c4 P 99eeafc0fde84458861039b41acbd9ad: stopping tablet replica
I20260808 14:54:43.760878 15020 raft_consensus.cc:2229] T 96bdd3e1390b421ca4a9f508ed7585c4 P 99eeafc0fde84458861039b41acbd9ad [term 1 LEADER]: Raft consensus shutting down.
I20260808 14:54:43.761788 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 14541
I20260808 14:54:43.761826 15020 raft_consensus.cc:2258] T 96bdd3e1390b421ca4a9f508ed7585c4 P 99eeafc0fde84458861039b41acbd9ad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:54:43.764464 15020 ts_tablet_manager.cc:1905] T 96bdd3e1390b421ca4a9f508ed7585c4 P 99eeafc0fde84458861039b41acbd9ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:54:43.774372 15020 ts_tablet_manager.cc:1918] T 96bdd3e1390b421ca4a9f508ed7585c4 P 99eeafc0fde84458861039b41acbd9ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:54:43.774526 15022 tablet_replica.cc:330] T 96bdd3e1390b421ca4a9f508ed7585c4 P 2ef6e53a7f944f81898a650cf1e20577: stopping tablet replica
I20260808 14:54:43.774544 15020 log.cc:1196] T 96bdd3e1390b421ca4a9f508ed7585c4 P 99eeafc0fde84458861039b41acbd9ad: Deleting WAL directory at /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200577490656-27451-0/minicluster-data/ts-2/wal/wals/96bdd3e1390b421ca4a9f508ed7585c4
I20260808 14:54:43.774984 15022 raft_consensus.cc:2229] T 96bdd3e1390b421ca4a9f508ed7585c4 P 2ef6e53a7f944f81898a650cf1e20577 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:54:43.775431 15020 ts_tablet_manager.cc:1939] T 96bdd3e1390b421ca4a9f508ed7585c4 P 99eeafc0fde84458861039b41acbd9ad: Deleting consensus metadata
I20260808 14:54:43.775512 15022 raft_consensus.cc:2258] T 96bdd3e1390b421ca4a9f508ed7585c4 P 2ef6e53a7f944f81898a650cf1e20577 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:54:43.777347 14454 catalog_manager.cc:4841] TS 99eeafc0fde84458861039b41acbd9ad (127.26.206.195:37371): tablet 96bdd3e1390b421ca4a9f508ed7585c4 (table test-table [id=a98817918fb74edabb2d4742a04ae0e1]) successfully deleted
I20260808 14:54:43.778270 15022 ts_tablet_manager.cc:1905] T 96bdd3e1390b421ca4a9f508ed7585c4 P 2ef6e53a7f944f81898a650cf1e20577: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:54:43.785331 15022 ts_tablet_manager.cc:1918] T 96bdd3e1390b421ca4a9f508ed7585c4 P 2ef6e53a7f944f81898a650cf1e20577: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
Aug 08 14:54:43 dist-test-slave-6k22 krb5kdc[14422](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200881, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.206.193@KRBTEST.COM
I20260808 14:54:43.785485 15022 log.cc:1196] T 96bdd3e1390b421ca4a9f508ed7585c4 P 2ef6e53a7f944f81898a650cf1e20577: Deleting WAL directory at /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200577490656-27451-0/minicluster-data/ts-0/wal/wals/96bdd3e1390b421ca4a9f508ed7585c4
I20260808 14:54:43.786032 15022 ts_tablet_manager.cc:1939] T 96bdd3e1390b421ca4a9f508ed7585c4 P 2ef6e53a7f944f81898a650cf1e20577: Deleting consensus metadata
I20260808 14:54:43.787904 14457 catalog_manager.cc:4841] TS 2ef6e53a7f944f81898a650cf1e20577 (127.26.206.193:43767): tablet 96bdd3e1390b421ca4a9f508ed7585c4 (table test-table [id=a98817918fb74edabb2d4742a04ae0e1]) successfully deleted
I20260808 14:54:43.792153 15021 tablet_replica.cc:330] T 96bdd3e1390b421ca4a9f508ed7585c4 P a1b1cfec0fae4fd7875feb9481624ad9: stopping tablet replica
I20260808 14:54:43.792622 15021 raft_consensus.cc:2229] T 96bdd3e1390b421ca4a9f508ed7585c4 P a1b1cfec0fae4fd7875feb9481624ad9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:54:43.793115 15021 raft_consensus.cc:2258] T 96bdd3e1390b421ca4a9f508ed7585c4 P a1b1cfec0fae4fd7875feb9481624ad9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:54:43.794902 14993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:43.763527 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35908 (local address 127.26.206.193:43767)
0808 14:54:43.763757 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0808 14:54:43.763766 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:54:43.773610 (+ 9844us) server_negotiation.cc:407] Connection header received
0808 14:54:43.773825 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:54:43.773831 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:54:43.773956 (+ 125us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:54:43.774073 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:54:43.776632 (+ 2559us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:43.777828 (+ 1196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:43.779907 (+ 2079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:43.780593 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:43.780694 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:43.786941 (+ 6247us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:54:43.786955 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:54:43.786972 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:54:43.787013 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:54:43.791103 (+ 4090us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:54:43.792113 (+ 1010us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:54:43.792122 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:54:43.792125 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:54:43.792364 (+ 239us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:54:43.792865 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:54:43.792870 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:54:43.792874 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:54:43.793367 (+ 493us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:54:43.794130 (+ 763us) server_negotiation.cc:1035] Waiting for connection context
0808 14:54:43.794299 (+ 169us) server_negotiation.cc:299] Negotiation successful
0808 14:54:43.794502 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260808 14:54:43.795742 14678 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:54:43.799403 15021 ts_tablet_manager.cc:1905] T 96bdd3e1390b421ca4a9f508ed7585c4 P a1b1cfec0fae4fd7875feb9481624ad9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:54:43.806447 15021 ts_tablet_manager.cc:1918] T 96bdd3e1390b421ca4a9f508ed7585c4 P a1b1cfec0fae4fd7875feb9481624ad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:54:43.806602 15021 log.cc:1196] T 96bdd3e1390b421ca4a9f508ed7585c4 P a1b1cfec0fae4fd7875feb9481624ad9: Deleting WAL directory at /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200577490656-27451-0/minicluster-data/ts-1/wal/wals/96bdd3e1390b421ca4a9f508ed7585c4
I20260808 14:54:43.807153 15021 ts_tablet_manager.cc:1939] T 96bdd3e1390b421ca4a9f508ed7585c4 P a1b1cfec0fae4fd7875feb9481624ad9: Deleting consensus metadata
I20260808 14:54:43.808903 14455 catalog_manager.cc:4841] TS a1b1cfec0fae4fd7875feb9481624ad9 (127.26.206.194:43139): tablet 96bdd3e1390b421ca4a9f508ed7585c4 (table test-table [id=a98817918fb74edabb2d4742a04ae0e1]) successfully deleted
I20260808 14:54:43.885915 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 14541
I20260808 14:54:43.907053 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 14692
Aug 08 14:54:43 dist-test-slave-6k22 krb5kdc[14422](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200881, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.206.194@KRBTEST.COM
I20260808 14:54:43.922662 14991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:43.907824 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40750 (local address 127.26.206.194:43139)
0808 14:54:43.907994 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0808 14:54:43.907999 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:54:43.908221 (+ 222us) server_negotiation.cc:407] Connection header received
0808 14:54:43.908423 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:54:43.908429 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:54:43.908514 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:54:43.908621 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:54:43.909834 (+ 1213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:43.910555 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:43.912057 (+ 1502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:43.912526 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:43.912656 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:43.916859 (+ 4203us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:54:43.916872 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:54:43.916886 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:54:43.916915 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:54:43.919965 (+ 3050us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:54:43.920619 (+ 654us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:54:43.920635 (+ 16us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:54:43.920638 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:54:43.920756 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:54:43.921136 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:54:43.921142 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:54:43.921145 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:54:43.921504 (+ 359us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:54:43.921810 (+ 306us) server_negotiation.cc:1035] Waiting for connection context
0808 14:54:43.922108 (+ 298us) server_negotiation.cc:299] Negotiation successful
0808 14:54:43.922326 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260808 14:54:43.923404 14823 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:54:44.024039 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 14692
I20260808 14:54:44.044641 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 14835
Aug 08 14:54:44 dist-test-slave-6k22 krb5kdc[14422](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200881, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.206.195@KRBTEST.COM
I20260808 14:54:44.063103 14989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:44.045491 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58568 (local address 127.26.206.195:37371)
0808 14:54:44.045697 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0808 14:54:44.045703 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:54:44.045726 (+ 23us) server_negotiation.cc:407] Connection header received
0808 14:54:44.045867 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:54:44.045873 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:54:44.045965 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:54:44.046105 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:54:44.047549 (+ 1444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:44.048894 (+ 1345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:44.050307 (+ 1413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:44.051027 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:44.051163 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:44.055791 (+ 4628us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:54:44.055808 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:54:44.055828 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:54:44.055877 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:54:44.060167 (+ 4290us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:54:44.060832 (+ 665us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:54:44.060841 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:54:44.060845 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:54:44.061051 (+ 206us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:54:44.061430 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:54:44.061435 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:54:44.061438 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:54:44.061889 (+ 451us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:54:44.062277 (+ 388us) server_negotiation.cc:1035] Waiting for connection context
0808 14:54:44.062444 (+ 167us) server_negotiation.cc:299] Negotiation successful
0808 14:54:44.062675 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260808 14:54:44.063961 14969 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:54:44.186432 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 14835
I20260808 14:54:44.209115 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 14436
I20260808 14:54:44.210297 14505 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:54:44.321568 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 14436
2026-08-08T14:54:44Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (4525 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-08T14:54:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:54:44Z Disabled control of system clock
I20260808 14:54:44.417343 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200577490656-27451-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200577490656-27451-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200577490656-27451-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.206.254:40157
--webserver_interface=127.26.206.254
--webserver_port=0
--builtin_ntp_servers=127.26.206.212:33633
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.206.254:40157
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 14:54:44.753732 15031 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:54:44.754022 15031 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:54:44.754119 15031 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:54:44.761399 15031 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:54:44.761507 15031 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:54:44.761559 15031 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:54:44.761615 15031 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:54:44.761672 15031 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:54:44.770613 15031 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:33633
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200577490656-27451-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200577490656-27451-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.206.254:40157
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.206.254:40157
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.206.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200577490656-27451-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:54:44.771862 15031 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:54:44.773598 15031 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:54:44.785578 15036 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:54:44.785529 15039 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:54:44.785650 15037 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:54:44.786772 15031 server_base.cc:1034] running on GCE node
I20260808 14:54:44.787478 15031 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:54:44.788887 15031 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:54:44.790130 15031 hybrid_clock.cc:648] HybridClock initialized: now 1786200884790101 us; error 42 us; skew 500 ppm
I20260808 14:54:44.790454 15031 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 14:54:44.797021 15031 webserver.cc:460] Webserver started at http://127.26.206.254:40033/ using document root <none> and password file <none>
I20260808 14:54:44.797717 15031 fs_manager.cc:359] Metadata directory not provided
I20260808 14:54:44.797816 15031 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:54:44.798108 15031 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:54:44.801108 15031 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200577490656-27451-0/minicluster-data/master-0/data/instance:
uuid: "47a83eb0304c41faab27a01dba5630f2"
format_stamp: "Formatted at 2026-08-08 14:54:44 on dist-test-slave-6k22"
server_key: "9509cf019186fe597f08142def9be68f"
server_key_iv: "254900a8bb99a94b74ba5cc9e7736370"
server_key_version: "encryptionkey@0"
I20260808 14:54:44.801904 15031 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200577490656-27451-0/minicluster-data/master-0/wal/instance:
uuid: "47a83eb0304c41faab27a01dba5630f2"
format_stamp: "Formatted at 2026-08-08 14:54:44 on dist-test-slave-6k22"
server_key: "9509cf019186fe597f08142def9be68f"
server_key_iv: "254900a8bb99a94b74ba5cc9e7736370"
server_key_version: "encryptionkey@0"
I20260808 14:54:44.807118 15031 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260808 14:54:44.810555 15048 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:54:44.811936 15031 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 14:54:44.812135 15031 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200577490656-27451-0/minicluster-data/master-0/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200577490656-27451-0/minicluster-data/master-0/wal
uuid: "47a83eb0304c41faab27a01dba5630f2"
format_stamp: "Formatted at 2026-08-08 14:54:44 on dist-test-slave-6k22"
server_key: "9509cf019186fe597f08142def9be68f"
server_key_iv: "254900a8bb99a94b74ba5cc9e7736370"
server_key_version: "encryptionkey@0"
I20260808 14:54:44.812352 15031 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200577490656-27451-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200577490656-27451-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200577490656-27451-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:54:44.834110 15031 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:54:44.834968 15031 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:54:44.835310 15031 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:54:44.855113 15031 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.254:40157
I20260808 14:54:44.855119 15105 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.254:40157 every 8 connection(s)
I20260808 14:54:44.856530 15031 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
I20260808 14:54:44.860304 15106 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:54:44.862162 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 15031
I20260808 14:54:44.862378 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200577490656-27451-0/minicluster-data/master-0/wal/instance
I20260808 14:54:44.862888 27451 external_mini_cluster.cc:1428] Setting key bf23e52bbbacd47355223e07c5b1cca5
I20260808 14:54:44.871843 15106 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 47a83eb0304c41faab27a01dba5630f2: Bootstrap starting.
I20260808 14:54:44.875527 15106 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 47a83eb0304c41faab27a01dba5630f2: Neither blocks nor log segments found. Creating new log.
I20260808 14:54:44.876752 15106 log.cc:824] T 00000000000000000000000000000000 P 47a83eb0304c41faab27a01dba5630f2: Log is configured to *not* fsync() on all Append() calls
I20260808 14:54:44.877311 15110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:44.864926 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58144 (local address 127.26.206.254:40157)
0808 14:54:44.866035 (+ 1109us) server_negotiation.cc:206] Beginning negotiation
0808 14:54:44.866045 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 14:54:44.866090 (+ 45us) server_negotiation.cc:407] Connection header received
0808 14:54:44.867952 (+ 1862us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:54:44.867974 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:54:44.868446 (+ 472us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:54:44.868800 (+ 354us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:54:44.869406 (+ 606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:44.870861 (+ 1455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:44.872829 (+ 1968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:44.873492 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:44.873625 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:44.874875 (+ 1250us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:54:44.874882 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:54:44.874895 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:54:44.875402 (+ 507us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:54:44.875492 (+ 90us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:54:44.875528 (+ 36us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:54:44.875697 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0808 14:54:44.875915 (+ 218us) server_negotiation.cc:299] Negotiation successful
0808 14:54:44.876243 (+ 328us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":676,"thread_start_us":431,"threads_started":1}
I20260808 14:54:44.879722 15106 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 47a83eb0304c41faab27a01dba5630f2: No bootstrap required, opened a new log
I20260808 14:54:44.886639 15106 raft_consensus.cc:348] T 00000000000000000000000000000000 P 47a83eb0304c41faab27a01dba5630f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47a83eb0304c41faab27a01dba5630f2" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 40157 } }
I20260808 14:54:44.886986 15106 raft_consensus.cc:374] T 00000000000000000000000000000000 P 47a83eb0304c41faab27a01dba5630f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:54:44.887091 15106 raft_consensus.cc:729] T 00000000000000000000000000000000 P 47a83eb0304c41faab27a01dba5630f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47a83eb0304c41faab27a01dba5630f2, State: Initialized, Role: FOLLOWER
I20260808 14:54:44.887683 15106 consensus_queue.cc:260] T 00000000000000000000000000000000 P 47a83eb0304c41faab27a01dba5630f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47a83eb0304c41faab27a01dba5630f2" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 40157 } }
I20260808 14:54:44.887928 15106 raft_consensus.cc:388] T 00000000000000000000000000000000 P 47a83eb0304c41faab27a01dba5630f2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:54:44.888068 15106 raft_consensus.cc:482] T 00000000000000000000000000000000 P 47a83eb0304c41faab27a01dba5630f2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:54:44.888228 15106 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 47a83eb0304c41faab27a01dba5630f2 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:54:44.890283 15106 raft_consensus.cc:504] T 00000000000000000000000000000000 P 47a83eb0304c41faab27a01dba5630f2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47a83eb0304c41faab27a01dba5630f2" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 40157 } }
I20260808 14:54:44.890733 15106 leader_election.cc:302] T 00000000000000000000000000000000 P 47a83eb0304c41faab27a01dba5630f2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 47a83eb0304c41faab27a01dba5630f2; no voters:
I20260808 14:54:44.891297 15106 leader_election.cc:288] T 00000000000000000000000000000000 P 47a83eb0304c41faab27a01dba5630f2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:54:44.891494 15112 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 47a83eb0304c41faab27a01dba5630f2 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:54:44.892719 15112 raft_consensus.cc:686] T 00000000000000000000000000000000 P 47a83eb0304c41faab27a01dba5630f2 [term 1 LEADER]: Becoming Leader. State: Replica: 47a83eb0304c41faab27a01dba5630f2, State: Running, Role: LEADER
I20260808 14:54:44.893209 15112 consensus_queue.cc:237] T 00000000000000000000000000000000 P 47a83eb0304c41faab27a01dba5630f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47a83eb0304c41faab27a01dba5630f2" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 40157 } }
I20260808 14:54:44.893440 15106 sys_catalog.cc:564] T 00000000000000000000000000000000 P 47a83eb0304c41faab27a01dba5630f2 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:54:44.895879 15114 sys_catalog.cc:455] T 00000000000000000000000000000000 P 47a83eb0304c41faab27a01dba5630f2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 47a83eb0304c41faab27a01dba5630f2. Latest consensus state: current_term: 1 leader_uuid: "47a83eb0304c41faab27a01dba5630f2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47a83eb0304c41faab27a01dba5630f2" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 40157 } } }
I20260808 14:54:44.896358 15114 sys_catalog.cc:458] T 00000000000000000000000000000000 P 47a83eb0304c41faab27a01dba5630f2 [sys.catalog]: This master's current role is: LEADER
I20260808 14:54:44.896898 15113 sys_catalog.cc:455] T 00000000000000000000000000000000 P 47a83eb0304c41faab27a01dba5630f2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "47a83eb0304c41faab27a01dba5630f2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47a83eb0304c41faab27a01dba5630f2" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 40157 } } }
I20260808 14:54:44.897215 15113 sys_catalog.cc:458] T 00000000000000000000000000000000 P 47a83eb0304c41faab27a01dba5630f2 [sys.catalog]: This master's current role is: LEADER
I20260808 14:54:44.898514 15121 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:54:44.904385 15121 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:54:44.913241 15121 catalog_manager.cc:1347] Generated new cluster ID: f4c226a5c29344c7bbb8f2822faf8955
I20260808 14:54:44.913362 15121 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:54:44.932962 15121 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:54:44.934731 15121 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:54:44.953620 15121 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 47a83eb0304c41faab27a01dba5630f2: Generated new TSK 0
I20260808 14:54:44.954429 15121 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:54:44.959267 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200577490656-27451-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200577490656-27451-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200577490656-27451-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200577490656-27451-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.206.193:0
--local_ip_for_outbound_sockets=127.26.206.193
--webserver_interface=127.26.206.193
--webserver_port=0
--tserver_master_addrs=127.26.206.254:40157
--builtin_ntp_servers=127.26.206.212:33633
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 14:54:45.318087 15131 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:54:45.318353 15131 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:54:45.318544 15131 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:54:45.325646 15131 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:54:45.325737 15131 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:54:45.325942 15131 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.206.193
I20260808 14:54:45.335031 15131 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:33633
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200577490656-27451-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200577490656-27451-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.206.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200577490656-27451-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.206.193
--webserver_port=0
--tserver_master_addrs=127.26.206.254:40157
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.206.193
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200577490656-27451-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:54:45.336369 15131 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:54:45.338162 15131 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:54:45.351500 15137 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:54:45.351536 15138 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:54:45.351614 15140 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:54:45.352676 15131 server_base.cc:1034] running on GCE node
I20260808 14:54:45.353236 15131 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:54:45.354115 15131 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:54:45.355319 15131 hybrid_clock.cc:648] HybridClock initialized: now 1786200885355286 us; error 25 us; skew 500 ppm
I20260808 14:54:45.355690 15131 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 14:54:45.357800 15131 webserver.cc:460] Webserver started at http://127.26.206.193:35707/ using document root <none> and password file <none>
I20260808 14:54:45.358515 15131 fs_manager.cc:359] Metadata directory not provided
I20260808 14:54:45.358633 15131 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:54:45.358965 15131 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:54:45.361739 15131 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200577490656-27451-0/minicluster-data/ts-0/data/instance:
uuid: "2fcef73fcbd2437db005ee281f2c37e9"
format_stamp: "Formatted at 2026-08-08 14:54:45 on dist-test-slave-6k22"
server_key: "7e7e01d7ddc809a139049e90fef29307"
server_key_iv: "84d09c9ccd9fc62b7265b337e1309654"
server_key_version: "encryptionkey@0"
I20260808 14:54:45.362505 15131 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200577490656-27451-0/minicluster-data/ts-0/wal/instance:
uuid: "2fcef73fcbd2437db005ee281f2c37e9"
format_stamp: "Formatted at 2026-08-08 14:54:45 on dist-test-slave-6k22"
server_key: "7e7e01d7ddc809a139049e90fef29307"
server_key_iv: "84d09c9ccd9fc62b7265b337e1309654"
server_key_version: "encryptionkey@0"
I20260808 14:54:45.367419 15131 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260808 14:54:45.370771 15146 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:54:45.372198 15131 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 14:54:45.372402 15131 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200577490656-27451-0/minicluster-data/ts-0/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200577490656-27451-0/minicluster-data/ts-0/wal
uuid: "2fcef73fcbd2437db005ee281f2c37e9"
format_stamp: "Formatted at 2026-08-08 14:54:45 on dist-test-slave-6k22"
server_key: "7e7e01d7ddc809a139049e90fef29307"
server_key_iv: "84d09c9ccd9fc62b7265b337e1309654"
server_key_version: "encryptionkey@0"
I20260808 14:54:45.372617 15131 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200577490656-27451-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200577490656-27451-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200577490656-27451-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:54:45.385731 15131 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:54:45.386502 15131 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:54:45.386811 15131 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:54:45.387810 15131 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:54:45.389219 15131 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:54:45.389354 15131 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:54:45.389479 15131 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:54:45.389566 15131 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:54:45.423621 15131 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.193:34593
I20260808 14:54:45.423677 15272 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.193:34593 every 8 connection(s)
I20260808 14:54:45.425050 15131 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200577490656-27451-0/minicluster-data/ts-0/data/info.pb
I20260808 14:54:45.426820 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 15131
I20260808 14:54:45.427040 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200577490656-27451-0/minicluster-data/ts-0/wal/instance
I20260808 14:54:45.427536 27451 external_mini_cluster.cc:1428] Setting key 54542bfdf7e2238b132eb4bad4d8b92d
I20260808 14:54:45.430933 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200577490656-27451-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200577490656-27451-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200577490656-27451-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200577490656-27451-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.206.194:0
--local_ip_for_outbound_sockets=127.26.206.194
--webserver_interface=127.26.206.194
--webserver_port=0
--tserver_master_addrs=127.26.206.254:40157
--builtin_ntp_servers=127.26.206.212:33633
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 14:54:45.439834 15275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:45.427746 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.193:40847 (local address 127.26.206.254:40157)
0808 14:54:45.428260 (+ 514us) server_negotiation.cc:206] Beginning negotiation
0808 14:54:45.428265 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:54:45.429567 (+ 1302us) server_negotiation.cc:407] Connection header received
0808 14:54:45.432259 (+ 2692us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:54:45.432265 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:54:45.432327 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:54:45.432419 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:54:45.433798 (+ 1379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:45.434549 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:45.436976 (+ 2427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:45.437374 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:45.437470 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:45.439042 (+ 1572us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:54:45.439046 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:54:45.439049 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:54:45.439066 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:54:45.439110 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:54:45.439121 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:54:45.439189 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0808 14:54:45.439440 (+ 251us) server_negotiation.cc:299] Negotiation successful
0808 14:54:45.439514 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":385,"thread_start_us":252,"threads_started":1}
I20260808 14:54:45.441148 15276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:45.428436 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:40157 (local address 127.26.206.193:40847)
0808 14:54:45.429422 (+ 986us) negotiation.cc:107] Waiting for socket to connect
0808 14:54:45.429478 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0808 14:54:45.431965 (+ 2487us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:54:45.432691 (+ 726us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:54:45.432706 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:54:45.432835 (+ 129us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:54:45.433621 (+ 786us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:54:45.433647 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:54:45.434709 (+ 1062us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:54:45.434717 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:54:45.436833 (+ 2116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:54:45.436850 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:54:45.437589 (+ 739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:54:45.437598 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:54:45.437929 (+ 331us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:45.438691 (+ 762us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 14:54:45.438697 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:54:45.438749 (+ 52us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 14:54:45.438859 (+ 110us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:54:45.439216 (+ 357us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:54:45.439230 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:54:45.439240 (+ 10us) client_negotiation.cc:769] Sending connection context
0808 14:54:45.439418 (+ 178us) client_negotiation.cc:240] Negotiation successful
0808 14:54:45.439848 (+ 430us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":529,"thread_start_us":346,"threads_started":1}
I20260808 14:54:45.442744 15273 heartbeater.cc:347] Connected to a master server at 127.26.206.254:40157
I20260808 14:54:45.443032 15273 heartbeater.cc:464] Registering TS with master...
I20260808 14:54:45.443800 15273 heartbeater.cc:511] Master 127.26.206.254:40157 requested a full tablet report, sending...
I20260808 14:54:45.445946 15069 ts_manager.cc:194] Registered new tserver with Master: 2fcef73fcbd2437db005ee281f2c37e9 (127.26.206.193:34593)
I20260808 14:54:45.447389 15069 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.26.206.193:40847
W20260808 14:54:45.777825 15277 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:54:45.778108 15277 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:54:45.778309 15277 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:54:45.785302 15277 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:54:45.785398 15277 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:54:45.785615 15277 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.206.194
I20260808 14:54:45.794500 15277 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:33633
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200577490656-27451-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200577490656-27451-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.206.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200577490656-27451-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.206.194
--webserver_port=0
--tserver_master_addrs=127.26.206.254:40157
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.206.194
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200577490656-27451-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:54:45.795842 15277 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:54:45.797605 15277 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:54:45.811196 15282 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:54:45.811249 15286 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:54:45.811272 15283 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:54:45.812304 15277 server_base.cc:1034] running on GCE node
I20260808 14:54:45.812906 15277 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:54:45.813799 15277 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:54:45.815043 15277 hybrid_clock.cc:648] HybridClock initialized: now 1786200885815012 us; error 46 us; skew 500 ppm
I20260808 14:54:45.815359 15277 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 14:54:45.817637 15277 webserver.cc:460] Webserver started at http://127.26.206.194:39771/ using document root <none> and password file <none>
I20260808 14:54:45.818290 15277 fs_manager.cc:359] Metadata directory not provided
I20260808 14:54:45.818425 15277 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:54:45.818742 15277 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:54:45.821537 15277 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200577490656-27451-0/minicluster-data/ts-1/data/instance:
uuid: "dffb1087a7b24b1cbf25ea944c523ec3"
format_stamp: "Formatted at 2026-08-08 14:54:45 on dist-test-slave-6k22"
server_key: "59eda4a1ca2bc9e317b2f215fcc59035"
server_key_iv: "676a5372e27fe300e24ccf0721362f0b"
server_key_version: "encryptionkey@0"
I20260808 14:54:45.822391 15277 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200577490656-27451-0/minicluster-data/ts-1/wal/instance:
uuid: "dffb1087a7b24b1cbf25ea944c523ec3"
format_stamp: "Formatted at 2026-08-08 14:54:45 on dist-test-slave-6k22"
server_key: "59eda4a1ca2bc9e317b2f215fcc59035"
server_key_iv: "676a5372e27fe300e24ccf0721362f0b"
server_key_version: "encryptionkey@0"
I20260808 14:54:45.827311 15277 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260808 14:54:45.830659 15293 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:54:45.832037 15277 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 14:54:45.832204 15277 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200577490656-27451-0/minicluster-data/ts-1/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200577490656-27451-0/minicluster-data/ts-1/wal
uuid: "dffb1087a7b24b1cbf25ea944c523ec3"
format_stamp: "Formatted at 2026-08-08 14:54:45 on dist-test-slave-6k22"
server_key: "59eda4a1ca2bc9e317b2f215fcc59035"
server_key_iv: "676a5372e27fe300e24ccf0721362f0b"
server_key_version: "encryptionkey@0"
I20260808 14:54:45.832404 15277 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200577490656-27451-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200577490656-27451-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200577490656-27451-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:54:45.857594 15277 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:54:45.858333 15277 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:54:45.858654 15277 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:54:45.859643 15277 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:54:45.861063 15277 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:54:45.861148 15277 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:54:45.861296 15277 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:54:45.861368 15277 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:54:45.893643 15277 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.194:45999
I20260808 14:54:45.893720 15417 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.194:45999 every 8 connection(s)
I20260808 14:54:45.894918 15277 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200577490656-27451-0/minicluster-data/ts-1/data/info.pb
I20260808 14:54:45.903117 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 15277
I20260808 14:54:45.903331 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200577490656-27451-0/minicluster-data/ts-1/wal/instance
I20260808 14:54:45.903858 27451 external_mini_cluster.cc:1428] Setting key 73c78e8be001e3c93d98d83fd6efba1f
I20260808 14:54:45.907088 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200577490656-27451-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200577490656-27451-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200577490656-27451-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200577490656-27451-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.206.195:0
--local_ip_for_outbound_sockets=127.26.206.195
--webserver_interface=127.26.206.195
--webserver_port=0
--tserver_master_addrs=127.26.206.254:40157
--builtin_ntp_servers=127.26.206.212:33633
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 14:54:45.907346 15275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:45.897442 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.194:60799 (local address 127.26.206.254:40157)
0808 14:54:45.897655 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0808 14:54:45.897661 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:54:45.899072 (+ 1411us) server_negotiation.cc:407] Connection header received
0808 14:54:45.900872 (+ 1800us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:54:45.900876 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:54:45.900940 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:54:45.901029 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:54:45.901991 (+ 962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:45.902697 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:45.904400 (+ 1703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:45.904925 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:45.905046 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:45.906552 (+ 1506us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:54:45.906559 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:54:45.906563 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:54:45.906582 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:54:45.906620 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:54:45.906636 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:54:45.906728 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0808 14:54:45.906941 (+ 213us) server_negotiation.cc:299] Negotiation successful
0808 14:54:45.907033 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260808 14:54:45.908190 15420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:45.897984 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:40157 (local address 127.26.206.194:60799)
0808 14:54:45.898924 (+ 940us) negotiation.cc:107] Waiting for socket to connect
0808 14:54:45.898959 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0808 14:54:45.900640 (+ 1681us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:54:45.901219 (+ 579us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:54:45.901226 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:54:45.901318 (+ 92us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:54:45.901837 (+ 519us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:54:45.901857 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:54:45.902835 (+ 978us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:54:45.902838 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:54:45.904252 (+ 1414us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:54:45.904264 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:54:45.905170 (+ 906us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:54:45.905177 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:54:45.905458 (+ 281us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:45.906236 (+ 778us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 14:54:45.906238 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:54:45.906294 (+ 56us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 14:54:45.906375 (+ 81us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:54:45.906740 (+ 365us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:54:45.906748 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:54:45.906753 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 14:54:45.906888 (+ 135us) client_negotiation.cc:240] Negotiation successful
0808 14:54:45.907132 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":529,"thread_start_us":273,"threads_started":1}
I20260808 14:54:45.909461 15418 heartbeater.cc:347] Connected to a master server at 127.26.206.254:40157
I20260808 14:54:45.909755 15418 heartbeater.cc:464] Registering TS with master...
I20260808 14:54:45.910554 15418 heartbeater.cc:511] Master 127.26.206.254:40157 requested a full tablet report, sending...
I20260808 14:54:45.911995 15069 ts_manager.cc:194] Registered new tserver with Master: dffb1087a7b24b1cbf25ea944c523ec3 (127.26.206.194:45999)
I20260808 14:54:45.912758 15069 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.26.206.194:60799
W20260808 14:54:46.245986 15421 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:54:46.246268 15421 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:54:46.246421 15421 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:54:46.253379 15421 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:54:46.253468 15421 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:54:46.253604 15421 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.206.195
I20260808 14:54:46.262439 15421 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:33633
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200577490656-27451-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200577490656-27451-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.206.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200577490656-27451-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.206.195
--webserver_port=0
--tserver_master_addrs=127.26.206.254:40157
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.206.195
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200577490656-27451-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:54:46.263724 15421 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:54:46.265450 15421 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:54:46.278257 15426 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:54:46.278381 15430 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:54:46.279393 15421 server_base.cc:1034] running on GCE node
W20260808 14:54:46.279785 15428 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:54:46.280630 15421 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:54:46.281777 15421 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:54:46.282998 15421 hybrid_clock.cc:648] HybridClock initialized: now 1786200886282951 us; error 41 us; skew 500 ppm
I20260808 14:54:46.283341 15421 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 14:54:46.285588 15421 webserver.cc:460] Webserver started at http://127.26.206.195:46727/ using document root <none> and password file <none>
I20260808 14:54:46.286293 15421 fs_manager.cc:359] Metadata directory not provided
I20260808 14:54:46.286405 15421 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:54:46.286736 15421 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:54:46.289644 15421 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200577490656-27451-0/minicluster-data/ts-2/data/instance:
uuid: "6aa92ae14937480dba1bd6e5231506f4"
format_stamp: "Formatted at 2026-08-08 14:54:46 on dist-test-slave-6k22"
server_key: "50e67c6cf67b21b129465dbc5b68dd37"
server_key_iv: "258be40b29abf7ef105cc026aef29ef2"
server_key_version: "encryptionkey@0"
I20260808 14:54:46.290423 15421 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200577490656-27451-0/minicluster-data/ts-2/wal/instance:
uuid: "6aa92ae14937480dba1bd6e5231506f4"
format_stamp: "Formatted at 2026-08-08 14:54:46 on dist-test-slave-6k22"
server_key: "50e67c6cf67b21b129465dbc5b68dd37"
server_key_iv: "258be40b29abf7ef105cc026aef29ef2"
server_key_version: "encryptionkey@0"
I20260808 14:54:46.295468 15421 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.007s
I20260808 14:54:46.298952 15436 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:54:46.300340 15421 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.003s
I20260808 14:54:46.300503 15421 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200577490656-27451-0/minicluster-data/ts-2/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200577490656-27451-0/minicluster-data/ts-2/wal
uuid: "6aa92ae14937480dba1bd6e5231506f4"
format_stamp: "Formatted at 2026-08-08 14:54:46 on dist-test-slave-6k22"
server_key: "50e67c6cf67b21b129465dbc5b68dd37"
server_key_iv: "258be40b29abf7ef105cc026aef29ef2"
server_key_version: "encryptionkey@0"
I20260808 14:54:46.300719 15421 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200577490656-27451-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200577490656-27451-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200577490656-27451-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:54:46.315910 15421 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:54:46.316813 15421 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:54:46.317101 15421 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:54:46.318042 15421 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:54:46.319856 15421 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:54:46.319986 15421 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:54:46.320108 15421 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:54:46.320219 15421 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:54:46.352587 15421 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.195:35201
I20260808 14:54:46.352628 15556 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.195:35201 every 8 connection(s)
I20260808 14:54:46.353909 15421 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200577490656-27451-0/minicluster-data/ts-2/data/info.pb
I20260808 14:54:46.359071 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 15421
I20260808 14:54:46.359254 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200577490656-27451-0/minicluster-data/ts-2/wal/instance
I20260808 14:54:46.359754 27451 external_mini_cluster.cc:1428] Setting key 7acc5646dc510b9b036c77967142f71d
I20260808 14:54:46.366075 15275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:46.356543 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.195:41783 (local address 127.26.206.254:40157)
0808 14:54:46.356746 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0808 14:54:46.356750 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:54:46.358077 (+ 1327us) server_negotiation.cc:407] Connection header received
0808 14:54:46.359986 (+ 1909us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:54:46.359991 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:54:46.360084 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:54:46.360199 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:54:46.361213 (+ 1014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:46.361958 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:46.363433 (+ 1475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:46.363883 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:46.364013 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:46.365254 (+ 1241us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:54:46.365259 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:54:46.365262 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:54:46.365279 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:54:46.365316 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:54:46.365328 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:54:46.365425 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0808 14:54:46.365642 (+ 217us) server_negotiation.cc:299] Negotiation successful
0808 14:54:46.365737 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260808 14:54:46.367010 15559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:46.357054 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:40157 (local address 127.26.206.195:41783)
0808 14:54:46.357925 (+ 871us) negotiation.cc:107] Waiting for socket to connect
0808 14:54:46.357960 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0808 14:54:46.359695 (+ 1735us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:54:46.360447 (+ 752us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:54:46.360455 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:54:46.360536 (+ 81us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:54:46.361058 (+ 522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:54:46.361073 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:54:46.362099 (+ 1026us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:54:46.362111 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:54:46.363296 (+ 1185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:54:46.363307 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:54:46.364098 (+ 791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:54:46.364106 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:54:46.364333 (+ 227us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:46.364940 (+ 607us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 14:54:46.364942 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:54:46.364979 (+ 37us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 14:54:46.365064 (+ 85us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:54:46.365426 (+ 362us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:54:46.365439 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:54:46.365449 (+ 10us) client_negotiation.cc:769] Sending connection context
0808 14:54:46.365626 (+ 177us) client_negotiation.cc:240] Negotiation successful
0808 14:54:46.365996 (+ 370us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":441,"thread_start_us":278,"threads_started":1}
I20260808 14:54:46.368312 15557 heartbeater.cc:347] Connected to a master server at 127.26.206.254:40157
I20260808 14:54:46.368602 15557 heartbeater.cc:464] Registering TS with master...
I20260808 14:54:46.369269 15557 heartbeater.cc:511] Master 127.26.206.254:40157 requested a full tablet report, sending...
I20260808 14:54:46.370599 15069 ts_manager.cc:194] Registered new tserver with Master: 6aa92ae14937480dba1bd6e5231506f4 (127.26.206.195:35201)
I20260808 14:54:46.371374 15069 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.26.206.195:41783
I20260808 14:54:46.374500 27451 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 14:54:46.384291 15275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:46.378825 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58152 (local address 127.26.206.254:40157)
0808 14:54:46.379025 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0808 14:54:46.379033 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:54:46.379462 (+ 429us) server_negotiation.cc:407] Connection header received
0808 14:54:46.379631 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:54:46.379634 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:54:46.379696 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:54:46.379774 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:54:46.380219 (+ 445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:46.380869 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:46.382102 (+ 1233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:46.382655 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:46.382739 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:46.383677 (+ 938us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:54:46.383681 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:54:46.383684 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:54:46.383699 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:54:46.383727 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:54:46.383738 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:54:46.383815 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0808 14:54:46.383928 (+ 113us) server_negotiation.cc:299] Negotiation successful
0808 14:54:46.383992 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260808 14:54:46.387538 15069 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58152:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:54:46.394271 15069 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:54:46.433563 15577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:46.406603 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.194:45999 (local address 127.0.0.1:41422)
0808 14:54:46.415458 (+ 8855us) negotiation.cc:107] Waiting for socket to connect
0808 14:54:46.415510 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0808 14:54:46.416391 (+ 881us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:54:46.420802 (+ 4411us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:54:46.420808 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:54:46.420852 (+ 44us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:54:46.421352 (+ 500us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:54:46.421368 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:54:46.427826 (+ 6458us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:54:46.427831 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:54:46.430364 (+ 2533us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:54:46.430376 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:54:46.432603 (+ 2227us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:54:46.432609 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:54:46.432789 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:46.432836 (+ 47us) client_negotiation.cc:769] Sending connection context
0808 14:54:46.432966 (+ 130us) client_negotiation.cc:240] Negotiation successful
0808 14:54:46.433139 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8622,"mutex_wait_us":22,"thread_start_us":16581,"threads_started":1}
I20260808 14:54:46.433898 15578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:46.409458 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38886 (local address 127.26.206.193:34593)
0808 14:54:46.424252 (+ 14794us) server_negotiation.cc:206] Beginning negotiation
0808 14:54:46.424264 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 14:54:46.424839 (+ 575us) server_negotiation.cc:407] Connection header received
0808 14:54:46.425016 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:54:46.425024 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:54:46.425253 (+ 229us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:54:46.425442 (+ 189us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:54:46.426233 (+ 791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:46.427921 (+ 1688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:46.431379 (+ 3458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:46.432686 (+ 1307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:46.432884 (+ 198us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:46.433083 (+ 199us) server_negotiation.cc:1035] Waiting for connection context
0808 14:54:46.433335 (+ 252us) server_negotiation.cc:299] Negotiation successful
0808 14:54:46.433511 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14578,"thread_start_us":14443,"threads_started":1}
I20260808 14:54:46.434194 15575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:46.406707 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41422 (local address 127.26.206.194:45999)
0808 14:54:46.420072 (+ 13365us) server_negotiation.cc:206] Beginning negotiation
0808 14:54:46.420085 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 14:54:46.420124 (+ 39us) server_negotiation.cc:407] Connection header received
0808 14:54:46.420240 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:54:46.420251 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:54:46.420558 (+ 307us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:54:46.422272 (+ 1714us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:54:46.422524 (+ 252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:46.426397 (+ 3873us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:46.430958 (+ 4561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:46.432409 (+ 1451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:46.432579 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:46.432811 (+ 232us) server_negotiation.cc:1035] Waiting for connection context
0808 14:54:46.433686 (+ 875us) server_negotiation.cc:299] Negotiation successful
0808 14:54:46.433847 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13136,"thread_start_us":15298,"threads_started":1}
I20260808 14:54:46.434401 15573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:46.406655 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.195:35201 (local address 127.0.0.1:56700)
0808 14:54:46.423429 (+ 16774us) negotiation.cc:107] Waiting for socket to connect
0808 14:54:46.423468 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 14:54:46.423666 (+ 198us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:54:46.427549 (+ 3883us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:54:46.427574 (+ 25us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:54:46.427600 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:54:46.427995 (+ 395us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:54:46.428006 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:54:46.429873 (+ 1867us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:54:46.429878 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:54:46.431987 (+ 2109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:54:46.431998 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:54:46.433610 (+ 1612us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:54:46.433619 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:54:46.433803 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:46.433831 (+ 28us) client_negotiation.cc:769] Sending connection context
0808 14:54:46.433895 (+ 64us) client_negotiation.cc:240] Negotiation successful
0808 14:54:46.434007 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16285,"mutex_wait_us":1,"thread_start_us":17839,"threads_started":1}
I20260808 14:54:46.434680 15574 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:46.408879 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.193:34593 (local address 127.0.0.1:38886)
0808 14:54:46.424715 (+ 15836us) negotiation.cc:107] Waiting for socket to connect
0808 14:54:46.424738 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 14:54:46.424871 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:54:46.425687 (+ 816us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:54:46.425716 (+ 29us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:54:46.425741 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:54:46.426047 (+ 306us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:54:46.426056 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:54:46.428138 (+ 2082us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:54:46.428143 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:54:46.431146 (+ 3003us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:54:46.431160 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:54:46.432956 (+ 1796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:54:46.432963 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:54:46.433141 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:46.433174 (+ 33us) client_negotiation.cc:769] Sending connection context
0808 14:54:46.433291 (+ 117us) client_negotiation.cc:240] Negotiation successful
0808 14:54:46.433414 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15732,"mutex_wait_us":34,"thread_start_us":6187,"threads_started":1}
I20260808 14:54:46.436362 15576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:46.406984 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56700 (local address 127.26.206.195:35201)
0808 14:54:46.426972 (+ 19988us) server_negotiation.cc:206] Beginning negotiation
0808 14:54:46.426980 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:54:46.427012 (+ 32us) server_negotiation.cc:407] Connection header received
0808 14:54:46.427109 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:54:46.427117 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:54:46.427339 (+ 222us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:54:46.427530 (+ 191us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:54:46.428208 (+ 678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:46.429703 (+ 1495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:46.432163 (+ 2460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:46.433354 (+ 1191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:46.435478 (+ 2124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:46.435741 (+ 263us) server_negotiation.cc:1035] Waiting for connection context
0808 14:54:46.435814 (+ 73us) server_negotiation.cc:299] Negotiation successful
0808 14:54:46.435969 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19815,"thread_start_us":19656,"threads_started":1}
I20260808 14:54:46.438123 15347 tablet_service.cc:1467] Processing CreateTablet for tablet d69352cdcfdc4d2298c44b808eb7f41e (DEFAULT_TABLE table=test-table [id=f5a0aa41443a4f12b901955928fbede7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:54:46.438233 15198 tablet_service.cc:1467] Processing CreateTablet for tablet d69352cdcfdc4d2298c44b808eb7f41e (DEFAULT_TABLE table=test-table [id=f5a0aa41443a4f12b901955928fbede7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:54:46.439359 15347 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d69352cdcfdc4d2298c44b808eb7f41e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:54:46.439668 15198 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d69352cdcfdc4d2298c44b808eb7f41e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:54:46.440100 15487 tablet_service.cc:1467] Processing CreateTablet for tablet d69352cdcfdc4d2298c44b808eb7f41e (DEFAULT_TABLE table=test-table [id=f5a0aa41443a4f12b901955928fbede7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:54:46.441448 15487 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d69352cdcfdc4d2298c44b808eb7f41e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:54:46.450606 15579 tablet_bootstrap.cc:492] T d69352cdcfdc4d2298c44b808eb7f41e P dffb1087a7b24b1cbf25ea944c523ec3: Bootstrap starting.
I20260808 14:54:46.450804 15273 heartbeater.cc:503] Master 127.26.206.254:40157 was elected leader, sending a full tablet report...
I20260808 14:54:46.453886 15580 tablet_bootstrap.cc:492] T d69352cdcfdc4d2298c44b808eb7f41e P 2fcef73fcbd2437db005ee281f2c37e9: Bootstrap starting.
I20260808 14:54:46.454090 15579 tablet_bootstrap.cc:654] T d69352cdcfdc4d2298c44b808eb7f41e P dffb1087a7b24b1cbf25ea944c523ec3: Neither blocks nor log segments found. Creating new log.
I20260808 14:54:46.455418 15579 log.cc:824] T d69352cdcfdc4d2298c44b808eb7f41e P dffb1087a7b24b1cbf25ea944c523ec3: Log is configured to *not* fsync() on all Append() calls
I20260808 14:54:46.457569 15580 tablet_bootstrap.cc:654] T d69352cdcfdc4d2298c44b808eb7f41e P 2fcef73fcbd2437db005ee281f2c37e9: Neither blocks nor log segments found. Creating new log.
I20260808 14:54:46.458671 15579 tablet_bootstrap.cc:492] T d69352cdcfdc4d2298c44b808eb7f41e P dffb1087a7b24b1cbf25ea944c523ec3: No bootstrap required, opened a new log
I20260808 14:54:46.458822 15580 log.cc:824] T d69352cdcfdc4d2298c44b808eb7f41e P 2fcef73fcbd2437db005ee281f2c37e9: Log is configured to *not* fsync() on all Append() calls
I20260808 14:54:46.458940 15579 ts_tablet_manager.cc:1397] T d69352cdcfdc4d2298c44b808eb7f41e P dffb1087a7b24b1cbf25ea944c523ec3: Time spent bootstrapping tablet: real 0.009s user 0.008s sys 0.000s
I20260808 14:54:46.459661 15585 tablet_bootstrap.cc:492] T d69352cdcfdc4d2298c44b808eb7f41e P 6aa92ae14937480dba1bd6e5231506f4: Bootstrap starting.
I20260808 14:54:46.461329 15580 tablet_bootstrap.cc:492] T d69352cdcfdc4d2298c44b808eb7f41e P 2fcef73fcbd2437db005ee281f2c37e9: No bootstrap required, opened a new log
I20260808 14:54:46.461619 15580 ts_tablet_manager.cc:1397] T d69352cdcfdc4d2298c44b808eb7f41e P 2fcef73fcbd2437db005ee281f2c37e9: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260808 14:54:46.463038 15585 tablet_bootstrap.cc:654] T d69352cdcfdc4d2298c44b808eb7f41e P 6aa92ae14937480dba1bd6e5231506f4: Neither blocks nor log segments found. Creating new log.
I20260808 14:54:46.464182 15585 log.cc:824] T d69352cdcfdc4d2298c44b808eb7f41e P 6aa92ae14937480dba1bd6e5231506f4: Log is configured to *not* fsync() on all Append() calls
I20260808 14:54:46.467121 15585 tablet_bootstrap.cc:492] T d69352cdcfdc4d2298c44b808eb7f41e P 6aa92ae14937480dba1bd6e5231506f4: No bootstrap required, opened a new log
I20260808 14:54:46.467386 15585 ts_tablet_manager.cc:1397] T d69352cdcfdc4d2298c44b808eb7f41e P 6aa92ae14937480dba1bd6e5231506f4: Time spent bootstrapping tablet: real 0.011s user 0.006s sys 0.000s
I20260808 14:54:46.468987 15580 raft_consensus.cc:348] T d69352cdcfdc4d2298c44b808eb7f41e P 2fcef73fcbd2437db005ee281f2c37e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dffb1087a7b24b1cbf25ea944c523ec3" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 45999 } } peers { permanent_uuid: "6aa92ae14937480dba1bd6e5231506f4" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 35201 } } peers { permanent_uuid: "2fcef73fcbd2437db005ee281f2c37e9" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 34593 } }
I20260808 14:54:46.469089 15579 raft_consensus.cc:348] T d69352cdcfdc4d2298c44b808eb7f41e P dffb1087a7b24b1cbf25ea944c523ec3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dffb1087a7b24b1cbf25ea944c523ec3" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 45999 } } peers { permanent_uuid: "6aa92ae14937480dba1bd6e5231506f4" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 35201 } } peers { permanent_uuid: "2fcef73fcbd2437db005ee281f2c37e9" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 34593 } }
I20260808 14:54:46.469420 15580 raft_consensus.cc:374] T d69352cdcfdc4d2298c44b808eb7f41e P 2fcef73fcbd2437db005ee281f2c37e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:54:46.469523 15579 raft_consensus.cc:374] T d69352cdcfdc4d2298c44b808eb7f41e P dffb1087a7b24b1cbf25ea944c523ec3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:54:46.469543 15580 raft_consensus.cc:729] T d69352cdcfdc4d2298c44b808eb7f41e P 2fcef73fcbd2437db005ee281f2c37e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fcef73fcbd2437db005ee281f2c37e9, State: Initialized, Role: FOLLOWER
I20260808 14:54:46.469637 15579 raft_consensus.cc:729] T d69352cdcfdc4d2298c44b808eb7f41e P dffb1087a7b24b1cbf25ea944c523ec3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dffb1087a7b24b1cbf25ea944c523ec3, State: Initialized, Role: FOLLOWER
I20260808 14:54:46.470173 15580 consensus_queue.cc:260] T d69352cdcfdc4d2298c44b808eb7f41e P 2fcef73fcbd2437db005ee281f2c37e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dffb1087a7b24b1cbf25ea944c523ec3" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 45999 } } peers { permanent_uuid: "6aa92ae14937480dba1bd6e5231506f4" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 35201 } } peers { permanent_uuid: "2fcef73fcbd2437db005ee281f2c37e9" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 34593 } }
I20260808 14:54:46.470348 15579 consensus_queue.cc:260] T d69352cdcfdc4d2298c44b808eb7f41e P dffb1087a7b24b1cbf25ea944c523ec3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dffb1087a7b24b1cbf25ea944c523ec3" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 45999 } } peers { permanent_uuid: "6aa92ae14937480dba1bd6e5231506f4" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 35201 } } peers { permanent_uuid: "2fcef73fcbd2437db005ee281f2c37e9" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 34593 } }
I20260808 14:54:46.472990 15580 ts_tablet_manager.cc:1428] T d69352cdcfdc4d2298c44b808eb7f41e P 2fcef73fcbd2437db005ee281f2c37e9: Time spent starting tablet: real 0.011s user 0.012s sys 0.000s
I20260808 14:54:46.475426 15418 heartbeater.cc:503] Master 127.26.206.254:40157 was elected leader, sending a full tablet report...
I20260808 14:54:46.476845 15579 ts_tablet_manager.cc:1428] T d69352cdcfdc4d2298c44b808eb7f41e P dffb1087a7b24b1cbf25ea944c523ec3: Time spent starting tablet: real 0.018s user 0.013s sys 0.004s
I20260808 14:54:46.478951 15585 raft_consensus.cc:348] T d69352cdcfdc4d2298c44b808eb7f41e P 6aa92ae14937480dba1bd6e5231506f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dffb1087a7b24b1cbf25ea944c523ec3" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 45999 } } peers { permanent_uuid: "6aa92ae14937480dba1bd6e5231506f4" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 35201 } } peers { permanent_uuid: "2fcef73fcbd2437db005ee281f2c37e9" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 34593 } }
I20260808 14:54:46.479347 15585 raft_consensus.cc:374] T d69352cdcfdc4d2298c44b808eb7f41e P 6aa92ae14937480dba1bd6e5231506f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:54:46.479446 15585 raft_consensus.cc:729] T d69352cdcfdc4d2298c44b808eb7f41e P 6aa92ae14937480dba1bd6e5231506f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6aa92ae14937480dba1bd6e5231506f4, State: Initialized, Role: FOLLOWER
I20260808 14:54:46.480052 15585 consensus_queue.cc:260] T d69352cdcfdc4d2298c44b808eb7f41e P 6aa92ae14937480dba1bd6e5231506f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dffb1087a7b24b1cbf25ea944c523ec3" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 45999 } } peers { permanent_uuid: "6aa92ae14937480dba1bd6e5231506f4" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 35201 } } peers { permanent_uuid: "2fcef73fcbd2437db005ee281f2c37e9" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 34593 } }
I20260808 14:54:46.480989 15557 heartbeater.cc:503] Master 127.26.206.254:40157 was elected leader, sending a full tablet report...
I20260808 14:54:46.481528 15585 ts_tablet_manager.cc:1428] T d69352cdcfdc4d2298c44b808eb7f41e P 6aa92ae14937480dba1bd6e5231506f4: Time spent starting tablet: real 0.014s user 0.010s sys 0.004s
I20260808 14:54:46.509460 15588 raft_consensus.cc:482] T d69352cdcfdc4d2298c44b808eb7f41e P 2fcef73fcbd2437db005ee281f2c37e9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:54:46.509791 15588 raft_consensus.cc:504] T d69352cdcfdc4d2298c44b808eb7f41e P 2fcef73fcbd2437db005ee281f2c37e9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dffb1087a7b24b1cbf25ea944c523ec3" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 45999 } } peers { permanent_uuid: "6aa92ae14937480dba1bd6e5231506f4" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 35201 } } peers { permanent_uuid: "2fcef73fcbd2437db005ee281f2c37e9" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 34593 } }
I20260808 14:54:46.511662 15588 leader_election.cc:288] T d69352cdcfdc4d2298c44b808eb7f41e P 2fcef73fcbd2437db005ee281f2c37e9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dffb1087a7b24b1cbf25ea944c523ec3 (127.26.206.194:45999), 6aa92ae14937480dba1bd6e5231506f4 (127.26.206.195:35201)
I20260808 14:54:46.518854 15575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:46.512128 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.193:35041 (local address 127.26.206.194:45999)
0808 14:54:46.512363 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0808 14:54:46.512371 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:54:46.513078 (+ 707us) server_negotiation.cc:407] Connection header received
0808 14:54:46.513241 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:54:46.513248 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:54:46.513347 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:54:46.513424 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:54:46.514100 (+ 676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:46.514838 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:46.516928 (+ 2090us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:46.517806 (+ 878us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:46.517988 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:46.518061 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 14:54:46.518428 (+ 367us) server_negotiation.cc:299] Negotiation successful
0808 14:54:46.518582 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260808 14:54:46.518906 15592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:46.512074 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.194:45999 (local address 127.26.206.193:35041)
0808 14:54:46.512962 (+ 888us) negotiation.cc:107] Waiting for socket to connect
0808 14:54:46.512977 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 14:54:46.513095 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:54:46.513471 (+ 376us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:54:46.513478 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:54:46.513509 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:54:46.513945 (+ 436us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:54:46.513955 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:54:46.514975 (+ 1020us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:54:46.514983 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:54:46.516713 (+ 1730us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:54:46.516725 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:54:46.517986 (+ 1261us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:54:46.517992 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:54:46.518175 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:46.518221 (+ 46us) client_negotiation.cc:769] Sending connection context
0808 14:54:46.518366 (+ 145us) client_negotiation.cc:240] Negotiation successful
0808 14:54:46.518528 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":766,"mutex_wait_us":5,"thread_start_us":521,"threads_started":1}
I20260808 14:54:46.519058 15576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:46.512187 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.193:39579 (local address 127.26.206.195:35201)
0808 14:54:46.512414 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0808 14:54:46.512423 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:54:46.513212 (+ 789us) server_negotiation.cc:407] Connection header received
0808 14:54:46.513360 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:54:46.513364 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:54:46.513453 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:54:46.513544 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:54:46.514216 (+ 672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:46.514942 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:46.517178 (+ 2236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:46.518041 (+ 863us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:46.518222 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:46.518290 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0808 14:54:46.518679 (+ 389us) server_negotiation.cc:299] Negotiation successful
0808 14:54:46.518803 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260808 14:54:46.519651 15593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:46.512178 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.195:35201 (local address 127.26.206.193:39579)
0808 14:54:46.513080 (+ 902us) negotiation.cc:107] Waiting for socket to connect
0808 14:54:46.513098 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 14:54:46.513233 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:54:46.513597 (+ 364us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:54:46.513600 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:54:46.513631 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:54:46.514048 (+ 417us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:54:46.514058 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:54:46.515094 (+ 1036us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:54:46.515098 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:54:46.516964 (+ 1866us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:54:46.516981 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:54:46.518262 (+ 1281us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:54:46.518268 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:54:46.518495 (+ 227us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:46.518528 (+ 33us) client_negotiation.cc:769] Sending connection context
0808 14:54:46.519212 (+ 684us) client_negotiation.cc:240] Negotiation successful
0808 14:54:46.519362 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":778,"mutex_wait_us":176,"thread_start_us":446,"threads_started":1}
I20260808 14:54:46.520184 15369 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d69352cdcfdc4d2298c44b808eb7f41e" candidate_uuid: "2fcef73fcbd2437db005ee281f2c37e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dffb1087a7b24b1cbf25ea944c523ec3" is_pre_election: true
I20260808 14:54:46.520696 15369 raft_consensus.cc:2454] T d69352cdcfdc4d2298c44b808eb7f41e P dffb1087a7b24b1cbf25ea944c523ec3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fcef73fcbd2437db005ee281f2c37e9 in term 0.
I20260808 14:54:46.520651 15507 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d69352cdcfdc4d2298c44b808eb7f41e" candidate_uuid: "2fcef73fcbd2437db005ee281f2c37e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6aa92ae14937480dba1bd6e5231506f4" is_pre_election: true
I20260808 14:54:46.521193 15507 raft_consensus.cc:2454] T d69352cdcfdc4d2298c44b808eb7f41e P 6aa92ae14937480dba1bd6e5231506f4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fcef73fcbd2437db005ee281f2c37e9 in term 0.
I20260808 14:54:46.521358 15149 leader_election.cc:302] T d69352cdcfdc4d2298c44b808eb7f41e P 2fcef73fcbd2437db005ee281f2c37e9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fcef73fcbd2437db005ee281f2c37e9, dffb1087a7b24b1cbf25ea944c523ec3; no voters:
I20260808 14:54:46.521786 15588 raft_consensus.cc:2781] T d69352cdcfdc4d2298c44b808eb7f41e P 2fcef73fcbd2437db005ee281f2c37e9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:54:46.521934 15588 raft_consensus.cc:482] T d69352cdcfdc4d2298c44b808eb7f41e P 2fcef73fcbd2437db005ee281f2c37e9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:54:46.522055 15588 raft_consensus.cc:3037] T d69352cdcfdc4d2298c44b808eb7f41e P 2fcef73fcbd2437db005ee281f2c37e9 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:54:46.524360 15588 raft_consensus.cc:504] T d69352cdcfdc4d2298c44b808eb7f41e P 2fcef73fcbd2437db005ee281f2c37e9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dffb1087a7b24b1cbf25ea944c523ec3" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 45999 } } peers { permanent_uuid: "6aa92ae14937480dba1bd6e5231506f4" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 35201 } } peers { permanent_uuid: "2fcef73fcbd2437db005ee281f2c37e9" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 34593 } }
I20260808 14:54:46.525055 15588 leader_election.cc:288] T d69352cdcfdc4d2298c44b808eb7f41e P 2fcef73fcbd2437db005ee281f2c37e9 [CANDIDATE]: Term 1 election: Requested vote from peers dffb1087a7b24b1cbf25ea944c523ec3 (127.26.206.194:45999), 6aa92ae14937480dba1bd6e5231506f4 (127.26.206.195:35201)
I20260808 14:54:46.525358 15369 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d69352cdcfdc4d2298c44b808eb7f41e" candidate_uuid: "2fcef73fcbd2437db005ee281f2c37e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dffb1087a7b24b1cbf25ea944c523ec3"
I20260808 14:54:46.525543 15369 raft_consensus.cc:3037] T d69352cdcfdc4d2298c44b808eb7f41e P dffb1087a7b24b1cbf25ea944c523ec3 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:54:46.525552 15507 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d69352cdcfdc4d2298c44b808eb7f41e" candidate_uuid: "2fcef73fcbd2437db005ee281f2c37e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6aa92ae14937480dba1bd6e5231506f4"
I20260808 14:54:46.525758 15507 raft_consensus.cc:3037] T d69352cdcfdc4d2298c44b808eb7f41e P 6aa92ae14937480dba1bd6e5231506f4 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:54:46.527889 15369 raft_consensus.cc:2454] T d69352cdcfdc4d2298c44b808eb7f41e P dffb1087a7b24b1cbf25ea944c523ec3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fcef73fcbd2437db005ee281f2c37e9 in term 1.
I20260808 14:54:46.528162 15507 raft_consensus.cc:2454] T d69352cdcfdc4d2298c44b808eb7f41e P 6aa92ae14937480dba1bd6e5231506f4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fcef73fcbd2437db005ee281f2c37e9 in term 1.
I20260808 14:54:46.528296 15149 leader_election.cc:302] T d69352cdcfdc4d2298c44b808eb7f41e P 2fcef73fcbd2437db005ee281f2c37e9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fcef73fcbd2437db005ee281f2c37e9, dffb1087a7b24b1cbf25ea944c523ec3; no voters:
I20260808 14:54:46.528589 15588 raft_consensus.cc:2781] T d69352cdcfdc4d2298c44b808eb7f41e P 2fcef73fcbd2437db005ee281f2c37e9 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:54:46.529008 15588 raft_consensus.cc:686] T d69352cdcfdc4d2298c44b808eb7f41e P 2fcef73fcbd2437db005ee281f2c37e9 [term 1 LEADER]: Becoming Leader. State: Replica: 2fcef73fcbd2437db005ee281f2c37e9, State: Running, Role: LEADER
I20260808 14:54:46.529471 15588 consensus_queue.cc:237] T d69352cdcfdc4d2298c44b808eb7f41e P 2fcef73fcbd2437db005ee281f2c37e9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dffb1087a7b24b1cbf25ea944c523ec3" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 45999 } } peers { permanent_uuid: "6aa92ae14937480dba1bd6e5231506f4" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 35201 } } peers { permanent_uuid: "2fcef73fcbd2437db005ee281f2c37e9" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 34593 } }
I20260808 14:54:46.534137 15068 catalog_manager.cc:5495] T d69352cdcfdc4d2298c44b808eb7f41e P 2fcef73fcbd2437db005ee281f2c37e9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2fcef73fcbd2437db005ee281f2c37e9 (127.26.206.193). New cstate: current_term: 1 leader_uuid: "2fcef73fcbd2437db005ee281f2c37e9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dffb1087a7b24b1cbf25ea944c523ec3" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 45999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6aa92ae14937480dba1bd6e5231506f4" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fcef73fcbd2437db005ee281f2c37e9" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 34593 } health_report { overall_health: HEALTHY } } }
I20260808 14:54:46.553927 15578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:46.548762 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38896 (local address 127.26.206.193:34593)
0808 14:54:46.548936 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0808 14:54:46.548940 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:54:46.549019 (+ 79us) server_negotiation.cc:407] Connection header received
0808 14:54:46.549215 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:54:46.549218 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:54:46.549305 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:54:46.549428 (+ 123us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:54:46.549742 (+ 314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:46.550454 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:46.552063 (+ 1609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:46.552490 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:46.552594 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:46.553010 (+ 416us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:54:46.553495 (+ 485us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:54:46.553614 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0808 14:54:46.553672 (+ 58us) server_negotiation.cc:299] Negotiation successful
0808 14:54:46.553735 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260808 14:54:46.561717 15507 raft_consensus.cc:1261] T d69352cdcfdc4d2298c44b808eb7f41e P 6aa92ae14937480dba1bd6e5231506f4 [term 1 FOLLOWER]: Refusing update from remote peer 2fcef73fcbd2437db005ee281f2c37e9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:54:46.561758 15369 raft_consensus.cc:1261] T d69352cdcfdc4d2298c44b808eb7f41e P dffb1087a7b24b1cbf25ea944c523ec3 [term 1 FOLLOWER]: Refusing update from remote peer 2fcef73fcbd2437db005ee281f2c37e9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:54:46.562654 15594 consensus_queue.cc:1035] T d69352cdcfdc4d2298c44b808eb7f41e P 2fcef73fcbd2437db005ee281f2c37e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dffb1087a7b24b1cbf25ea944c523ec3" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 45999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:54:46.563030 15588 consensus_queue.cc:1035] T d69352cdcfdc4d2298c44b808eb7f41e P 2fcef73fcbd2437db005ee281f2c37e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6aa92ae14937480dba1bd6e5231506f4" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:54:46.573932 15597 mvcc.cc:205] Tried to move back new op lower bound from 7316278831347068928 to 7316278831228612608. Current Snapshot: MvccSnapshot[applied={T|T < 7316278831347068928}]
I20260808 14:54:46.586774 15068 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58152:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:54:46.587069 15068 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58152:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:54:46.590787 15068 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 47a83eb0304c41faab27a01dba5630f2: Sending DeleteTablet for 3 replicas of tablet d69352cdcfdc4d2298c44b808eb7f41e
I20260808 14:54:46.591886 15347 tablet_service.cc:1514] Processing DeleteTablet for tablet d69352cdcfdc4d2298c44b808eb7f41e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:54:46 UTC) from {username='slave'} at 127.0.0.1:41422
I20260808 14:54:46.591944 15487 tablet_service.cc:1514] Processing DeleteTablet for tablet d69352cdcfdc4d2298c44b808eb7f41e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:54:46 UTC) from {username='slave'} at 127.0.0.1:56700
I20260808 14:54:46.592394 15198 tablet_service.cc:1514] Processing DeleteTablet for tablet d69352cdcfdc4d2298c44b808eb7f41e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:54:46 UTC) from {username='slave'} at 127.0.0.1:38886
I20260808 14:54:46.593317 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 15131
I20260808 14:54:46.606163 15608 tablet_replica.cc:330] T d69352cdcfdc4d2298c44b808eb7f41e P 6aa92ae14937480dba1bd6e5231506f4: stopping tablet replica
I20260808 14:54:46.606743 15609 tablet_replica.cc:330] T d69352cdcfdc4d2298c44b808eb7f41e P 2fcef73fcbd2437db005ee281f2c37e9: stopping tablet replica
I20260808 14:54:46.607110 15608 raft_consensus.cc:2229] T d69352cdcfdc4d2298c44b808eb7f41e P 6aa92ae14937480dba1bd6e5231506f4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:54:46.607117 15609 raft_consensus.cc:2229] T d69352cdcfdc4d2298c44b808eb7f41e P 2fcef73fcbd2437db005ee281f2c37e9 [term 1 LEADER]: Raft consensus shutting down.
I20260808 14:54:46.607728 15608 raft_consensus.cc:2258] T d69352cdcfdc4d2298c44b808eb7f41e P 6aa92ae14937480dba1bd6e5231506f4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:54:46.607765 15609 raft_consensus.cc:2258] T d69352cdcfdc4d2298c44b808eb7f41e P 2fcef73fcbd2437db005ee281f2c37e9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:54:46.610203 15608 ts_tablet_manager.cc:1905] T d69352cdcfdc4d2298c44b808eb7f41e P 6aa92ae14937480dba1bd6e5231506f4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:54:46.610215 15609 ts_tablet_manager.cc:1905] T d69352cdcfdc4d2298c44b808eb7f41e P 2fcef73fcbd2437db005ee281f2c37e9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:54:46.617250 15608 ts_tablet_manager.cc:1918] T d69352cdcfdc4d2298c44b808eb7f41e P 6aa92ae14937480dba1bd6e5231506f4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:54:46.617571 15608 log.cc:1196] T d69352cdcfdc4d2298c44b808eb7f41e P 6aa92ae14937480dba1bd6e5231506f4: Deleting WAL directory at /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200577490656-27451-0/minicluster-data/ts-2/wal/wals/d69352cdcfdc4d2298c44b808eb7f41e
I20260808 14:54:46.618181 15608 ts_tablet_manager.cc:1939] T d69352cdcfdc4d2298c44b808eb7f41e P 6aa92ae14937480dba1bd6e5231506f4: Deleting consensus metadata
I20260808 14:54:46.620221 15053 catalog_manager.cc:4841] TS 6aa92ae14937480dba1bd6e5231506f4 (127.26.206.195:35201): tablet d69352cdcfdc4d2298c44b808eb7f41e (table test-table [id=f5a0aa41443a4f12b901955928fbede7]) successfully deleted
I20260808 14:54:46.621255 15607 tablet_replica.cc:330] T d69352cdcfdc4d2298c44b808eb7f41e P dffb1087a7b24b1cbf25ea944c523ec3: stopping tablet replica
I20260808 14:54:46.621773 15607 raft_consensus.cc:2229] T d69352cdcfdc4d2298c44b808eb7f41e P dffb1087a7b24b1cbf25ea944c523ec3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:54:46.622781 15607 raft_consensus.cc:2258] T d69352cdcfdc4d2298c44b808eb7f41e P dffb1087a7b24b1cbf25ea944c523ec3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:54:46.623188 15609 ts_tablet_manager.cc:1918] T d69352cdcfdc4d2298c44b808eb7f41e P 2fcef73fcbd2437db005ee281f2c37e9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:54:46.623409 15609 log.cc:1196] T d69352cdcfdc4d2298c44b808eb7f41e P 2fcef73fcbd2437db005ee281f2c37e9: Deleting WAL directory at /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200577490656-27451-0/minicluster-data/ts-0/wal/wals/d69352cdcfdc4d2298c44b808eb7f41e
I20260808 14:54:46.624063 15609 ts_tablet_manager.cc:1939] T d69352cdcfdc4d2298c44b808eb7f41e P 2fcef73fcbd2437db005ee281f2c37e9: Deleting consensus metadata
I20260808 14:54:46.624754 15578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:46.595211 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38908 (local address 127.26.206.193:34593)
0808 14:54:46.595427 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0808 14:54:46.595436 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:54:46.608865 (+ 13429us) server_negotiation.cc:407] Connection header received
0808 14:54:46.615795 (+ 6930us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:54:46.615800 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:54:46.615925 (+ 125us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:54:46.616014 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:54:46.616766 (+ 752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:46.618502 (+ 1736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:46.620430 (+ 1928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:46.621131 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:46.621250 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:46.622891 (+ 1641us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:54:46.622903 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:54:46.622921 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:54:46.623821 (+ 900us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:54:46.623886 (+ 65us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:54:46.623915 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:54:46.623997 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0808 14:54:46.624269 (+ 272us) server_negotiation.cc:299] Negotiation successful
0808 14:54:46.624379 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260808 14:54:46.625373 15607 ts_tablet_manager.cc:1905] T d69352cdcfdc4d2298c44b808eb7f41e P dffb1087a7b24b1cbf25ea944c523ec3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:54:46.626101 15049 catalog_manager.cc:4841] TS 2fcef73fcbd2437db005ee281f2c37e9 (127.26.206.193:34593): tablet d69352cdcfdc4d2298c44b808eb7f41e (table test-table [id=f5a0aa41443a4f12b901955928fbede7]) successfully deleted
I20260808 14:54:46.626175 15267 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:54:46.632985 15607 ts_tablet_manager.cc:1918] T d69352cdcfdc4d2298c44b808eb7f41e P dffb1087a7b24b1cbf25ea944c523ec3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:54:46.633152 15607 log.cc:1196] T d69352cdcfdc4d2298c44b808eb7f41e P dffb1087a7b24b1cbf25ea944c523ec3: Deleting WAL directory at /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200577490656-27451-0/minicluster-data/ts-1/wal/wals/d69352cdcfdc4d2298c44b808eb7f41e
I20260808 14:54:46.633708 15607 ts_tablet_manager.cc:1939] T d69352cdcfdc4d2298c44b808eb7f41e P dffb1087a7b24b1cbf25ea944c523ec3: Deleting consensus metadata
I20260808 14:54:46.635619 15050 catalog_manager.cc:4841] TS dffb1087a7b24b1cbf25ea944c523ec3 (127.26.206.194:45999): tablet d69352cdcfdc4d2298c44b808eb7f41e (table test-table [id=f5a0aa41443a4f12b901955928fbede7]) successfully deleted
I20260808 14:54:46.723874 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 15131
I20260808 14:54:46.746142 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 15277
I20260808 14:54:46.753063 15575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:46.746989 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41426 (local address 127.26.206.194:45999)
0808 14:54:46.747190 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0808 14:54:46.747196 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:54:46.747217 (+ 21us) server_negotiation.cc:407] Connection header received
0808 14:54:46.747422 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:54:46.747427 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:54:46.747522 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:54:46.747658 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:54:46.748046 (+ 388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:46.748865 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:46.750123 (+ 1258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:46.750510 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:46.750602 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:46.751660 (+ 1058us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:54:46.751672 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:54:46.751693 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:54:46.752359 (+ 666us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:54:46.752404 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:54:46.752423 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:54:46.752513 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0808 14:54:46.752629 (+ 116us) server_negotiation.cc:299] Negotiation successful
0808 14:54:46.752712 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260808 14:54:46.753739 15411 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:54:46.841166 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 15277
I20260808 14:54:46.864912 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 15421
I20260808 14:54:46.872166 15576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:46.865779 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56704 (local address 127.26.206.195:35201)
0808 14:54:46.865971 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0808 14:54:46.865979 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:54:46.866007 (+ 28us) server_negotiation.cc:407] Connection header received
0808 14:54:46.866232 (+ 225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:54:46.866236 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:54:46.866342 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:54:46.866450 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:54:46.866864 (+ 414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:46.867763 (+ 899us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:46.869095 (+ 1332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:46.869504 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:46.869658 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:46.870747 (+ 1089us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:54:46.870756 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:54:46.870771 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:54:46.871330 (+ 559us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:54:46.871375 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:54:46.871392 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:54:46.871516 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0808 14:54:46.871828 (+ 312us) server_negotiation.cc:299] Negotiation successful
0808 14:54:46.871925 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260808 14:54:46.872825 15552 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:54:46.960357 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 15421
I20260808 14:54:46.979717 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 15031
I20260808 14:54:46.980799 15101 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:54:47.089120 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 15031
2026-08-08T14:54:47Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (2763 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200577490656-27451-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:54:47 dist-test-slave-6k22 krb5kdc[15618](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:54:47 dist-test-slave-6k22 krb5kdc[15618](info): set up 2 sockets
Aug 08 14:54:47 dist-test-slave-6k22 krb5kdc[15618](info): commencing operation
krb5kdc: starting...
W20260808 14:54:48.275496 27451 mini_kdc.cc:121] Time spent starting KDC: real 1.140s user 0.000s sys 0.038s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200577490656-27451-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200577490656-27451-0/krb5kdc/test-user.keytab.
Aug 08 14:54:48 dist-test-slave-6k22 krb5kdc[15618](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200888, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:54:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:54:48Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.206.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.206.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.206.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.254.keytab.
Entry for principal kudu/127.26.206.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.254.keytab.
I20260808 14:54:48.580538 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200577490656-27451-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200577490656-27451-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200577490656-27451-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.206.254:39233
--webserver_interface=127.26.206.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.254.keytab
--principal=kudu/127.26.206.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.206.212:41917
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.206.254:39233
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:54:48.928313 15633 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:54:48.928630 15633 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:54:48.928851 15633 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:54:48.936275 15633 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:54:48.936424 15633 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:54:48.936550 15633 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:54:48.936668 15633 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:54:48.936753 15633 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:54:48.946772 15633 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:41917
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200577490656-27451-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200577490656-27451-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.206.254:39233
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.254.keytab
--principal=kudu/127.26.206.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.206.254:39233
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.206.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200577490656-27451-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:54:48.948342 15633 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:54:48.949697 15633 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:54:48.961521 15639 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:54:48.961472 15641 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:54:48.961547 15638 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:54:48.962741 15633 server_base.cc:1034] running on GCE node
I20260808 14:54:48.963668 15633 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:54:48.965098 15633 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:54:48.966404 15633 hybrid_clock.cc:648] HybridClock initialized: now 1786200888966327 us; error 47 us; skew 500 ppm
I20260808 14:54:48.966796 15633 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:54:48 dist-test-slave-6k22 krb5kdc[15618](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200888, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:54:48.970197 15633 init.cc:377] Logged in from keytab as kudu/127.26.206.254@KRBTEST.COM (short username kudu)
I20260808 14:54:48.971788 15633 webserver.cc:460] Webserver started at http://127.26.206.254:38371/ using document root <none> and password file <none>
I20260808 14:54:48.972543 15633 fs_manager.cc:359] Metadata directory not provided
I20260808 14:54:48.972668 15633 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:54:48.972935 15633 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:54:48.976089 15633 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200577490656-27451-0/minicluster-data/master-0/data/instance:
uuid: "1c0de2c6909144f782f162275b8fbca1"
format_stamp: "Formatted at 2026-08-08 14:54:48 on dist-test-slave-6k22"
server_key: "d20c444c3daa6534b89407811e1d3164"
server_key_iv: "e431c8cbe609c52697fd7b0e2116f5b0"
server_key_version: "encryptionkey@0"
I20260808 14:54:48.976871 15633 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200577490656-27451-0/minicluster-data/master-0/wal/instance:
uuid: "1c0de2c6909144f782f162275b8fbca1"
format_stamp: "Formatted at 2026-08-08 14:54:48 on dist-test-slave-6k22"
server_key: "d20c444c3daa6534b89407811e1d3164"
server_key_iv: "e431c8cbe609c52697fd7b0e2116f5b0"
server_key_version: "encryptionkey@0"
I20260808 14:54:48.982175 15633 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.005s
I20260808 14:54:48.985586 15649 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:54:48.986912 15633 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.001s
I20260808 14:54:48.987061 15633 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200577490656-27451-0/minicluster-data/master-0/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200577490656-27451-0/minicluster-data/master-0/wal
uuid: "1c0de2c6909144f782f162275b8fbca1"
format_stamp: "Formatted at 2026-08-08 14:54:48 on dist-test-slave-6k22"
server_key: "d20c444c3daa6534b89407811e1d3164"
server_key_iv: "e431c8cbe609c52697fd7b0e2116f5b0"
server_key_version: "encryptionkey@0"
I20260808 14:54:48.987233 15633 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200577490656-27451-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200577490656-27451-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200577490656-27451-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:54:48.998653 15633 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:54:49.002728 15633 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:54:49.002992 15633 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:54:49.022396 15633 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.254:39233
I20260808 14:54:49.022418 15703 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.254:39233 every 8 connection(s)
I20260808 14:54:49.023864 15633 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
I20260808 14:54:49.027789 15704 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:54:49.030747 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 15633
I20260808 14:54:49.030959 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200577490656-27451-0/minicluster-data/master-0/wal/instance
I20260808 14:54:49.031531 27451 external_mini_cluster.cc:1428] Setting key f8266e6617804f1e92be2dab34371b4e
I20260808 14:54:49.040340 15704 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1c0de2c6909144f782f162275b8fbca1: Bootstrap starting.
I20260808 14:54:49.044175 15704 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1c0de2c6909144f782f162275b8fbca1: Neither blocks nor log segments found. Creating new log.
I20260808 14:54:49.045526 15704 log.cc:824] T 00000000000000000000000000000000 P 1c0de2c6909144f782f162275b8fbca1: Log is configured to *not* fsync() on all Append() calls
Aug 08 14:54:49 dist-test-slave-6k22 krb5kdc[15618](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200888, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.206.254@KRBTEST.COM
I20260808 14:54:49.048525 15704 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1c0de2c6909144f782f162275b8fbca1: No bootstrap required, opened a new log
I20260808 14:54:49.055764 15707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:49.033482 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48844 (local address 127.26.206.254:39233)
0808 14:54:49.034377 (+ 895us) server_negotiation.cc:206] Beginning negotiation
0808 14:54:49.034388 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 14:54:49.034431 (+ 43us) server_negotiation.cc:407] Connection header received
0808 14:54:49.036214 (+ 1783us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:54:49.036235 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:54:49.036604 (+ 369us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:54:49.036919 (+ 315us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:54:49.038862 (+ 1943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:49.040270 (+ 1408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:49.042226 (+ 1956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:49.042912 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:49.043039 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:49.048247 (+ 5208us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:54:49.048254 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:54:49.048267 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:54:49.048302 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:54:49.051650 (+ 3348us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:54:49.052372 (+ 722us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:54:49.052381 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:54:49.052390 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:54:49.052567 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:54:49.052963 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:54:49.052968 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:54:49.052971 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:54:49.053500 (+ 529us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:54:49.053814 (+ 314us) server_negotiation.cc:1035] Waiting for connection context
0808 14:54:49.054291 (+ 477us) server_negotiation.cc:299] Negotiation successful
0808 14:54:49.054712 (+ 421us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":606,"thread_start_us":400,"threads_started":1}
I20260808 14:54:49.056481 15704 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1c0de2c6909144f782f162275b8fbca1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c0de2c6909144f782f162275b8fbca1" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 39233 } }
I20260808 14:54:49.056839 15704 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1c0de2c6909144f782f162275b8fbca1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:54:49.056964 15704 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1c0de2c6909144f782f162275b8fbca1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c0de2c6909144f782f162275b8fbca1, State: Initialized, Role: FOLLOWER
I20260808 14:54:49.057610 15704 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1c0de2c6909144f782f162275b8fbca1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c0de2c6909144f782f162275b8fbca1" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 39233 } }
I20260808 14:54:49.057885 15704 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1c0de2c6909144f782f162275b8fbca1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:54:49.058034 15704 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1c0de2c6909144f782f162275b8fbca1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:54:49.058205 15704 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1c0de2c6909144f782f162275b8fbca1 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:54:49.060595 15704 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1c0de2c6909144f782f162275b8fbca1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c0de2c6909144f782f162275b8fbca1" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 39233 } }
I20260808 14:54:49.061008 15704 leader_election.cc:302] T 00000000000000000000000000000000 P 1c0de2c6909144f782f162275b8fbca1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1c0de2c6909144f782f162275b8fbca1; no voters:
I20260808 14:54:49.061511 15704 leader_election.cc:288] T 00000000000000000000000000000000 P 1c0de2c6909144f782f162275b8fbca1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:54:49.061698 15709 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1c0de2c6909144f782f162275b8fbca1 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:54:49.062397 15709 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1c0de2c6909144f782f162275b8fbca1 [term 1 LEADER]: Becoming Leader. State: Replica: 1c0de2c6909144f782f162275b8fbca1, State: Running, Role: LEADER
I20260808 14:54:49.062906 15709 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1c0de2c6909144f782f162275b8fbca1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c0de2c6909144f782f162275b8fbca1" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 39233 } }
I20260808 14:54:49.063671 15704 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1c0de2c6909144f782f162275b8fbca1 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:54:49.065712 15712 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1c0de2c6909144f782f162275b8fbca1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1c0de2c6909144f782f162275b8fbca1. Latest consensus state: current_term: 1 leader_uuid: "1c0de2c6909144f782f162275b8fbca1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c0de2c6909144f782f162275b8fbca1" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 39233 } } }
I20260808 14:54:49.066241 15712 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1c0de2c6909144f782f162275b8fbca1 [sys.catalog]: This master's current role is: LEADER
I20260808 14:54:49.066965 15710 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1c0de2c6909144f782f162275b8fbca1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1c0de2c6909144f782f162275b8fbca1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c0de2c6909144f782f162275b8fbca1" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 39233 } } }
I20260808 14:54:49.067415 15710 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1c0de2c6909144f782f162275b8fbca1 [sys.catalog]: This master's current role is: LEADER
I20260808 14:54:49.070469 15716 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:54:49.075861 15716 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:54:49.084997 15716 catalog_manager.cc:1347] Generated new cluster ID: b4972a23687d4cadbb66b8691c1d14b3
I20260808 14:54:49.085115 15716 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:54:49.096756 15716 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:54:49.097993 15716 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:54:49.106086 15716 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1c0de2c6909144f782f162275b8fbca1: Generated new TSK 0
I20260808 14:54:49.106843 15716 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.206.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.206.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.206.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.193.keytab.
Entry for principal kudu/127.26.206.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.193.keytab.
I20260808 14:54:49.181401 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200577490656-27451-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200577490656-27451-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200577490656-27451-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200577490656-27451-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.206.193:0
--local_ip_for_outbound_sockets=127.26.206.193
--webserver_interface=127.26.206.193
--webserver_port=0
--tserver_master_addrs=127.26.206.254:39233
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.193.keytab
--principal=kudu/127.26.206.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.206.212:41917
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:54:49.520428 15732 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:54:49.520738 15732 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:54:49.520907 15732 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:54:49.528133 15732 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:54:49.528270 15732 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:54:49.528455 15732 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.206.193
I20260808 14:54:49.538039 15732 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:41917
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200577490656-27451-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200577490656-27451-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.193.keytab
--principal=kudu/127.26.206.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.206.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200577490656-27451-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.206.193
--webserver_port=0
--tserver_master_addrs=127.26.206.254:39233
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.206.193
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200577490656-27451-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:54:49.539296 15732 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:54:49.540608 15732 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:54:49.553835 15739 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:54:49.553910 15741 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:54:49.553828 15738 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:54:49.554720 15732 server_base.cc:1034] running on GCE node
I20260808 14:54:49.555477 15732 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:54:49.556449 15732 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:54:49.557651 15732 hybrid_clock.cc:648] HybridClock initialized: now 1786200889557573 us; error 68 us; skew 500 ppm
I20260808 14:54:49.557971 15732 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:54:49 dist-test-slave-6k22 krb5kdc[15618](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200889, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:54:49.561422 15732 init.cc:377] Logged in from keytab as kudu/127.26.206.193@KRBTEST.COM (short username kudu)
I20260808 14:54:49.562865 15732 webserver.cc:460] Webserver started at http://127.26.206.193:39697/ using document root <none> and password file <none>
I20260808 14:54:49.563524 15732 fs_manager.cc:359] Metadata directory not provided
I20260808 14:54:49.563712 15732 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:54:49.564065 15732 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:54:49.566998 15732 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200577490656-27451-0/minicluster-data/ts-0/data/instance:
uuid: "5ebd1c448af5431c83a6bc1f926e8ae5"
format_stamp: "Formatted at 2026-08-08 14:54:49 on dist-test-slave-6k22"
server_key: "d7ff6d19eaae0f679efcb82b2babd42b"
server_key_iv: "2e35bb8af830710b8ac5e6f1e7552c28"
server_key_version: "encryptionkey@0"
I20260808 14:54:49.567778 15732 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200577490656-27451-0/minicluster-data/ts-0/wal/instance:
uuid: "5ebd1c448af5431c83a6bc1f926e8ae5"
format_stamp: "Formatted at 2026-08-08 14:54:49 on dist-test-slave-6k22"
server_key: "d7ff6d19eaae0f679efcb82b2babd42b"
server_key_iv: "2e35bb8af830710b8ac5e6f1e7552c28"
server_key_version: "encryptionkey@0"
I20260808 14:54:49.572989 15732 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260808 14:54:49.576305 15748 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:54:49.577596 15732 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 14:54:49.577771 15732 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200577490656-27451-0/minicluster-data/ts-0/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200577490656-27451-0/minicluster-data/ts-0/wal
uuid: "5ebd1c448af5431c83a6bc1f926e8ae5"
format_stamp: "Formatted at 2026-08-08 14:54:49 on dist-test-slave-6k22"
server_key: "d7ff6d19eaae0f679efcb82b2babd42b"
server_key_iv: "2e35bb8af830710b8ac5e6f1e7552c28"
server_key_version: "encryptionkey@0"
I20260808 14:54:49.577988 15732 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200577490656-27451-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200577490656-27451-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200577490656-27451-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:54:49.594110 15732 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:54:49.597958 15732 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:54:49.598256 15732 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:54:49.599187 15732 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:54:49.600548 15732 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:54:49.600649 15732 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:54:49.600831 15732 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:54:49.600912 15732 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:54:49.634718 15732 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.193:40979
I20260808 14:54:49.634771 15869 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.193:40979 every 8 connection(s)
I20260808 14:54:49.636135 15732 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200577490656-27451-0/minicluster-data/ts-0/data/info.pb
I20260808 14:54:49.642448 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 15732
I20260808 14:54:49.642656 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200577490656-27451-0/minicluster-data/ts-0/wal/instance
I20260808 14:54:49.643105 27451 external_mini_cluster.cc:1428] Setting key fdd54733c084254db4d692010181fe01
Aug 08 14:54:49 dist-test-slave-6k22 krb5kdc[15618](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200889, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.193@KRBTEST.COM for kudu/127.26.206.254@KRBTEST.COM
I20260808 14:54:49.657711 15872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:49.638700 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.193:51657 (local address 127.26.206.254:39233)
0808 14:54:49.639158 (+ 458us) server_negotiation.cc:206] Beginning negotiation
0808 14:54:49.639163 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:54:49.640155 (+ 992us) server_negotiation.cc:407] Connection header received
0808 14:54:49.641990 (+ 1835us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:54:49.641996 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:54:49.642087 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:54:49.642209 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:54:49.644036 (+ 1827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:49.644914 (+ 878us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:49.646591 (+ 1677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:49.647330 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:49.647481 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:49.650950 (+ 3469us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:54:49.650959 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:54:49.650966 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:54:49.651009 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:54:49.654430 (+ 3421us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:54:49.655117 (+ 687us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:54:49.655124 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:54:49.655130 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:54:49.655302 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:54:49.655756 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:54:49.655764 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:54:49.655769 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:54:49.656146 (+ 377us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:54:49.656300 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0808 14:54:49.656973 (+ 673us) server_negotiation.cc:299] Negotiation successful
0808 14:54:49.657228 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":337,"thread_start_us":230,"threads_started":1}
I20260808 14:54:49.658293 15873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:49.639246 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:39233 (local address 127.26.206.193:51657)
0808 14:54:49.639998 (+ 752us) negotiation.cc:107] Waiting for socket to connect
0808 14:54:49.640036 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 14:54:49.641729 (+ 1693us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:54:49.642469 (+ 740us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:54:49.642477 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:54:49.643097 (+ 620us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:54:49.643847 (+ 750us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:54:49.643875 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:54:49.645100 (+ 1225us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:54:49.645105 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:54:49.646440 (+ 1335us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:54:49.646453 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:54:49.647618 (+ 1165us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:54:49.647626 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:54:49.647868 (+ 242us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:49.648560 (+ 692us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:54:49.648587 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:54:49.650735 (+ 2148us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:54:49.654569 (+ 3834us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:54:49.654575 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:54:49.654586 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:54:49.654988 (+ 402us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:54:49.655406 (+ 418us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:54:49.655409 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:54:49.655411 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:54:49.655643 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:54:49.656274 (+ 631us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:54:49.656279 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:54:49.656590 (+ 311us) client_negotiation.cc:769] Sending connection context
0808 14:54:49.656822 (+ 232us) client_negotiation.cc:240] Negotiation successful
0808 14:54:49.657189 (+ 367us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":527,"thread_start_us":327,"threads_started":1}
I20260808 14:54:49.660082 15870 heartbeater.cc:347] Connected to a master server at 127.26.206.254:39233
I20260808 14:54:49.660396 15870 heartbeater.cc:464] Registering TS with master...
I20260808 14:54:49.661130 15870 heartbeater.cc:511] Master 127.26.206.254:39233 requested a full tablet report, sending...
I20260808 14:54:49.663383 15666 ts_manager.cc:194] Registered new tserver with Master: 5ebd1c448af5431c83a6bc1f926e8ae5 (127.26.206.193:40979)
I20260808 14:54:49.665609 15666 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.206.193@KRBTEST.COM'} at 127.26.206.193:51657
WARNING: no policy specified for kudu/127.26.206.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.206.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.206.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.194.keytab.
Entry for principal kudu/127.26.206.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.194.keytab.
I20260808 14:54:49.710728 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200577490656-27451-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200577490656-27451-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200577490656-27451-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200577490656-27451-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.206.194:0
--local_ip_for_outbound_sockets=127.26.206.194
--webserver_interface=127.26.206.194
--webserver_port=0
--tserver_master_addrs=127.26.206.254:39233
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.194.keytab
--principal=kudu/127.26.206.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.206.212:41917
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:54:50.055073 15876 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:54:50.055404 15876 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:54:50.055624 15876 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:54:50.062662 15876 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:54:50.062803 15876 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:54:50.062979 15876 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.206.194
I20260808 14:54:50.072686 15876 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:41917
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200577490656-27451-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200577490656-27451-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.194.keytab
--principal=kudu/127.26.206.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.206.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200577490656-27451-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.206.194
--webserver_port=0
--tserver_master_addrs=127.26.206.254:39233
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.206.194
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200577490656-27451-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:54:50.073951 15876 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:54:50.075192 15876 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:54:50.087970 15882 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:54:50.087941 15886 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:54:50.088203 15883 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:54:50.089191 15876 server_base.cc:1034] running on GCE node
I20260808 14:54:50.089798 15876 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:54:50.090768 15876 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:54:50.091979 15876 hybrid_clock.cc:648] HybridClock initialized: now 1786200890091935 us; error 55 us; skew 500 ppm
I20260808 14:54:50.092332 15876 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:54:50 dist-test-slave-6k22 krb5kdc[15618](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200890, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:54:50.099987 15876 init.cc:377] Logged in from keytab as kudu/127.26.206.194@KRBTEST.COM (short username kudu)
I20260808 14:54:50.101327 15876 webserver.cc:460] Webserver started at http://127.26.206.194:35193/ using document root <none> and password file <none>
I20260808 14:54:50.101984 15876 fs_manager.cc:359] Metadata directory not provided
I20260808 14:54:50.102128 15876 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:54:50.102439 15876 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:54:50.105213 15876 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200577490656-27451-0/minicluster-data/ts-1/data/instance:
uuid: "8b46ca1a0b864a7f9d60c754c04514b3"
format_stamp: "Formatted at 2026-08-08 14:54:50 on dist-test-slave-6k22"
server_key: "67903306d57b278a8c62cb2417ac30ff"
server_key_iv: "b3ba12dee80d7a5b6510d4aacb187916"
server_key_version: "encryptionkey@0"
I20260808 14:54:50.105983 15876 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200577490656-27451-0/minicluster-data/ts-1/wal/instance:
uuid: "8b46ca1a0b864a7f9d60c754c04514b3"
format_stamp: "Formatted at 2026-08-08 14:54:50 on dist-test-slave-6k22"
server_key: "67903306d57b278a8c62cb2417ac30ff"
server_key_iv: "b3ba12dee80d7a5b6510d4aacb187916"
server_key_version: "encryptionkey@0"
I20260808 14:54:50.110821 15876 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260808 14:54:50.113931 15893 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:54:50.115123 15876 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260808 14:54:50.115314 15876 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200577490656-27451-0/minicluster-data/ts-1/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200577490656-27451-0/minicluster-data/ts-1/wal
uuid: "8b46ca1a0b864a7f9d60c754c04514b3"
format_stamp: "Formatted at 2026-08-08 14:54:50 on dist-test-slave-6k22"
server_key: "67903306d57b278a8c62cb2417ac30ff"
server_key_iv: "b3ba12dee80d7a5b6510d4aacb187916"
server_key_version: "encryptionkey@0"
I20260808 14:54:50.115504 15876 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200577490656-27451-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200577490656-27451-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200577490656-27451-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:54:50.145131 15876 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:54:50.149545 15876 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:54:50.149859 15876 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:54:50.150767 15876 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:54:50.152045 15876 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:54:50.152146 15876 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:54:50.152288 15876 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:54:50.152372 15876 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:54:50.186739 15876 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.194:44687
I20260808 14:54:50.186815 16010 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.194:44687 every 8 connection(s)
I20260808 14:54:50.188040 15876 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200577490656-27451-0/minicluster-data/ts-1/data/info.pb
I20260808 14:54:50.190371 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 15876
I20260808 14:54:50.190575 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200577490656-27451-0/minicluster-data/ts-1/wal/instance
I20260808 14:54:50.191183 27451 external_mini_cluster.cc:1428] Setting key 4dba192cff510da0a648e10e3d861ad5
Aug 08 14:54:50 dist-test-slave-6k22 krb5kdc[15618](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200890, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.194@KRBTEST.COM for kudu/127.26.206.254@KRBTEST.COM
I20260808 14:54:50.210541 16013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:50.190699 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.194:48759 (local address 127.26.206.254:39233)
0808 14:54:50.191180 (+ 481us) server_negotiation.cc:206] Beginning negotiation
0808 14:54:50.191185 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:54:50.192209 (+ 1024us) server_negotiation.cc:407] Connection header received
0808 14:54:50.194517 (+ 2308us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:54:50.194520 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:54:50.194579 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:54:50.194679 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:54:50.196752 (+ 2073us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:50.197478 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:50.199881 (+ 2403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:50.200292 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:50.200385 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:50.204570 (+ 4185us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:54:50.204575 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:54:50.204578 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:54:50.204608 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:54:50.207222 (+ 2614us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:54:50.208010 (+ 788us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:54:50.208018 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:54:50.208022 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:54:50.208198 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:54:50.208690 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:54:50.208697 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:54:50.208703 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:54:50.209068 (+ 365us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:54:50.209217 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0808 14:54:50.209830 (+ 613us) server_negotiation.cc:299] Negotiation successful
0808 14:54:50.210074 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":349,"thread_start_us":231,"threads_started":1}
I20260808 14:54:50.211047 16014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:50.191223 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:39233 (local address 127.26.206.194:48759)
0808 14:54:50.192044 (+ 821us) negotiation.cc:107] Waiting for socket to connect
0808 14:54:50.192092 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0808 14:54:50.194232 (+ 2140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:54:50.194924 (+ 692us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:54:50.194938 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:54:50.195802 (+ 864us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:54:50.196577 (+ 775us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:54:50.196603 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:54:50.197645 (+ 1042us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:54:50.197652 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:54:50.199748 (+ 2096us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:54:50.199764 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:54:50.200512 (+ 748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:54:50.200521 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:54:50.200856 (+ 335us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:50.201579 (+ 723us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:54:50.201612 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:54:50.204338 (+ 2726us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:54:50.207374 (+ 3036us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:54:50.207380 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:54:50.207390 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:54:50.207870 (+ 480us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:54:50.208335 (+ 465us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:54:50.208338 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:54:50.208341 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:54:50.208571 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:54:50.209186 (+ 615us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:54:50.209191 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:54:50.209471 (+ 280us) client_negotiation.cc:769] Sending connection context
0808 14:54:50.209677 (+ 206us) client_negotiation.cc:240] Negotiation successful
0808 14:54:50.210006 (+ 329us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":581,"thread_start_us":358,"threads_started":1}
I20260808 14:54:50.212522 16011 heartbeater.cc:347] Connected to a master server at 127.26.206.254:39233
I20260808 14:54:50.212826 16011 heartbeater.cc:464] Registering TS with master...
I20260808 14:54:50.213508 16011 heartbeater.cc:511] Master 127.26.206.254:39233 requested a full tablet report, sending...
I20260808 14:54:50.215054 15666 ts_manager.cc:194] Registered new tserver with Master: 8b46ca1a0b864a7f9d60c754c04514b3 (127.26.206.194:44687)
I20260808 14:54:50.216348 15666 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.206.194@KRBTEST.COM'} at 127.26.206.194:48759
WARNING: no policy specified for kudu/127.26.206.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.206.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.206.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.195.keytab.
Entry for principal kudu/127.26.206.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.195.keytab.
I20260808 14:54:50.258720 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200577490656-27451-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200577490656-27451-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200577490656-27451-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200577490656-27451-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.206.195:0
--local_ip_for_outbound_sockets=127.26.206.195
--webserver_interface=127.26.206.195
--webserver_port=0
--tserver_master_addrs=127.26.206.254:39233
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.195.keytab
--principal=kudu/127.26.206.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.206.212:41917
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:54:50.590314 16017 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:54:50.590607 16017 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:54:50.590780 16017 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:54:50.598088 16017 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:54:50.598182 16017 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:54:50.598296 16017 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.206.195
I20260808 14:54:50.607649 16017 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:41917
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200577490656-27451-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200577490656-27451-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.195.keytab
--principal=kudu/127.26.206.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.206.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200577490656-27451-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.206.195
--webserver_port=0
--tserver_master_addrs=127.26.206.254:39233
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.206.195
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200577490656-27451-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:54:50.608765 16017 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:54:50.610231 16017 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:54:50.623732 16023 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:54:50.623911 16022 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:54:50.623759 16025 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:54:50.625120 16017 server_base.cc:1034] running on GCE node
I20260808 14:54:50.625685 16017 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:54:50.626572 16017 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:54:50.627790 16017 hybrid_clock.cc:648] HybridClock initialized: now 1786200890627748 us; error 52 us; skew 500 ppm
I20260808 14:54:50.628085 16017 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:54:50 dist-test-slave-6k22 krb5kdc[15618](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200890, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:54:50.631037 16017 init.cc:377] Logged in from keytab as kudu/127.26.206.195@KRBTEST.COM (short username kudu)
I20260808 14:54:50.632403 16017 webserver.cc:460] Webserver started at http://127.26.206.195:32999/ using document root <none> and password file <none>
I20260808 14:54:50.632993 16017 fs_manager.cc:359] Metadata directory not provided
I20260808 14:54:50.633091 16017 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:54:50.633353 16017 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:54:50.637177 16017 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200577490656-27451-0/minicluster-data/ts-2/data/instance:
uuid: "147a5837556d4c449dd1a1148d140f96"
format_stamp: "Formatted at 2026-08-08 14:54:50 on dist-test-slave-6k22"
server_key: "b2f3f26b1c385ad42906004b05bdc187"
server_key_iv: "bb9e13fd2e109c5d131cc2b8a5443bfe"
server_key_version: "encryptionkey@0"
I20260808 14:54:50.638168 16017 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200577490656-27451-0/minicluster-data/ts-2/wal/instance:
uuid: "147a5837556d4c449dd1a1148d140f96"
format_stamp: "Formatted at 2026-08-08 14:54:50 on dist-test-slave-6k22"
server_key: "b2f3f26b1c385ad42906004b05bdc187"
server_key_iv: "bb9e13fd2e109c5d131cc2b8a5443bfe"
server_key_version: "encryptionkey@0"
I20260808 14:54:50.643934 16017 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.008s sys 0.000s
I20260808 14:54:50.647167 16035 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:54:50.648437 16017 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 14:54:50.648595 16017 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200577490656-27451-0/minicluster-data/ts-2/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200577490656-27451-0/minicluster-data/ts-2/wal
uuid: "147a5837556d4c449dd1a1148d140f96"
format_stamp: "Formatted at 2026-08-08 14:54:50 on dist-test-slave-6k22"
server_key: "b2f3f26b1c385ad42906004b05bdc187"
server_key_iv: "bb9e13fd2e109c5d131cc2b8a5443bfe"
server_key_version: "encryptionkey@0"
I20260808 14:54:50.648784 16017 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200577490656-27451-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200577490656-27451-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200577490656-27451-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:54:50.668547 15870 heartbeater.cc:503] Master 127.26.206.254:39233 was elected leader, sending a full tablet report...
I20260808 14:54:50.674855 16017 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:54:50.678587 16017 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:54:50.678879 16017 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:54:50.679839 16017 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:54:50.681121 16017 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:54:50.681219 16017 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:54:50.681362 16017 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:54:50.681432 16017 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:54:50.714535 16017 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.195:37207
I20260808 14:54:50.714596 16158 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.195:37207 every 8 connection(s)
I20260808 14:54:50.715961 16017 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200577490656-27451-0/minicluster-data/ts-2/data/info.pb
I20260808 14:54:50.716264 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 16017
I20260808 14:54:50.716468 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200577490656-27451-0/minicluster-data/ts-2/wal/instance
I20260808 14:54:50.717103 27451 external_mini_cluster.cc:1428] Setting key 98d9d841361270fe032c2a612f97ebad
Aug 08 14:54:50 dist-test-slave-6k22 krb5kdc[15618](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200890, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.195@KRBTEST.COM for kudu/127.26.206.254@KRBTEST.COM
I20260808 14:54:50.735852 16161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:50.718716 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.195:50801 (local address 127.26.206.254:39233)
0808 14:54:50.719270 (+ 554us) server_negotiation.cc:206] Beginning negotiation
0808 14:54:50.719285 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 14:54:50.720453 (+ 1168us) server_negotiation.cc:407] Connection header received
0808 14:54:50.722232 (+ 1779us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:54:50.722236 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:54:50.722320 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:54:50.722413 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:54:50.723930 (+ 1517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:50.724683 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:50.726125 (+ 1442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:50.726507 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:50.726596 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:50.729902 (+ 3306us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:54:50.729906 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:54:50.729910 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:54:50.729941 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:54:50.733205 (+ 3264us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:54:50.733853 (+ 648us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:54:50.733857 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:54:50.733859 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:54:50.733970 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:54:50.734350 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:54:50.734353 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:54:50.734355 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:54:50.734614 (+ 259us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:54:50.734729 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0808 14:54:50.735356 (+ 627us) server_negotiation.cc:299] Negotiation successful
0808 14:54:50.735510 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":432,"thread_start_us":277,"threads_started":1}
I20260808 14:54:50.736737 16162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:50.719351 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:39233 (local address 127.26.206.195:50801)
0808 14:54:50.720289 (+ 938us) negotiation.cc:107] Waiting for socket to connect
0808 14:54:50.720336 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0808 14:54:50.722002 (+ 1666us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:54:50.722636 (+ 634us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:54:50.722644 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:54:50.723131 (+ 487us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:54:50.723773 (+ 642us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:54:50.723798 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:54:50.724814 (+ 1016us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:54:50.724817 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:54:50.726007 (+ 1190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:54:50.726019 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:54:50.726679 (+ 660us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:54:50.726683 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:54:50.726886 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:50.727521 (+ 635us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:54:50.727542 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:54:50.729709 (+ 2167us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:54:50.733325 (+ 3616us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:54:50.733331 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:54:50.733342 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:54:50.733739 (+ 397us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:54:50.734060 (+ 321us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:54:50.734063 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:54:50.734065 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:54:50.734233 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:54:50.734723 (+ 490us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:54:50.734728 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:54:50.735029 (+ 301us) client_negotiation.cc:769] Sending connection context
0808 14:54:50.735243 (+ 214us) client_negotiation.cc:240] Negotiation successful
0808 14:54:50.735673 (+ 430us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":592,"thread_start_us":356,"threads_started":1}
I20260808 14:54:50.738082 16159 heartbeater.cc:347] Connected to a master server at 127.26.206.254:39233
I20260808 14:54:50.738355 16159 heartbeater.cc:464] Registering TS with master...
I20260808 14:54:50.738991 16159 heartbeater.cc:511] Master 127.26.206.254:39233 requested a full tablet report, sending...
I20260808 14:54:50.740358 15666 ts_manager.cc:194] Registered new tserver with Master: 147a5837556d4c449dd1a1148d140f96 (127.26.206.195:37207)
I20260808 14:54:50.741148 15666 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.206.195@KRBTEST.COM'} at 127.26.206.195:50801
I20260808 14:54:50.744886 27451 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 14:54:50.761859 16161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:50.749056 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48848 (local address 127.26.206.254:39233)
0808 14:54:50.749209 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0808 14:54:50.749213 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:54:50.749750 (+ 537us) server_negotiation.cc:407] Connection header received
0808 14:54:50.749956 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:54:50.749960 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:54:50.750013 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:54:50.750092 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:54:50.751441 (+ 1349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:50.752281 (+ 840us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:50.753697 (+ 1416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:50.754093 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:50.754205 (+ 112us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:50.756764 (+ 2559us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:54:50.756769 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:54:50.756772 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:54:50.756807 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:54:50.759374 (+ 2567us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:54:50.760154 (+ 780us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:54:50.760158 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:54:50.760160 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:54:50.760268 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:54:50.760671 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:54:50.760674 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:54:50.760676 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:54:50.760944 (+ 268us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:54:50.761126 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0808 14:54:50.761453 (+ 327us) server_negotiation.cc:299] Negotiation successful
0808 14:54:50.761634 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260808 14:54:50.765571 15666 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48848:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:54:50.772380 15666 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:54:50.806389 16175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:50.784385 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54590 (local address 127.26.206.195:37207)
0808 14:54:50.796701 (+ 12316us) server_negotiation.cc:206] Beginning negotiation
0808 14:54:50.796710 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:54:50.797013 (+ 303us) server_negotiation.cc:407] Connection header received
0808 14:54:50.797133 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:54:50.797141 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:54:50.797414 (+ 273us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:54:50.799161 (+ 1747us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:54:50.799460 (+ 299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:50.800905 (+ 1445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:50.803816 (+ 2911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:50.805032 (+ 1216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:50.805243 (+ 211us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:50.805426 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0808 14:54:50.805884 (+ 458us) server_negotiation.cc:299] Negotiation successful
0808 14:54:50.806061 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12113,"thread_start_us":12326,"threads_started":1}
I20260808 14:54:50.806632 16174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:50.783711 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.193:40979 (local address 127.0.0.1:55956)
0808 14:54:50.794846 (+ 11135us) negotiation.cc:107] Waiting for socket to connect
0808 14:54:50.794913 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0808 14:54:50.795134 (+ 221us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:54:50.798021 (+ 2887us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:54:50.798025 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:54:50.798048 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:54:50.798618 (+ 570us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:54:50.798633 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:54:50.801260 (+ 2627us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:54:50.801265 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:54:50.803746 (+ 2481us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:54:50.803760 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:54:50.805676 (+ 1916us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:54:50.805681 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:54:50.805884 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:50.805915 (+ 31us) client_negotiation.cc:769] Sending connection context
0808 14:54:50.806002 (+ 87us) client_negotiation.cc:240] Negotiation successful
0808 14:54:50.806181 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10776,"mutex_wait_us":62,"thread_start_us":13474,"threads_started":1}
I20260808 14:54:50.806900 16173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:50.783864 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55956 (local address 127.26.206.193:40979)
0808 14:54:50.797473 (+ 13609us) server_negotiation.cc:206] Beginning negotiation
0808 14:54:50.797481 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:54:50.797510 (+ 29us) server_negotiation.cc:407] Connection header received
0808 14:54:50.797604 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:54:50.797612 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:54:50.797843 (+ 231us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:54:50.798030 (+ 187us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:54:50.798835 (+ 805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:50.801053 (+ 2218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:50.803961 (+ 2908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:50.805442 (+ 1481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:50.805657 (+ 215us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:50.805829 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0808 14:54:50.806060 (+ 231us) server_negotiation.cc:299] Negotiation successful
0808 14:54:50.806229 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13441,"thread_start_us":13193,"threads_started":1}
I20260808 14:54:50.807226 16172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:50.784094 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.195:37207 (local address 127.0.0.1:54590)
0808 14:54:50.796749 (+ 12655us) negotiation.cc:107] Waiting for socket to connect
0808 14:54:50.796767 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 14:54:50.796884 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:54:50.797662 (+ 778us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:54:50.797669 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:54:50.797711 (+ 42us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:54:50.799011 (+ 1300us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:54:50.799021 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:54:50.801051 (+ 2030us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:54:50.801056 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:54:50.803599 (+ 2543us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:54:50.803614 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:54:50.805287 (+ 1673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:54:50.805297 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:54:50.805581 (+ 284us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:50.805668 (+ 87us) client_negotiation.cc:769] Sending connection context
0808 14:54:50.806675 (+ 1007us) client_negotiation.cc:240] Negotiation successful
0808 14:54:50.806832 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12525,"mutex_wait_us":125,"thread_start_us":11283,"threads_started":1}
I20260808 14:54:50.809966 16176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:50.797564 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.194:44687 (local address 127.0.0.1:58048)
0808 14:54:50.798729 (+ 1165us) negotiation.cc:107] Waiting for socket to connect
0808 14:54:50.798746 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 14:54:50.798869 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:54:50.802047 (+ 3178us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:54:50.802051 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:54:50.802097 (+ 46us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:54:50.802620 (+ 523us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:54:50.802633 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:54:50.804598 (+ 1965us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:54:50.804604 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:54:50.806826 (+ 2222us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:54:50.806842 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:54:50.809183 (+ 2341us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:54:50.809192 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:54:50.809357 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:50.809388 (+ 31us) client_negotiation.cc:769] Sending connection context
0808 14:54:50.809476 (+ 88us) client_negotiation.cc:240] Negotiation successful
0808 14:54:50.809589 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1025,"mutex_wait_us":52,"thread_start_us":868,"threads_started":1}
I20260808 14:54:50.810672 16177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:50.797908 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58048 (local address 127.26.206.194:44687)
0808 14:54:50.801478 (+ 3570us) server_negotiation.cc:206] Beginning negotiation
0808 14:54:50.801488 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 14:54:50.801526 (+ 38us) server_negotiation.cc:407] Connection header received
0808 14:54:50.801617 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:54:50.801624 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:54:50.801833 (+ 209us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:54:50.802026 (+ 193us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:54:50.802798 (+ 772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:50.804444 (+ 1646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:50.807029 (+ 2585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:50.808725 (+ 1696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:50.808881 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:50.809028 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0808 14:54:50.810200 (+ 1172us) server_negotiation.cc:299] Negotiation successful
0808 14:54:50.810354 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3415,"thread_start_us":3239,"threads_started":1}
I20260808 14:54:50.810680 16088 tablet_service.cc:1467] Processing CreateTablet for tablet c52e0bf3787046f692763d2166e6a496 (DEFAULT_TABLE table=test-table [id=f903ae0d58e741d1954ef44b3806479f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:54:50.810950 15800 tablet_service.cc:1467] Processing CreateTablet for tablet c52e0bf3787046f692763d2166e6a496 (DEFAULT_TABLE table=test-table [id=f903ae0d58e741d1954ef44b3806479f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:54:50.812165 16088 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c52e0bf3787046f692763d2166e6a496. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:54:50.812342 15800 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c52e0bf3787046f692763d2166e6a496. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:54:50.814915 15942 tablet_service.cc:1467] Processing CreateTablet for tablet c52e0bf3787046f692763d2166e6a496 (DEFAULT_TABLE table=test-table [id=f903ae0d58e741d1954ef44b3806479f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:54:50.816274 15942 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c52e0bf3787046f692763d2166e6a496. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:54:50.823825 16178 tablet_bootstrap.cc:492] T c52e0bf3787046f692763d2166e6a496 P 147a5837556d4c449dd1a1148d140f96: Bootstrap starting.
I20260808 14:54:50.827272 16178 tablet_bootstrap.cc:654] T c52e0bf3787046f692763d2166e6a496 P 147a5837556d4c449dd1a1148d140f96: Neither blocks nor log segments found. Creating new log.
I20260808 14:54:50.827332 16179 tablet_bootstrap.cc:492] T c52e0bf3787046f692763d2166e6a496 P 5ebd1c448af5431c83a6bc1f926e8ae5: Bootstrap starting.
I20260808 14:54:50.828670 16178 log.cc:824] T c52e0bf3787046f692763d2166e6a496 P 147a5837556d4c449dd1a1148d140f96: Log is configured to *not* fsync() on all Append() calls
I20260808 14:54:50.830744 16179 tablet_bootstrap.cc:654] T c52e0bf3787046f692763d2166e6a496 P 5ebd1c448af5431c83a6bc1f926e8ae5: Neither blocks nor log segments found. Creating new log.
I20260808 14:54:50.831910 16178 tablet_bootstrap.cc:492] T c52e0bf3787046f692763d2166e6a496 P 147a5837556d4c449dd1a1148d140f96: No bootstrap required, opened a new log
I20260808 14:54:50.831946 16183 tablet_bootstrap.cc:492] T c52e0bf3787046f692763d2166e6a496 P 8b46ca1a0b864a7f9d60c754c04514b3: Bootstrap starting.
I20260808 14:54:50.832067 16179 log.cc:824] T c52e0bf3787046f692763d2166e6a496 P 5ebd1c448af5431c83a6bc1f926e8ae5: Log is configured to *not* fsync() on all Append() calls
I20260808 14:54:50.832180 16178 ts_tablet_manager.cc:1397] T c52e0bf3787046f692763d2166e6a496 P 147a5837556d4c449dd1a1148d140f96: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.003s
I20260808 14:54:50.834666 16183 tablet_bootstrap.cc:654] T c52e0bf3787046f692763d2166e6a496 P 8b46ca1a0b864a7f9d60c754c04514b3: Neither blocks nor log segments found. Creating new log.
I20260808 14:54:50.835904 16183 log.cc:824] T c52e0bf3787046f692763d2166e6a496 P 8b46ca1a0b864a7f9d60c754c04514b3: Log is configured to *not* fsync() on all Append() calls
I20260808 14:54:50.838302 16183 tablet_bootstrap.cc:492] T c52e0bf3787046f692763d2166e6a496 P 8b46ca1a0b864a7f9d60c754c04514b3: No bootstrap required, opened a new log
I20260808 14:54:50.838608 16183 ts_tablet_manager.cc:1397] T c52e0bf3787046f692763d2166e6a496 P 8b46ca1a0b864a7f9d60c754c04514b3: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260808 14:54:50.840996 16179 tablet_bootstrap.cc:492] T c52e0bf3787046f692763d2166e6a496 P 5ebd1c448af5431c83a6bc1f926e8ae5: No bootstrap required, opened a new log
I20260808 14:54:50.841248 16179 ts_tablet_manager.cc:1397] T c52e0bf3787046f692763d2166e6a496 P 5ebd1c448af5431c83a6bc1f926e8ae5: Time spent bootstrapping tablet: real 0.014s user 0.008s sys 0.004s
I20260808 14:54:50.844058 16178 raft_consensus.cc:348] T c52e0bf3787046f692763d2166e6a496 P 147a5837556d4c449dd1a1148d140f96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ebd1c448af5431c83a6bc1f926e8ae5" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 40979 } } peers { permanent_uuid: "8b46ca1a0b864a7f9d60c754c04514b3" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 44687 } } peers { permanent_uuid: "147a5837556d4c449dd1a1148d140f96" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 37207 } }
I20260808 14:54:50.844480 16178 raft_consensus.cc:374] T c52e0bf3787046f692763d2166e6a496 P 147a5837556d4c449dd1a1148d140f96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:54:50.844591 16178 raft_consensus.cc:729] T c52e0bf3787046f692763d2166e6a496 P 147a5837556d4c449dd1a1148d140f96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 147a5837556d4c449dd1a1148d140f96, State: Initialized, Role: FOLLOWER
I20260808 14:54:50.845224 16178 consensus_queue.cc:260] T c52e0bf3787046f692763d2166e6a496 P 147a5837556d4c449dd1a1148d140f96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ebd1c448af5431c83a6bc1f926e8ae5" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 40979 } } peers { permanent_uuid: "8b46ca1a0b864a7f9d60c754c04514b3" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 44687 } } peers { permanent_uuid: "147a5837556d4c449dd1a1148d140f96" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 37207 } }
I20260808 14:54:50.846323 16183 raft_consensus.cc:348] T c52e0bf3787046f692763d2166e6a496 P 8b46ca1a0b864a7f9d60c754c04514b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ebd1c448af5431c83a6bc1f926e8ae5" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 40979 } } peers { permanent_uuid: "8b46ca1a0b864a7f9d60c754c04514b3" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 44687 } } peers { permanent_uuid: "147a5837556d4c449dd1a1148d140f96" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 37207 } }
I20260808 14:54:50.846998 16159 heartbeater.cc:503] Master 127.26.206.254:39233 was elected leader, sending a full tablet report...
I20260808 14:54:50.846789 16183 raft_consensus.cc:374] T c52e0bf3787046f692763d2166e6a496 P 8b46ca1a0b864a7f9d60c754c04514b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:54:50.847721 16178 ts_tablet_manager.cc:1428] T c52e0bf3787046f692763d2166e6a496 P 147a5837556d4c449dd1a1148d140f96: Time spent starting tablet: real 0.015s user 0.015s sys 0.001s
I20260808 14:54:50.847787 16183 raft_consensus.cc:729] T c52e0bf3787046f692763d2166e6a496 P 8b46ca1a0b864a7f9d60c754c04514b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b46ca1a0b864a7f9d60c754c04514b3, State: Initialized, Role: FOLLOWER
I20260808 14:54:50.848382 16183 consensus_queue.cc:260] T c52e0bf3787046f692763d2166e6a496 P 8b46ca1a0b864a7f9d60c754c04514b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ebd1c448af5431c83a6bc1f926e8ae5" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 40979 } } peers { permanent_uuid: "8b46ca1a0b864a7f9d60c754c04514b3" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 44687 } } peers { permanent_uuid: "147a5837556d4c449dd1a1148d140f96" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 37207 } }
I20260808 14:54:50.849529 16011 heartbeater.cc:503] Master 127.26.206.254:39233 was elected leader, sending a full tablet report...
I20260808 14:54:50.850095 16183 ts_tablet_manager.cc:1428] T c52e0bf3787046f692763d2166e6a496 P 8b46ca1a0b864a7f9d60c754c04514b3: Time spent starting tablet: real 0.011s user 0.004s sys 0.005s
I20260808 14:54:50.851516 16179 raft_consensus.cc:348] T c52e0bf3787046f692763d2166e6a496 P 5ebd1c448af5431c83a6bc1f926e8ae5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ebd1c448af5431c83a6bc1f926e8ae5" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 40979 } } peers { permanent_uuid: "8b46ca1a0b864a7f9d60c754c04514b3" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 44687 } } peers { permanent_uuid: "147a5837556d4c449dd1a1148d140f96" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 37207 } }
I20260808 14:54:50.851927 16179 raft_consensus.cc:374] T c52e0bf3787046f692763d2166e6a496 P 5ebd1c448af5431c83a6bc1f926e8ae5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:54:50.852035 16179 raft_consensus.cc:729] T c52e0bf3787046f692763d2166e6a496 P 5ebd1c448af5431c83a6bc1f926e8ae5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ebd1c448af5431c83a6bc1f926e8ae5, State: Initialized, Role: FOLLOWER
I20260808 14:54:50.852661 16179 consensus_queue.cc:260] T c52e0bf3787046f692763d2166e6a496 P 5ebd1c448af5431c83a6bc1f926e8ae5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ebd1c448af5431c83a6bc1f926e8ae5" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 40979 } } peers { permanent_uuid: "8b46ca1a0b864a7f9d60c754c04514b3" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 44687 } } peers { permanent_uuid: "147a5837556d4c449dd1a1148d140f96" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 37207 } }
I20260808 14:54:50.854405 16179 ts_tablet_manager.cc:1428] T c52e0bf3787046f692763d2166e6a496 P 5ebd1c448af5431c83a6bc1f926e8ae5: Time spent starting tablet: real 0.013s user 0.010s sys 0.003s
W20260808 14:54:50.888630 15871 tablet.cc:2369] T c52e0bf3787046f692763d2166e6a496 P 5ebd1c448af5431c83a6bc1f926e8ae5: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 14:54:50.939975 16012 tablet.cc:2369] T c52e0bf3787046f692763d2166e6a496 P 8b46ca1a0b864a7f9d60c754c04514b3: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 14:54:50.967796 16160 tablet.cc:2369] T c52e0bf3787046f692763d2166e6a496 P 147a5837556d4c449dd1a1148d140f96: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:54:51.054502 16188 raft_consensus.cc:482] T c52e0bf3787046f692763d2166e6a496 P 5ebd1c448af5431c83a6bc1f926e8ae5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:54:51.054829 16188 raft_consensus.cc:504] T c52e0bf3787046f692763d2166e6a496 P 5ebd1c448af5431c83a6bc1f926e8ae5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ebd1c448af5431c83a6bc1f926e8ae5" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 40979 } } peers { permanent_uuid: "8b46ca1a0b864a7f9d60c754c04514b3" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 44687 } } peers { permanent_uuid: "147a5837556d4c449dd1a1148d140f96" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 37207 } }
I20260808 14:54:51.056577 16188 leader_election.cc:288] T c52e0bf3787046f692763d2166e6a496 P 5ebd1c448af5431c83a6bc1f926e8ae5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b46ca1a0b864a7f9d60c754c04514b3 (127.26.206.194:44687), 147a5837556d4c449dd1a1148d140f96 (127.26.206.195:37207)
I20260808 14:54:51.063859 16177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:51.057058 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.193:46181 (local address 127.26.206.194:44687)
0808 14:54:51.057287 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0808 14:54:51.057295 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:54:51.058277 (+ 982us) server_negotiation.cc:407] Connection header received
0808 14:54:51.058510 (+ 233us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:54:51.058516 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:54:51.058594 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:54:51.058698 (+ 104us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:54:51.059327 (+ 629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:51.060135 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:51.062065 (+ 1930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:51.062858 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:51.063013 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:51.063101 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0808 14:54:51.063416 (+ 315us) server_negotiation.cc:299] Negotiation successful
0808 14:54:51.063546 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260808 14:54:51.063900 16175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:51.057211 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.193:51883 (local address 127.26.206.195:37207)
0808 14:54:51.057461 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0808 14:54:51.057469 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:54:51.058118 (+ 649us) server_negotiation.cc:407] Connection header received
0808 14:54:51.058302 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:54:51.058307 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:54:51.058390 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:54:51.058498 (+ 108us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:54:51.059274 (+ 776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:51.060127 (+ 853us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:51.062103 (+ 1976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:51.062865 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:51.063046 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:51.063136 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0808 14:54:51.063484 (+ 348us) server_negotiation.cc:299] Negotiation successful
0808 14:54:51.063628 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260808 14:54:51.064060 16189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:51.057040 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.194:44687 (local address 127.26.206.193:46181)
0808 14:54:51.058156 (+ 1116us) negotiation.cc:107] Waiting for socket to connect
0808 14:54:51.058178 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 14:54:51.058342 (+ 164us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:54:51.058732 (+ 390us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:54:51.058736 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:54:51.058755 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:54:51.059147 (+ 392us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:54:51.059154 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:54:51.060314 (+ 1160us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:54:51.060318 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:54:51.061906 (+ 1588us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:54:51.061918 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:54:51.063070 (+ 1152us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:54:51.063076 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:54:51.063254 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:51.063283 (+ 29us) client_negotiation.cc:769] Sending connection context
0808 14:54:51.063358 (+ 75us) client_negotiation.cc:240] Negotiation successful
0808 14:54:51.063484 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":980,"mutex_wait_us":48,"thread_start_us":464,"threads_started":1}
I20260808 14:54:51.064249 16190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:51.056875 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.195:37207 (local address 127.26.206.193:51883)
0808 14:54:51.058003 (+ 1128us) negotiation.cc:107] Waiting for socket to connect
0808 14:54:51.058023 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 14:54:51.058146 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:54:51.058525 (+ 379us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:54:51.058530 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:54:51.058563 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:54:51.059100 (+ 537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:54:51.059113 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:54:51.060257 (+ 1144us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:54:51.060272 (+ 15us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:54:51.061921 (+ 1649us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:54:51.061933 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:54:51.063141 (+ 1208us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:54:51.063149 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:54:51.063304 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:51.063325 (+ 21us) client_negotiation.cc:769] Sending connection context
0808 14:54:51.063439 (+ 114us) client_negotiation.cc:240] Negotiation successful
0808 14:54:51.063587 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1022,"mutex_wait_us":87,"thread_start_us":983,"threads_started":1}
I20260808 14:54:51.065380 15965 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c52e0bf3787046f692763d2166e6a496" candidate_uuid: "5ebd1c448af5431c83a6bc1f926e8ae5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b46ca1a0b864a7f9d60c754c04514b3" is_pre_election: true
I20260808 14:54:51.065383 16108 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c52e0bf3787046f692763d2166e6a496" candidate_uuid: "5ebd1c448af5431c83a6bc1f926e8ae5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "147a5837556d4c449dd1a1148d140f96" is_pre_election: true
I20260808 14:54:51.065966 16108 raft_consensus.cc:2454] T c52e0bf3787046f692763d2166e6a496 P 147a5837556d4c449dd1a1148d140f96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ebd1c448af5431c83a6bc1f926e8ae5 in term 0.
I20260808 14:54:51.065966 15965 raft_consensus.cc:2454] T c52e0bf3787046f692763d2166e6a496 P 8b46ca1a0b864a7f9d60c754c04514b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ebd1c448af5431c83a6bc1f926e8ae5 in term 0.
I20260808 14:54:51.066668 15750 leader_election.cc:302] T c52e0bf3787046f692763d2166e6a496 P 5ebd1c448af5431c83a6bc1f926e8ae5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ebd1c448af5431c83a6bc1f926e8ae5, 8b46ca1a0b864a7f9d60c754c04514b3; no voters:
I20260808 14:54:51.067031 16188 raft_consensus.cc:2781] T c52e0bf3787046f692763d2166e6a496 P 5ebd1c448af5431c83a6bc1f926e8ae5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:54:51.067207 16188 raft_consensus.cc:482] T c52e0bf3787046f692763d2166e6a496 P 5ebd1c448af5431c83a6bc1f926e8ae5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:54:51.067333 16188 raft_consensus.cc:3037] T c52e0bf3787046f692763d2166e6a496 P 5ebd1c448af5431c83a6bc1f926e8ae5 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:54:51.069571 16188 raft_consensus.cc:504] T c52e0bf3787046f692763d2166e6a496 P 5ebd1c448af5431c83a6bc1f926e8ae5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ebd1c448af5431c83a6bc1f926e8ae5" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 40979 } } peers { permanent_uuid: "8b46ca1a0b864a7f9d60c754c04514b3" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 44687 } } peers { permanent_uuid: "147a5837556d4c449dd1a1148d140f96" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 37207 } }
I20260808 14:54:51.070185 16188 leader_election.cc:288] T c52e0bf3787046f692763d2166e6a496 P 5ebd1c448af5431c83a6bc1f926e8ae5 [CANDIDATE]: Term 1 election: Requested vote from peers 8b46ca1a0b864a7f9d60c754c04514b3 (127.26.206.194:44687), 147a5837556d4c449dd1a1148d140f96 (127.26.206.195:37207)
I20260808 14:54:51.070665 15965 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c52e0bf3787046f692763d2166e6a496" candidate_uuid: "5ebd1c448af5431c83a6bc1f926e8ae5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b46ca1a0b864a7f9d60c754c04514b3"
I20260808 14:54:51.070683 16108 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c52e0bf3787046f692763d2166e6a496" candidate_uuid: "5ebd1c448af5431c83a6bc1f926e8ae5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "147a5837556d4c449dd1a1148d140f96"
I20260808 14:54:51.070886 16108 raft_consensus.cc:3037] T c52e0bf3787046f692763d2166e6a496 P 147a5837556d4c449dd1a1148d140f96 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:54:51.070886 15965 raft_consensus.cc:3037] T c52e0bf3787046f692763d2166e6a496 P 8b46ca1a0b864a7f9d60c754c04514b3 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:54:51.074107 15965 raft_consensus.cc:2454] T c52e0bf3787046f692763d2166e6a496 P 8b46ca1a0b864a7f9d60c754c04514b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ebd1c448af5431c83a6bc1f926e8ae5 in term 1.
I20260808 14:54:51.074107 16108 raft_consensus.cc:2454] T c52e0bf3787046f692763d2166e6a496 P 147a5837556d4c449dd1a1148d140f96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ebd1c448af5431c83a6bc1f926e8ae5 in term 1.
I20260808 14:54:51.074535 15750 leader_election.cc:302] T c52e0bf3787046f692763d2166e6a496 P 5ebd1c448af5431c83a6bc1f926e8ae5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ebd1c448af5431c83a6bc1f926e8ae5, 8b46ca1a0b864a7f9d60c754c04514b3; no voters:
I20260808 14:54:51.074837 16188 raft_consensus.cc:2781] T c52e0bf3787046f692763d2166e6a496 P 5ebd1c448af5431c83a6bc1f926e8ae5 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:54:51.075310 16188 raft_consensus.cc:686] T c52e0bf3787046f692763d2166e6a496 P 5ebd1c448af5431c83a6bc1f926e8ae5 [term 1 LEADER]: Becoming Leader. State: Replica: 5ebd1c448af5431c83a6bc1f926e8ae5, State: Running, Role: LEADER
I20260808 14:54:51.076086 16188 consensus_queue.cc:237] T c52e0bf3787046f692763d2166e6a496 P 5ebd1c448af5431c83a6bc1f926e8ae5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ebd1c448af5431c83a6bc1f926e8ae5" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 40979 } } peers { permanent_uuid: "8b46ca1a0b864a7f9d60c754c04514b3" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 44687 } } peers { permanent_uuid: "147a5837556d4c449dd1a1148d140f96" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 37207 } }
I20260808 14:54:51.080397 15665 catalog_manager.cc:5495] T c52e0bf3787046f692763d2166e6a496 P 5ebd1c448af5431c83a6bc1f926e8ae5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ebd1c448af5431c83a6bc1f926e8ae5 (127.26.206.193). New cstate: current_term: 1 leader_uuid: "5ebd1c448af5431c83a6bc1f926e8ae5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ebd1c448af5431c83a6bc1f926e8ae5" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 40979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b46ca1a0b864a7f9d60c754c04514b3" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 44687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "147a5837556d4c449dd1a1148d140f96" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 37207 } health_report { overall_health: UNKNOWN } } }
I20260808 14:54:51.099865 16173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:51.094693 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55972 (local address 127.26.206.193:40979)
0808 14:54:51.094881 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0808 14:54:51.094885 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:54:51.095024 (+ 139us) server_negotiation.cc:407] Connection header received
0808 14:54:51.095180 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:54:51.095183 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:54:51.095278 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:54:51.095397 (+ 119us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:54:51.095801 (+ 404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:51.096486 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:51.097935 (+ 1449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:51.098318 (+ 383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:51.098417 (+ 99us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:51.098877 (+ 460us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:54:51.099334 (+ 457us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:54:51.099462 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0808 14:54:51.099624 (+ 162us) server_negotiation.cc:299] Negotiation successful
0808 14:54:51.099675 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260808 14:54:51.107908 16108 raft_consensus.cc:1261] T c52e0bf3787046f692763d2166e6a496 P 147a5837556d4c449dd1a1148d140f96 [term 1 FOLLOWER]: Refusing update from remote peer 5ebd1c448af5431c83a6bc1f926e8ae5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:54:51.107940 15965 raft_consensus.cc:1261] T c52e0bf3787046f692763d2166e6a496 P 8b46ca1a0b864a7f9d60c754c04514b3 [term 1 FOLLOWER]: Refusing update from remote peer 5ebd1c448af5431c83a6bc1f926e8ae5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:54:51.108868 16192 consensus_queue.cc:1035] T c52e0bf3787046f692763d2166e6a496 P 5ebd1c448af5431c83a6bc1f926e8ae5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b46ca1a0b864a7f9d60c754c04514b3" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 44687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:54:51.109201 16188 consensus_queue.cc:1035] T c52e0bf3787046f692763d2166e6a496 P 5ebd1c448af5431c83a6bc1f926e8ae5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "147a5837556d4c449dd1a1148d140f96" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 37207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:54:51.125766 16196 mvcc.cc:205] Tried to move back new op lower bound from 7316278849967845376 to 7316278849851125760. Current Snapshot: MvccSnapshot[applied={T|T < 7316278849967845376}]
I20260808 14:54:51.134686 15665 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48848:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:54:51.134977 15665 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48848:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:54:51.138563 15665 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1c0de2c6909144f782f162275b8fbca1: Sending DeleteTablet for 3 replicas of tablet c52e0bf3787046f692763d2166e6a496
I20260808 14:54:51.139678 15800 tablet_service.cc:1514] Processing DeleteTablet for tablet c52e0bf3787046f692763d2166e6a496 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:54:51 UTC) from {username='kudu', principal='kudu/127.26.206.254@KRBTEST.COM'} at 127.0.0.1:55956
I20260808 14:54:51.139791 15942 tablet_service.cc:1514] Processing DeleteTablet for tablet c52e0bf3787046f692763d2166e6a496 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:54:51 UTC) from {username='kudu', principal='kudu/127.26.206.254@KRBTEST.COM'} at 127.0.0.1:58048
I20260808 14:54:51.140738 16088 tablet_service.cc:1514] Processing DeleteTablet for tablet c52e0bf3787046f692763d2166e6a496 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:54:51 UTC) from {username='kudu', principal='kudu/127.26.206.254@KRBTEST.COM'} at 127.0.0.1:54590
I20260808 14:54:51.140887 16207 tablet_replica.cc:330] T c52e0bf3787046f692763d2166e6a496 P 8b46ca1a0b864a7f9d60c754c04514b3: stopping tablet replica
I20260808 14:54:51.141291 16207 raft_consensus.cc:2229] T c52e0bf3787046f692763d2166e6a496 P 8b46ca1a0b864a7f9d60c754c04514b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:54:51.141638 16208 tablet_replica.cc:330] T c52e0bf3787046f692763d2166e6a496 P 147a5837556d4c449dd1a1148d140f96: stopping tablet replica
I20260808 14:54:51.141848 16207 raft_consensus.cc:2258] T c52e0bf3787046f692763d2166e6a496 P 8b46ca1a0b864a7f9d60c754c04514b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:54:51.142204 16208 raft_consensus.cc:2229] T c52e0bf3787046f692763d2166e6a496 P 147a5837556d4c449dd1a1148d140f96 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:54:51.142606 16206 tablet_replica.cc:330] T c52e0bf3787046f692763d2166e6a496 P 5ebd1c448af5431c83a6bc1f926e8ae5: stopping tablet replica
I20260808 14:54:51.142797 16208 raft_consensus.cc:2258] T c52e0bf3787046f692763d2166e6a496 P 147a5837556d4c449dd1a1148d140f96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:54:51.143013 16206 raft_consensus.cc:2229] T c52e0bf3787046f692763d2166e6a496 P 5ebd1c448af5431c83a6bc1f926e8ae5 [term 1 LEADER]: Raft consensus shutting down.
I20260808 14:54:51.143656 16206 raft_consensus.cc:2258] T c52e0bf3787046f692763d2166e6a496 P 5ebd1c448af5431c83a6bc1f926e8ae5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:54:51.144325 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 15732
I20260808 14:54:51.145828 16207 ts_tablet_manager.cc:1905] T c52e0bf3787046f692763d2166e6a496 P 8b46ca1a0b864a7f9d60c754c04514b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:54:51.147614 16208 ts_tablet_manager.cc:1905] T c52e0bf3787046f692763d2166e6a496 P 147a5837556d4c449dd1a1148d140f96: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:54:51.152840 16206 ts_tablet_manager.cc:1905] T c52e0bf3787046f692763d2166e6a496 P 5ebd1c448af5431c83a6bc1f926e8ae5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:54:51.155131 16208 ts_tablet_manager.cc:1918] T c52e0bf3787046f692763d2166e6a496 P 147a5837556d4c449dd1a1148d140f96: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:54:51.155372 16208 log.cc:1196] T c52e0bf3787046f692763d2166e6a496 P 147a5837556d4c449dd1a1148d140f96: Deleting WAL directory at /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200577490656-27451-0/minicluster-data/ts-2/wal/wals/c52e0bf3787046f692763d2166e6a496
I20260808 14:54:51.155987 16208 ts_tablet_manager.cc:1939] T c52e0bf3787046f692763d2166e6a496 P 147a5837556d4c449dd1a1148d140f96: Deleting consensus metadata
Aug 08 14:54:51 dist-test-slave-6k22 krb5kdc[15618](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200888, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.206.193@KRBTEST.COM
I20260808 14:54:51.157805 15650 catalog_manager.cc:4841] TS 147a5837556d4c449dd1a1148d140f96 (127.26.206.195:37207): tablet c52e0bf3787046f692763d2166e6a496 (table test-table [id=f903ae0d58e741d1954ef44b3806479f]) successfully deleted
I20260808 14:54:51.160113 16206 ts_tablet_manager.cc:1918] T c52e0bf3787046f692763d2166e6a496 P 5ebd1c448af5431c83a6bc1f926e8ae5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:54:51.160316 16206 log.cc:1196] T c52e0bf3787046f692763d2166e6a496 P 5ebd1c448af5431c83a6bc1f926e8ae5: Deleting WAL directory at /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200577490656-27451-0/minicluster-data/ts-0/wal/wals/c52e0bf3787046f692763d2166e6a496
I20260808 14:54:51.160880 16206 ts_tablet_manager.cc:1939] T c52e0bf3787046f692763d2166e6a496 P 5ebd1c448af5431c83a6bc1f926e8ae5: Deleting consensus metadata
I20260808 14:54:51.162060 16207 ts_tablet_manager.cc:1918] T c52e0bf3787046f692763d2166e6a496 P 8b46ca1a0b864a7f9d60c754c04514b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:54:51.162245 16207 log.cc:1196] T c52e0bf3787046f692763d2166e6a496 P 8b46ca1a0b864a7f9d60c754c04514b3: Deleting WAL directory at /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200577490656-27451-0/minicluster-data/ts-1/wal/wals/c52e0bf3787046f692763d2166e6a496
I20260808 14:54:51.162735 15651 catalog_manager.cc:4841] TS 5ebd1c448af5431c83a6bc1f926e8ae5 (127.26.206.193:40979): tablet c52e0bf3787046f692763d2166e6a496 (table test-table [id=f903ae0d58e741d1954ef44b3806479f]) successfully deleted
I20260808 14:54:51.162804 16207 ts_tablet_manager.cc:1939] T c52e0bf3787046f692763d2166e6a496 P 8b46ca1a0b864a7f9d60c754c04514b3: Deleting consensus metadata
I20260808 14:54:51.164575 15651 catalog_manager.cc:4841] TS 8b46ca1a0b864a7f9d60c754c04514b3 (127.26.206.194:44687): tablet c52e0bf3787046f692763d2166e6a496 (table test-table [id=f903ae0d58e741d1954ef44b3806479f]) successfully deleted
I20260808 14:54:51.166764 16173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:51.146257 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55974 (local address 127.26.206.193:40979)
0808 14:54:51.146457 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0808 14:54:51.146466 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:54:51.146837 (+ 371us) server_negotiation.cc:407] Connection header received
0808 14:54:51.147140 (+ 303us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:54:51.147145 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:54:51.147217 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:54:51.147308 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:54:51.149201 (+ 1893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:51.150400 (+ 1199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:51.152336 (+ 1936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:51.153094 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:51.153206 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:51.159035 (+ 5829us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:54:51.159050 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:54:51.159064 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:54:51.159101 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:54:51.163507 (+ 4406us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:54:51.164478 (+ 971us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:54:51.164491 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:54:51.164495 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:54:51.164665 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:54:51.165187 (+ 522us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:54:51.165194 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:54:51.165198 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:54:51.165641 (+ 443us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:54:51.165962 (+ 321us) server_negotiation.cc:1035] Waiting for connection context
0808 14:54:51.166159 (+ 197us) server_negotiation.cc:299] Negotiation successful
0808 14:54:51.166403 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260808 14:54:51.167407 15864 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:54:51.279891 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 15732
I20260808 14:54:51.302428 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 15876
Aug 08 14:54:51 dist-test-slave-6k22 krb5kdc[15618](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200888, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.206.194@KRBTEST.COM
I20260808 14:54:51.317304 16177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:51.303190 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58058 (local address 127.26.206.194:44687)
0808 14:54:51.303394 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0808 14:54:51.303399 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:54:51.303417 (+ 18us) server_negotiation.cc:407] Connection header received
0808 14:54:51.303605 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:54:51.303616 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:54:51.303700 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:54:51.303805 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:54:51.305041 (+ 1236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:51.305797 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:51.307033 (+ 1236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:51.307398 (+ 365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:51.307490 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:51.311802 (+ 4312us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:54:51.311814 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:54:51.311829 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:54:51.311860 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:54:51.314721 (+ 2861us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:54:51.315422 (+ 701us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:54:51.315428 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:54:51.315431 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:54:51.315548 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:54:51.315926 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:54:51.315929 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:54:51.315931 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:54:51.316282 (+ 351us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:54:51.316510 (+ 228us) server_negotiation.cc:1035] Waiting for connection context
0808 14:54:51.316761 (+ 251us) server_negotiation.cc:299] Negotiation successful
0808 14:54:51.316928 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260808 14:54:51.317940 16006 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:54:51.407444 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 15876
I20260808 14:54:51.429174 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 16017
Aug 08 14:54:51 dist-test-slave-6k22 krb5kdc[15618](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200888, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.206.195@KRBTEST.COM
I20260808 14:54:51.444087 16175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:51.429977 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54600 (local address 127.26.206.195:37207)
0808 14:54:51.430194 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0808 14:54:51.430198 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:54:51.430217 (+ 19us) server_negotiation.cc:407] Connection header received
0808 14:54:51.430310 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:54:51.430313 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:54:51.430383 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:54:51.430464 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:54:51.431807 (+ 1343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:51.432523 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:51.433759 (+ 1236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:51.434210 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:51.434306 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:51.438791 (+ 4485us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:54:51.438807 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:54:51.438824 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:54:51.438856 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:54:51.441703 (+ 2847us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:54:51.442298 (+ 595us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:54:51.442305 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:54:51.442307 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:54:51.442438 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:54:51.442742 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:54:51.442744 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:54:51.442746 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:54:51.443068 (+ 322us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:54:51.443283 (+ 215us) server_negotiation.cc:1035] Waiting for connection context
0808 14:54:51.443496 (+ 213us) server_negotiation.cc:299] Negotiation successful
0808 14:54:51.443713 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":104}
I20260808 14:54:51.444729 16153 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:54:51.533702 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 16017
I20260808 14:54:51.555256 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 15633
I20260808 14:54:51.556370 15698 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:54:51.668133 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 15633
2026-08-08T14:54:51Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (4580 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-08T14:54:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:54:51Z Disabled control of system clock
I20260808 14:54:51.759184 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200577490656-27451-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200577490656-27451-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200577490656-27451-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.206.254:37611
--webserver_interface=127.26.206.254
--webserver_port=0
--builtin_ntp_servers=127.26.206.212:45471
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.206.254:37611
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 14:54:52.089972 16221 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:54:52.090260 16221 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:54:52.090389 16221 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:54:52.097532 16221 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:54:52.097642 16221 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:54:52.097716 16221 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:54:52.097810 16221 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:54:52.097888 16221 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:54:52.107371 16221 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:45471
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200577490656-27451-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200577490656-27451-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.206.254:37611
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.206.254:37611
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.206.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200577490656-27451-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:54:52.108588 16221 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:54:52.110410 16221 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:54:52.122323 16227 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:54:52.122416 16229 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:54:52.122419 16226 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:54:52.123394 16221 server_base.cc:1034] running on GCE node
I20260808 14:54:52.124220 16221 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:54:52.125545 16221 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:54:52.126892 16221 hybrid_clock.cc:648] HybridClock initialized: now 1786200892126850 us; error 51 us; skew 500 ppm
I20260808 14:54:52.127264 16221 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 14:54:52.129598 16221 webserver.cc:460] Webserver started at http://127.26.206.254:38323/ using document root <none> and password file <none>
I20260808 14:54:52.130281 16221 fs_manager.cc:359] Metadata directory not provided
I20260808 14:54:52.130416 16221 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:54:52.130735 16221 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:54:52.133644 16221 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200577490656-27451-0/minicluster-data/master-0/data/instance:
uuid: "1fab932c6fef443f9e23abbdf8b244c9"
format_stamp: "Formatted at 2026-08-08 14:54:52 on dist-test-slave-6k22"
server_key: "f4fceb1b22650c97fb1adc028519c832"
server_key_iv: "4dc2b9bf6211041c665d1a2d793b9802"
server_key_version: "encryptionkey@0"
I20260808 14:54:52.134459 16221 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200577490656-27451-0/minicluster-data/master-0/wal/instance:
uuid: "1fab932c6fef443f9e23abbdf8b244c9"
format_stamp: "Formatted at 2026-08-08 14:54:52 on dist-test-slave-6k22"
server_key: "f4fceb1b22650c97fb1adc028519c832"
server_key_iv: "4dc2b9bf6211041c665d1a2d793b9802"
server_key_version: "encryptionkey@0"
I20260808 14:54:52.139637 16221 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260808 14:54:52.143028 16236 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:54:52.144276 16221 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 14:54:52.144465 16221 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200577490656-27451-0/minicluster-data/master-0/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200577490656-27451-0/minicluster-data/master-0/wal
uuid: "1fab932c6fef443f9e23abbdf8b244c9"
format_stamp: "Formatted at 2026-08-08 14:54:52 on dist-test-slave-6k22"
server_key: "f4fceb1b22650c97fb1adc028519c832"
server_key_iv: "4dc2b9bf6211041c665d1a2d793b9802"
server_key_version: "encryptionkey@0"
I20260808 14:54:52.144685 16221 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200577490656-27451-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200577490656-27451-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200577490656-27451-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:54:52.172022 16221 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:54:52.173023 16221 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:54:52.173312 16221 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:54:52.196208 16221 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.254:37611
I20260808 14:54:52.196241 16287 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.254:37611 every 8 connection(s)
I20260808 14:54:52.197494 16221 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
I20260808 14:54:52.201157 16288 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:54:52.203454 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 16221
I20260808 14:54:52.203656 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200577490656-27451-0/minicluster-data/master-0/wal/instance
I20260808 14:54:52.204118 27451 external_mini_cluster.cc:1428] Setting key ded6c131084f26bdd130f628af33e218
I20260808 14:54:52.212481 16288 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1fab932c6fef443f9e23abbdf8b244c9: Bootstrap starting.
I20260808 14:54:52.215667 16288 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1fab932c6fef443f9e23abbdf8b244c9: Neither blocks nor log segments found. Creating new log.
I20260808 14:54:52.216797 16288 log.cc:824] T 00000000000000000000000000000000 P 1fab932c6fef443f9e23abbdf8b244c9: Log is configured to *not* fsync() on all Append() calls
I20260808 14:54:52.217615 16291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:52.206033 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57020 (local address 127.26.206.254:37611)
0808 14:54:52.207024 (+ 991us) server_negotiation.cc:206] Beginning negotiation
0808 14:54:52.207034 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 14:54:52.207073 (+ 39us) server_negotiation.cc:407] Connection header received
0808 14:54:52.208786 (+ 1713us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:54:52.208808 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:54:52.209233 (+ 425us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:54:52.209631 (+ 398us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:54:52.210193 (+ 562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:52.211503 (+ 1310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:52.212936 (+ 1433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:52.213590 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:52.213826 (+ 236us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:52.215067 (+ 1241us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:54:52.215074 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:54:52.215088 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:54:52.215725 (+ 637us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:54:52.215816 (+ 91us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:54:52.215846 (+ 30us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:54:52.215982 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0808 14:54:52.216201 (+ 219us) server_negotiation.cc:299] Negotiation successful
0808 14:54:52.216504 (+ 303us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":597,"thread_start_us":363,"threads_started":1}
I20260808 14:54:52.219916 16288 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1fab932c6fef443f9e23abbdf8b244c9: No bootstrap required, opened a new log
I20260808 14:54:52.227131 16288 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1fab932c6fef443f9e23abbdf8b244c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1fab932c6fef443f9e23abbdf8b244c9" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 37611 } }
I20260808 14:54:52.227475 16288 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1fab932c6fef443f9e23abbdf8b244c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:54:52.227617 16288 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1fab932c6fef443f9e23abbdf8b244c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1fab932c6fef443f9e23abbdf8b244c9, State: Initialized, Role: FOLLOWER
I20260808 14:54:52.228188 16288 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1fab932c6fef443f9e23abbdf8b244c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1fab932c6fef443f9e23abbdf8b244c9" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 37611 } }
I20260808 14:54:52.228434 16288 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1fab932c6fef443f9e23abbdf8b244c9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:54:52.228577 16288 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1fab932c6fef443f9e23abbdf8b244c9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:54:52.228750 16288 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1fab932c6fef443f9e23abbdf8b244c9 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:54:52.230811 16288 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1fab932c6fef443f9e23abbdf8b244c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1fab932c6fef443f9e23abbdf8b244c9" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 37611 } }
I20260808 14:54:52.231384 16288 leader_election.cc:302] T 00000000000000000000000000000000 P 1fab932c6fef443f9e23abbdf8b244c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1fab932c6fef443f9e23abbdf8b244c9; no voters:
I20260808 14:54:52.232059 16288 leader_election.cc:288] T 00000000000000000000000000000000 P 1fab932c6fef443f9e23abbdf8b244c9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:54:52.232197 16293 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1fab932c6fef443f9e23abbdf8b244c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:54:52.232924 16293 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1fab932c6fef443f9e23abbdf8b244c9 [term 1 LEADER]: Becoming Leader. State: Replica: 1fab932c6fef443f9e23abbdf8b244c9, State: Running, Role: LEADER
I20260808 14:54:52.233420 16293 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1fab932c6fef443f9e23abbdf8b244c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1fab932c6fef443f9e23abbdf8b244c9" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 37611 } }
I20260808 14:54:52.234073 16288 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1fab932c6fef443f9e23abbdf8b244c9 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:54:52.237417 16295 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1fab932c6fef443f9e23abbdf8b244c9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1fab932c6fef443f9e23abbdf8b244c9. Latest consensus state: current_term: 1 leader_uuid: "1fab932c6fef443f9e23abbdf8b244c9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1fab932c6fef443f9e23abbdf8b244c9" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 37611 } } }
I20260808 14:54:52.237876 16295 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1fab932c6fef443f9e23abbdf8b244c9 [sys.catalog]: This master's current role is: LEADER
I20260808 14:54:52.238752 16302 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:54:52.238583 16294 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1fab932c6fef443f9e23abbdf8b244c9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1fab932c6fef443f9e23abbdf8b244c9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1fab932c6fef443f9e23abbdf8b244c9" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 37611 } } }
I20260808 14:54:52.239055 16294 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1fab932c6fef443f9e23abbdf8b244c9 [sys.catalog]: This master's current role is: LEADER
I20260808 14:54:52.244096 16302 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:54:52.253789 16302 catalog_manager.cc:1347] Generated new cluster ID: a8e4558ea1924c0d8188d6c4f4d3749d
I20260808 14:54:52.253932 16302 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:54:52.265255 16302 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:54:52.266503 16302 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:54:52.280582 16302 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1fab932c6fef443f9e23abbdf8b244c9: Generated new TSK 0
I20260808 14:54:52.281677 16302 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:54:52.293520 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200577490656-27451-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200577490656-27451-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200577490656-27451-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200577490656-27451-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.206.193:0
--local_ip_for_outbound_sockets=127.26.206.193
--webserver_interface=127.26.206.193
--webserver_port=0
--tserver_master_addrs=127.26.206.254:37611
--builtin_ntp_servers=127.26.206.212:45471
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 14:54:52.629034 16314 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:54:52.629357 16314 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:54:52.629541 16314 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:54:52.636981 16314 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:54:52.637126 16314 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:54:52.637305 16314 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.206.193
I20260808 14:54:52.646641 16314 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:45471
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200577490656-27451-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200577490656-27451-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.206.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200577490656-27451-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.206.193
--webserver_port=0
--tserver_master_addrs=127.26.206.254:37611
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.206.193
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200577490656-27451-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:54:52.648082 16314 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:54:52.649999 16314 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:54:52.662729 16320 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:54:52.662689 16323 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:54:52.662767 16319 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:54:52.663653 16314 server_base.cc:1034] running on GCE node
I20260808 14:54:52.664201 16314 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:54:52.665095 16314 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:54:52.666356 16314 hybrid_clock.cc:648] HybridClock initialized: now 1786200892666319 us; error 58 us; skew 500 ppm
I20260808 14:54:52.666661 16314 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 14:54:52.668967 16314 webserver.cc:460] Webserver started at http://127.26.206.193:36423/ using document root <none> and password file <none>
I20260808 14:54:52.669664 16314 fs_manager.cc:359] Metadata directory not provided
I20260808 14:54:52.669793 16314 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:54:52.670100 16314 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:54:52.672947 16314 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200577490656-27451-0/minicluster-data/ts-0/data/instance:
uuid: "ad39c7f3bbc64eb3b3bbd9e6ec99927a"
format_stamp: "Formatted at 2026-08-08 14:54:52 on dist-test-slave-6k22"
server_key: "1d2d73ff7daed8ad350618796eaa2d0b"
server_key_iv: "6e0072c903e42c9f723e1a19147c4898"
server_key_version: "encryptionkey@0"
I20260808 14:54:52.673734 16314 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200577490656-27451-0/minicluster-data/ts-0/wal/instance:
uuid: "ad39c7f3bbc64eb3b3bbd9e6ec99927a"
format_stamp: "Formatted at 2026-08-08 14:54:52 on dist-test-slave-6k22"
server_key: "1d2d73ff7daed8ad350618796eaa2d0b"
server_key_iv: "6e0072c903e42c9f723e1a19147c4898"
server_key_version: "encryptionkey@0"
I20260808 14:54:52.678650 16314 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260808 14:54:52.681964 16329 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:54:52.683109 16314 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 14:54:52.683300 16314 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200577490656-27451-0/minicluster-data/ts-0/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200577490656-27451-0/minicluster-data/ts-0/wal
uuid: "ad39c7f3bbc64eb3b3bbd9e6ec99927a"
format_stamp: "Formatted at 2026-08-08 14:54:52 on dist-test-slave-6k22"
server_key: "1d2d73ff7daed8ad350618796eaa2d0b"
server_key_iv: "6e0072c903e42c9f723e1a19147c4898"
server_key_version: "encryptionkey@0"
I20260808 14:54:52.683513 16314 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200577490656-27451-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200577490656-27451-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200577490656-27451-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:54:52.711225 16314 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:54:52.712054 16314 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:54:52.712368 16314 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:54:52.713323 16314 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:54:52.714804 16314 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:54:52.714926 16314 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:54:52.715061 16314 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:54:52.715150 16314 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:54:52.748481 16314 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.193:41223
I20260808 14:54:52.748567 16449 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.193:41223 every 8 connection(s)
I20260808 14:54:52.749821 16314 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200577490656-27451-0/minicluster-data/ts-0/data/info.pb
I20260808 14:54:52.756166 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 16314
I20260808 14:54:52.756366 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200577490656-27451-0/minicluster-data/ts-0/wal/instance
I20260808 14:54:52.756851 27451 external_mini_cluster.cc:1428] Setting key 370759d55784f2871f2c325344800721
I20260808 14:54:52.759944 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200577490656-27451-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200577490656-27451-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200577490656-27451-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200577490656-27451-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.206.194:0
--local_ip_for_outbound_sockets=127.26.206.194
--webserver_interface=127.26.206.194
--webserver_port=0
--tserver_master_addrs=127.26.206.254:37611
--builtin_ntp_servers=127.26.206.212:45471
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 14:54:52.763389 16452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:52.752263 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.193:39421 (local address 127.26.206.254:37611)
0808 14:54:52.752750 (+ 487us) server_negotiation.cc:206] Beginning negotiation
0808 14:54:52.752754 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:54:52.753751 (+ 997us) server_negotiation.cc:407] Connection header received
0808 14:54:52.755604 (+ 1853us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:54:52.755610 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:54:52.755699 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:54:52.755821 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:54:52.757010 (+ 1189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:52.757967 (+ 957us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:52.760219 (+ 2252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:52.760929 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:52.761088 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:52.762333 (+ 1245us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:54:52.762341 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:54:52.762348 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:54:52.762373 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:54:52.762445 (+ 72us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:54:52.762465 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:54:52.762596 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0808 14:54:52.762811 (+ 215us) server_negotiation.cc:299] Negotiation successful
0808 14:54:52.762951 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":383,"thread_start_us":272,"threads_started":1}
I20260808 14:54:52.764334 16453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:52.752718 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:37611 (local address 127.26.206.193:39421)
0808 14:54:52.753593 (+ 875us) negotiation.cc:107] Waiting for socket to connect
0808 14:54:52.753635 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 14:54:52.755310 (+ 1675us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:54:52.756055 (+ 745us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:54:52.756063 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:54:52.756146 (+ 83us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:54:52.756838 (+ 692us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:54:52.756860 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:54:52.758132 (+ 1272us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:54:52.758136 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:54:52.760020 (+ 1884us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:54:52.760039 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:54:52.761147 (+ 1108us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:54:52.761152 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:54:52.761340 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:52.762009 (+ 669us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 14:54:52.762012 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:54:52.762052 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 14:54:52.762139 (+ 87us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:54:52.762595 (+ 456us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:54:52.762604 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:54:52.762609 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 14:54:52.762751 (+ 142us) client_negotiation.cc:240] Negotiation successful
0808 14:54:52.763192 (+ 441us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":456,"thread_start_us":268,"threads_started":1}
I20260808 14:54:52.765772 16450 heartbeater.cc:347] Connected to a master server at 127.26.206.254:37611
I20260808 14:54:52.766080 16450 heartbeater.cc:464] Registering TS with master...
I20260808 14:54:52.766959 16450 heartbeater.cc:511] Master 127.26.206.254:37611 requested a full tablet report, sending...
I20260808 14:54:52.769016 16253 ts_manager.cc:194] Registered new tserver with Master: ad39c7f3bbc64eb3b3bbd9e6ec99927a (127.26.206.193:41223)
I20260808 14:54:52.770428 16253 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.26.206.193:39421
W20260808 14:54:53.094239 16454 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:54:53.094525 16454 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:54:53.094609 16454 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:54:53.101529 16454 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:54:53.101616 16454 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:54:53.101712 16454 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.206.194
I20260808 14:54:53.110199 16454 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:45471
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200577490656-27451-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200577490656-27451-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.206.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200577490656-27451-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.206.194
--webserver_port=0
--tserver_master_addrs=127.26.206.254:37611
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.206.194
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200577490656-27451-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:54:53.111352 16454 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:54:53.113005 16454 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:54:53.125599 16462 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:54:53.125653 16459 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:54:53.125676 16460 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:54:53.126469 16454 server_base.cc:1034] running on GCE node
I20260808 14:54:53.126986 16454 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:54:53.127854 16454 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:54:53.129076 16454 hybrid_clock.cc:648] HybridClock initialized: now 1786200893129037 us; error 48 us; skew 500 ppm
I20260808 14:54:53.129390 16454 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 14:54:53.131712 16454 webserver.cc:460] Webserver started at http://127.26.206.194:34493/ using document root <none> and password file <none>
I20260808 14:54:53.132418 16454 fs_manager.cc:359] Metadata directory not provided
I20260808 14:54:53.132548 16454 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:54:53.132875 16454 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:54:53.135893 16454 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200577490656-27451-0/minicluster-data/ts-1/data/instance:
uuid: "4eeb203186214b028e7a6cb2226253ba"
format_stamp: "Formatted at 2026-08-08 14:54:53 on dist-test-slave-6k22"
server_key: "e0dc983c14bc41dd03e2d1ff51905ca9"
server_key_iv: "949d88efa3158e770bd2a04977c11d56"
server_key_version: "encryptionkey@0"
I20260808 14:54:53.136667 16454 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200577490656-27451-0/minicluster-data/ts-1/wal/instance:
uuid: "4eeb203186214b028e7a6cb2226253ba"
format_stamp: "Formatted at 2026-08-08 14:54:53 on dist-test-slave-6k22"
server_key: "e0dc983c14bc41dd03e2d1ff51905ca9"
server_key_iv: "949d88efa3158e770bd2a04977c11d56"
server_key_version: "encryptionkey@0"
I20260808 14:54:53.141832 16454 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.005s
I20260808 14:54:53.145210 16468 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:54:53.146463 16454 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 14:54:53.146647 16454 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200577490656-27451-0/minicluster-data/ts-1/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200577490656-27451-0/minicluster-data/ts-1/wal
uuid: "4eeb203186214b028e7a6cb2226253ba"
format_stamp: "Formatted at 2026-08-08 14:54:53 on dist-test-slave-6k22"
server_key: "e0dc983c14bc41dd03e2d1ff51905ca9"
server_key_iv: "949d88efa3158e770bd2a04977c11d56"
server_key_version: "encryptionkey@0"
I20260808 14:54:53.146878 16454 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200577490656-27451-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200577490656-27451-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200577490656-27451-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:54:53.162524 16454 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:54:53.163206 16454 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:54:53.163481 16454 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:54:53.164345 16454 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:54:53.165769 16454 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:54:53.165897 16454 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:54:53.166021 16454 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:54:53.166108 16454 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:54:53.199527 16454 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.194:38095
I20260808 14:54:53.199600 16590 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.194:38095 every 8 connection(s)
I20260808 14:54:53.200780 16454 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200577490656-27451-0/minicluster-data/ts-1/data/info.pb
I20260808 14:54:53.201557 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 16454
I20260808 14:54:53.201727 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200577490656-27451-0/minicluster-data/ts-1/wal/instance
I20260808 14:54:53.202299 27451 external_mini_cluster.cc:1428] Setting key caf6b2163e966bf729c8fbd57bba7683
I20260808 14:54:53.206406 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200577490656-27451-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200577490656-27451-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200577490656-27451-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200577490656-27451-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.206.195:0
--local_ip_for_outbound_sockets=127.26.206.195
--webserver_interface=127.26.206.195
--webserver_port=0
--tserver_master_addrs=127.26.206.254:37611
--builtin_ntp_servers=127.26.206.212:45471
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 14:54:53.229321 16452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:53.203746 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.194:36299 (local address 127.26.206.254:37611)
0808 14:54:53.203958 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0808 14:54:53.203965 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:54:53.220644 (+ 16679us) server_negotiation.cc:407] Connection header received
0808 14:54:53.223009 (+ 2365us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:54:53.223015 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:54:53.223103 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:54:53.223226 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:54:53.224330 (+ 1104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:53.225034 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:53.226618 (+ 1584us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:53.226997 (+ 379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:53.227136 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:53.228536 (+ 1400us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:54:53.228540 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:54:53.228543 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:54:53.228560 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:54:53.228589 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:54:53.228601 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:54:53.228690 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0808 14:54:53.228919 (+ 229us) server_negotiation.cc:299] Negotiation successful
0808 14:54:53.229009 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260808 14:54:53.230286 16594 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:53.204408 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:37611 (local address 127.26.206.194:36299)
0808 14:54:53.220456 (+ 16048us) negotiation.cc:107] Waiting for socket to connect
0808 14:54:53.220512 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0808 14:54:53.222683 (+ 2171us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:54:53.223456 (+ 773us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:54:53.223464 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:54:53.223547 (+ 83us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:54:53.224158 (+ 611us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:54:53.224173 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:54:53.225205 (+ 1032us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:54:53.225215 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:54:53.226447 (+ 1232us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:54:53.226459 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:54:53.227231 (+ 772us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:54:53.227238 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:54:53.227470 (+ 232us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:53.228231 (+ 761us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 14:54:53.228234 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:54:53.228271 (+ 37us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 14:54:53.228339 (+ 68us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:54:53.228690 (+ 351us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:54:53.228703 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:54:53.228712 (+ 9us) client_negotiation.cc:769] Sending connection context
0808 14:54:53.228886 (+ 174us) client_negotiation.cc:240] Negotiation successful
0808 14:54:53.229251 (+ 365us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15473,"thread_start_us":15270,"threads_started":1}
I20260808 14:54:53.231810 16591 heartbeater.cc:347] Connected to a master server at 127.26.206.254:37611
I20260808 14:54:53.232098 16591 heartbeater.cc:464] Registering TS with master...
I20260808 14:54:53.232828 16591 heartbeater.cc:511] Master 127.26.206.254:37611 requested a full tablet report, sending...
I20260808 14:54:53.234328 16253 ts_manager.cc:194] Registered new tserver with Master: 4eeb203186214b028e7a6cb2226253ba (127.26.206.194:38095)
I20260808 14:54:53.235684 16253 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.26.206.194:36299
W20260808 14:54:53.554945 16595 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:54:53.555217 16595 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:54:53.555302 16595 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:54:53.562461 16595 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:54:53.562561 16595 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:54:53.562668 16595 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.206.195
I20260808 14:54:53.571432 16595 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:45471
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200577490656-27451-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200577490656-27451-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.206.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200577490656-27451-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.206.195
--webserver_port=0
--tserver_master_addrs=127.26.206.254:37611
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.206.195
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200577490656-27451-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:54:53.572695 16595 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:54:53.574420 16595 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:54:53.588078 16600 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:54:53.588078 16603 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:54:53.588014 16601 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:54:53.589097 16595 server_base.cc:1034] running on GCE node
I20260808 14:54:53.589648 16595 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:54:53.590565 16595 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:54:53.591756 16595 hybrid_clock.cc:648] HybridClock initialized: now 1786200893591706 us; error 50 us; skew 500 ppm
I20260808 14:54:53.592034 16595 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 14:54:53.594179 16595 webserver.cc:460] Webserver started at http://127.26.206.195:45491/ using document root <none> and password file <none>
I20260808 14:54:53.594821 16595 fs_manager.cc:359] Metadata directory not provided
I20260808 14:54:53.594907 16595 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:54:53.595162 16595 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:54:53.598026 16595 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200577490656-27451-0/minicluster-data/ts-2/data/instance:
uuid: "249e49a170694d89ab8d38853b0cef1d"
format_stamp: "Formatted at 2026-08-08 14:54:53 on dist-test-slave-6k22"
server_key: "655c59ae854519e3a293c834c0d3e5dd"
server_key_iv: "ff2c75ac53e0fbb69ef6efc2548583c1"
server_key_version: "encryptionkey@0"
I20260808 14:54:53.598769 16595 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200577490656-27451-0/minicluster-data/ts-2/wal/instance:
uuid: "249e49a170694d89ab8d38853b0cef1d"
format_stamp: "Formatted at 2026-08-08 14:54:53 on dist-test-slave-6k22"
server_key: "655c59ae854519e3a293c834c0d3e5dd"
server_key_iv: "ff2c75ac53e0fbb69ef6efc2548583c1"
server_key_version: "encryptionkey@0"
I20260808 14:54:53.603645 16595 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260808 14:54:53.606905 16609 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:54:53.608204 16595 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 14:54:53.608340 16595 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200577490656-27451-0/minicluster-data/ts-2/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200577490656-27451-0/minicluster-data/ts-2/wal
uuid: "249e49a170694d89ab8d38853b0cef1d"
format_stamp: "Formatted at 2026-08-08 14:54:53 on dist-test-slave-6k22"
server_key: "655c59ae854519e3a293c834c0d3e5dd"
server_key_iv: "ff2c75ac53e0fbb69ef6efc2548583c1"
server_key_version: "encryptionkey@0"
I20260808 14:54:53.608502 16595 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200577490656-27451-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200577490656-27451-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200577490656-27451-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:54:53.625095 16595 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:54:53.625805 16595 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:54:53.626060 16595 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:54:53.626930 16595 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:54:53.628360 16595 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:54:53.628453 16595 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:54:53.628530 16595 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:54:53.628584 16595 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:54:53.662403 16595 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.195:45951
I20260808 14:54:53.662482 16730 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.195:45951 every 8 connection(s)
I20260808 14:54:53.663801 16595 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200577490656-27451-0/minicluster-data/ts-2/data/info.pb
I20260808 14:54:53.671993 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 16595
I20260808 14:54:53.672199 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200577490656-27451-0/minicluster-data/ts-2/wal/instance
I20260808 14:54:53.672868 27451 external_mini_cluster.cc:1428] Setting key 4f767384af6f33c988b9e21eeaf9cff7
I20260808 14:54:53.676880 16452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:53.666306 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.195:55341 (local address 127.26.206.254:37611)
0808 14:54:53.666497 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0808 14:54:53.666501 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:54:53.668028 (+ 1527us) server_negotiation.cc:407] Connection header received
0808 14:54:53.669821 (+ 1793us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:54:53.669830 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:54:53.669922 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:54:53.670035 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:54:53.671070 (+ 1035us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:53.672109 (+ 1039us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:53.674082 (+ 1973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:53.674614 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:53.674712 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:53.676085 (+ 1373us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:54:53.676089 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:54:53.676092 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:54:53.676110 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:54:53.676142 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:54:53.676155 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:54:53.676252 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0808 14:54:53.676465 (+ 213us) server_negotiation.cc:299] Negotiation successful
0808 14:54:53.676561 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260808 14:54:53.677803 16733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:53.666826 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:37611 (local address 127.26.206.195:55341)
0808 14:54:53.667855 (+ 1029us) negotiation.cc:107] Waiting for socket to connect
0808 14:54:53.667902 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0808 14:54:53.669549 (+ 1647us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:54:53.670264 (+ 715us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:54:53.670272 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:54:53.670363 (+ 91us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:54:53.670908 (+ 545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:54:53.670924 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:54:53.672359 (+ 1435us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:54:53.672365 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:54:53.673934 (+ 1569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:54:53.673952 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:54:53.674833 (+ 881us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:54:53.674841 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:54:53.675042 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:53.675775 (+ 733us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 14:54:53.675786 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:54:53.675821 (+ 35us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 14:54:53.675896 (+ 75us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:54:53.676251 (+ 355us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:54:53.676263 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:54:53.676273 (+ 10us) client_negotiation.cc:769] Sending connection context
0808 14:54:53.676452 (+ 179us) client_negotiation.cc:240] Negotiation successful
0808 14:54:53.676824 (+ 372us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":474,"thread_start_us":274,"threads_started":1}
I20260808 14:54:53.678993 16731 heartbeater.cc:347] Connected to a master server at 127.26.206.254:37611
I20260808 14:54:53.679283 16731 heartbeater.cc:464] Registering TS with master...
I20260808 14:54:53.680030 16731 heartbeater.cc:511] Master 127.26.206.254:37611 requested a full tablet report, sending...
I20260808 14:54:53.681317 16253 ts_manager.cc:194] Registered new tserver with Master: 249e49a170694d89ab8d38853b0cef1d (127.26.206.195:45951)
I20260808 14:54:53.682126 16253 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.26.206.195:55341
I20260808 14:54:53.687963 27451 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 14:54:53.697819 16452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:53.692266 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57022 (local address 127.26.206.254:37611)
0808 14:54:53.692425 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0808 14:54:53.692430 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:54:53.692937 (+ 507us) server_negotiation.cc:407] Connection header received
0808 14:54:53.693066 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:54:53.693070 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:54:53.693139 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:54:53.693221 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:54:53.693664 (+ 443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:53.694344 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:53.695710 (+ 1366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:53.696129 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:53.696222 (+ 93us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:53.697239 (+ 1017us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:54:53.697243 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:54:53.697246 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:54:53.697272 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:54:53.697302 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:54:53.697313 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:54:53.697414 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0808 14:54:53.697573 (+ 159us) server_negotiation.cc:299] Negotiation successful
0808 14:54:53.697615 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260808 14:54:53.701606 16253 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57022:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:54:53.709153 16253 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:54:53.743647 16746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:53.722155 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58230 (local address 127.26.206.193:41223)
0808 14:54:53.732147 (+ 9992us) server_negotiation.cc:206] Beginning negotiation
0808 14:54:53.732161 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 14:54:53.735094 (+ 2933us) server_negotiation.cc:407] Connection header received
0808 14:54:53.735259 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:54:53.735270 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:54:53.735604 (+ 334us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:54:53.735828 (+ 224us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:54:53.736956 (+ 1128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:53.738563 (+ 1607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:53.741254 (+ 2691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:53.742330 (+ 1076us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:53.742497 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:53.742723 (+ 226us) server_negotiation.cc:1035] Waiting for connection context
0808 14:54:53.743075 (+ 352us) server_negotiation.cc:299] Negotiation successful
0808 14:54:53.743254 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9759,"thread_start_us":9615,"threads_started":1}
I20260808 14:54:53.743645 16745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:53.721757 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.195:45951 (local address 127.0.0.1:50276)
0808 14:54:53.732710 (+ 10953us) negotiation.cc:107] Waiting for socket to connect
0808 14:54:53.732776 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0808 14:54:53.733006 (+ 230us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:54:53.735813 (+ 2807us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:54:53.735820 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:54:53.735860 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:54:53.736523 (+ 663us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:54:53.736543 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:54:53.738209 (+ 1666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:54:53.738217 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:54:53.740830 (+ 2613us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:54:53.740846 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:54:53.742636 (+ 1790us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:54:53.742641 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:54:53.742842 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:53.742872 (+ 30us) client_negotiation.cc:769] Sending connection context
0808 14:54:53.742982 (+ 110us) client_negotiation.cc:240] Negotiation successful
0808 14:54:53.743211 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10673,"mutex_wait_us":32,"thread_start_us":12732,"threads_started":1}
I20260808 14:54:53.744030 16744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:53.721818 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50276 (local address 127.26.206.195:45951)
0808 14:54:53.735091 (+ 13273us) server_negotiation.cc:206] Beginning negotiation
0808 14:54:53.735099 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:54:53.735135 (+ 36us) server_negotiation.cc:407] Connection header received
0808 14:54:53.735247 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:54:53.735255 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:54:53.735542 (+ 287us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:54:53.736822 (+ 1280us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:54:53.737090 (+ 268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:53.738066 (+ 976us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:53.741048 (+ 2982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:53.742419 (+ 1371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:53.743203 (+ 784us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:53.743419 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0808 14:54:53.743483 (+ 64us) server_negotiation.cc:299] Negotiation successful
0808 14:54:53.743686 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11699,"thread_start_us":11598,"threads_started":1}
I20260808 14:54:53.744975 16748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:53.733810 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.194:38095 (local address 127.0.0.1:39176)
0808 14:54:53.735065 (+ 1255us) negotiation.cc:107] Waiting for socket to connect
0808 14:54:53.735082 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 14:54:53.735208 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:54:53.736039 (+ 831us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:54:53.736043 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:54:53.736063 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:54:53.736785 (+ 722us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:54:53.736815 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:54:53.739672 (+ 2857us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:54:53.739678 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:54:53.741916 (+ 2238us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:54:53.741931 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:54:53.744094 (+ 2163us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:54:53.744103 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:54:53.744304 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:53.744352 (+ 48us) client_negotiation.cc:769] Sending connection context
0808 14:54:53.744445 (+ 93us) client_negotiation.cc:240] Negotiation successful
0808 14:54:53.744580 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1106,"mutex_wait_us":91,"thread_start_us":972,"threads_started":1}
I20260808 14:54:53.745721 16747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:53.733826 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39176 (local address 127.26.206.194:38095)
0808 14:54:53.734439 (+ 613us) server_negotiation.cc:206] Beginning negotiation
0808 14:54:53.734451 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 14:54:53.735249 (+ 798us) server_negotiation.cc:407] Connection header received
0808 14:54:53.735337 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:54:53.735343 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:54:53.735538 (+ 195us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:54:53.735776 (+ 238us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:54:53.736979 (+ 1203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:53.738563 (+ 1584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:53.742130 (+ 3567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:53.743499 (+ 1369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:53.743758 (+ 259us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:53.743970 (+ 212us) server_negotiation.cc:1035] Waiting for connection context
0808 14:54:53.745194 (+ 1224us) server_negotiation.cc:299] Negotiation successful
0808 14:54:53.745389 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":419,"thread_start_us":283,"threads_started":1}
I20260808 14:54:53.747599 16743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:53.721907 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.193:41223 (local address 127.0.0.1:58230)
0808 14:54:53.734898 (+ 12991us) negotiation.cc:107] Waiting for socket to connect
0808 14:54:53.734920 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 14:54:53.735100 (+ 180us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:54:53.736100 (+ 1000us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:54:53.736106 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:54:53.736136 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:54:53.736720 (+ 584us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:54:53.736738 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:54:53.738713 (+ 1975us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:54:53.738718 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:54:53.741078 (+ 2360us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:54:53.741089 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:54:53.742550 (+ 1461us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:54:53.742560 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:54:53.742780 (+ 220us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:53.742873 (+ 93us) client_negotiation.cc:769] Sending connection context
0808 14:54:53.743003 (+ 130us) client_negotiation.cc:240] Negotiation successful
0808 14:54:53.744782 (+ 1779us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12808,"mutex_wait_us":123,"thread_start_us":10318,"threads_started":1}
I20260808 14:54:53.747965 16664 tablet_service.cc:1467] Processing CreateTablet for tablet 91ad6f5660ab401cbe82658999873518 (DEFAULT_TABLE table=test-table [id=074096b170864a9f992186a9c80dc82e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:54:53.749028 16520 tablet_service.cc:1467] Processing CreateTablet for tablet 91ad6f5660ab401cbe82658999873518 (DEFAULT_TABLE table=test-table [id=074096b170864a9f992186a9c80dc82e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:54:53.749820 16664 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 91ad6f5660ab401cbe82658999873518. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:54:53.750782 16520 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 91ad6f5660ab401cbe82658999873518. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:54:53.751955 16381 tablet_service.cc:1467] Processing CreateTablet for tablet 91ad6f5660ab401cbe82658999873518 (DEFAULT_TABLE table=test-table [id=074096b170864a9f992186a9c80dc82e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:54:53.753374 16381 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 91ad6f5660ab401cbe82658999873518. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:54:53.765759 16749 tablet_bootstrap.cc:492] T 91ad6f5660ab401cbe82658999873518 P 249e49a170694d89ab8d38853b0cef1d: Bootstrap starting.
I20260808 14:54:53.767793 16750 tablet_bootstrap.cc:492] T 91ad6f5660ab401cbe82658999873518 P 4eeb203186214b028e7a6cb2226253ba: Bootstrap starting.
I20260808 14:54:53.769646 16749 tablet_bootstrap.cc:654] T 91ad6f5660ab401cbe82658999873518 P 249e49a170694d89ab8d38853b0cef1d: Neither blocks nor log segments found. Creating new log.
I20260808 14:54:53.770949 16749 log.cc:824] T 91ad6f5660ab401cbe82658999873518 P 249e49a170694d89ab8d38853b0cef1d: Log is configured to *not* fsync() on all Append() calls
I20260808 14:54:53.771322 16750 tablet_bootstrap.cc:654] T 91ad6f5660ab401cbe82658999873518 P 4eeb203186214b028e7a6cb2226253ba: Neither blocks nor log segments found. Creating new log.
I20260808 14:54:53.772912 16750 log.cc:824] T 91ad6f5660ab401cbe82658999873518 P 4eeb203186214b028e7a6cb2226253ba: Log is configured to *not* fsync() on all Append() calls
I20260808 14:54:53.773293 16450 heartbeater.cc:503] Master 127.26.206.254:37611 was elected leader, sending a full tablet report...
I20260808 14:54:53.775096 16752 tablet_bootstrap.cc:492] T 91ad6f5660ab401cbe82658999873518 P ad39c7f3bbc64eb3b3bbd9e6ec99927a: Bootstrap starting.
I20260808 14:54:53.778717 16750 tablet_bootstrap.cc:492] T 91ad6f5660ab401cbe82658999873518 P 4eeb203186214b028e7a6cb2226253ba: No bootstrap required, opened a new log
I20260808 14:54:53.779057 16750 ts_tablet_manager.cc:1397] T 91ad6f5660ab401cbe82658999873518 P 4eeb203186214b028e7a6cb2226253ba: Time spent bootstrapping tablet: real 0.012s user 0.009s sys 0.000s
I20260808 14:54:53.780465 16749 tablet_bootstrap.cc:492] T 91ad6f5660ab401cbe82658999873518 P 249e49a170694d89ab8d38853b0cef1d: No bootstrap required, opened a new log
I20260808 14:54:53.780473 16752 tablet_bootstrap.cc:654] T 91ad6f5660ab401cbe82658999873518 P ad39c7f3bbc64eb3b3bbd9e6ec99927a: Neither blocks nor log segments found. Creating new log.
I20260808 14:54:53.780803 16749 ts_tablet_manager.cc:1397] T 91ad6f5660ab401cbe82658999873518 P 249e49a170694d89ab8d38853b0cef1d: Time spent bootstrapping tablet: real 0.015s user 0.013s sys 0.000s
I20260808 14:54:53.781780 16752 log.cc:824] T 91ad6f5660ab401cbe82658999873518 P ad39c7f3bbc64eb3b3bbd9e6ec99927a: Log is configured to *not* fsync() on all Append() calls
I20260808 14:54:53.784719 16752 tablet_bootstrap.cc:492] T 91ad6f5660ab401cbe82658999873518 P ad39c7f3bbc64eb3b3bbd9e6ec99927a: No bootstrap required, opened a new log
I20260808 14:54:53.784974 16752 ts_tablet_manager.cc:1397] T 91ad6f5660ab401cbe82658999873518 P ad39c7f3bbc64eb3b3bbd9e6ec99927a: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.000s
I20260808 14:54:53.787133 16750 raft_consensus.cc:348] T 91ad6f5660ab401cbe82658999873518 P 4eeb203186214b028e7a6cb2226253ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "249e49a170694d89ab8d38853b0cef1d" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 45951 } } peers { permanent_uuid: "ad39c7f3bbc64eb3b3bbd9e6ec99927a" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 41223 } } peers { permanent_uuid: "4eeb203186214b028e7a6cb2226253ba" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 38095 } }
I20260808 14:54:53.787730 16750 raft_consensus.cc:374] T 91ad6f5660ab401cbe82658999873518 P 4eeb203186214b028e7a6cb2226253ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:54:53.787894 16750 raft_consensus.cc:729] T 91ad6f5660ab401cbe82658999873518 P 4eeb203186214b028e7a6cb2226253ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4eeb203186214b028e7a6cb2226253ba, State: Initialized, Role: FOLLOWER
I20260808 14:54:53.788532 16750 consensus_queue.cc:260] T 91ad6f5660ab401cbe82658999873518 P 4eeb203186214b028e7a6cb2226253ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "249e49a170694d89ab8d38853b0cef1d" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 45951 } } peers { permanent_uuid: "ad39c7f3bbc64eb3b3bbd9e6ec99927a" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 41223 } } peers { permanent_uuid: "4eeb203186214b028e7a6cb2226253ba" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 38095 } }
I20260808 14:54:53.789681 16591 heartbeater.cc:503] Master 127.26.206.254:37611 was elected leader, sending a full tablet report...
I20260808 14:54:53.790331 16750 ts_tablet_manager.cc:1428] T 91ad6f5660ab401cbe82658999873518 P 4eeb203186214b028e7a6cb2226253ba: Time spent starting tablet: real 0.011s user 0.006s sys 0.004s
I20260808 14:54:53.790968 16749 raft_consensus.cc:348] T 91ad6f5660ab401cbe82658999873518 P 249e49a170694d89ab8d38853b0cef1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "249e49a170694d89ab8d38853b0cef1d" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 45951 } } peers { permanent_uuid: "ad39c7f3bbc64eb3b3bbd9e6ec99927a" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 41223 } } peers { permanent_uuid: "4eeb203186214b028e7a6cb2226253ba" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 38095 } }
I20260808 14:54:53.791373 16749 raft_consensus.cc:374] T 91ad6f5660ab401cbe82658999873518 P 249e49a170694d89ab8d38853b0cef1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:54:53.791481 16749 raft_consensus.cc:729] T 91ad6f5660ab401cbe82658999873518 P 249e49a170694d89ab8d38853b0cef1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 249e49a170694d89ab8d38853b0cef1d, State: Initialized, Role: FOLLOWER
I20260808 14:54:53.792089 16749 consensus_queue.cc:260] T 91ad6f5660ab401cbe82658999873518 P 249e49a170694d89ab8d38853b0cef1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "249e49a170694d89ab8d38853b0cef1d" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 45951 } } peers { permanent_uuid: "ad39c7f3bbc64eb3b3bbd9e6ec99927a" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 41223 } } peers { permanent_uuid: "4eeb203186214b028e7a6cb2226253ba" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 38095 } }
I20260808 14:54:53.796514 16752 raft_consensus.cc:348] T 91ad6f5660ab401cbe82658999873518 P ad39c7f3bbc64eb3b3bbd9e6ec99927a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "249e49a170694d89ab8d38853b0cef1d" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 45951 } } peers { permanent_uuid: "ad39c7f3bbc64eb3b3bbd9e6ec99927a" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 41223 } } peers { permanent_uuid: "4eeb203186214b028e7a6cb2226253ba" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 38095 } }
I20260808 14:54:53.797035 16752 raft_consensus.cc:374] T 91ad6f5660ab401cbe82658999873518 P ad39c7f3bbc64eb3b3bbd9e6ec99927a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:54:53.797147 16752 raft_consensus.cc:729] T 91ad6f5660ab401cbe82658999873518 P ad39c7f3bbc64eb3b3bbd9e6ec99927a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad39c7f3bbc64eb3b3bbd9e6ec99927a, State: Initialized, Role: FOLLOWER
I20260808 14:54:53.797751 16731 heartbeater.cc:503] Master 127.26.206.254:37611 was elected leader, sending a full tablet report...
I20260808 14:54:53.797837 16752 consensus_queue.cc:260] T 91ad6f5660ab401cbe82658999873518 P ad39c7f3bbc64eb3b3bbd9e6ec99927a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "249e49a170694d89ab8d38853b0cef1d" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 45951 } } peers { permanent_uuid: "ad39c7f3bbc64eb3b3bbd9e6ec99927a" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 41223 } } peers { permanent_uuid: "4eeb203186214b028e7a6cb2226253ba" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 38095 } }
I20260808 14:54:53.798583 16749 ts_tablet_manager.cc:1428] T 91ad6f5660ab401cbe82658999873518 P 249e49a170694d89ab8d38853b0cef1d: Time spent starting tablet: real 0.018s user 0.019s sys 0.000s
I20260808 14:54:53.799283 16756 raft_consensus.cc:482] T 91ad6f5660ab401cbe82658999873518 P 4eeb203186214b028e7a6cb2226253ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:54:53.799633 16756 raft_consensus.cc:504] T 91ad6f5660ab401cbe82658999873518 P 4eeb203186214b028e7a6cb2226253ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "249e49a170694d89ab8d38853b0cef1d" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 45951 } } peers { permanent_uuid: "ad39c7f3bbc64eb3b3bbd9e6ec99927a" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 41223 } } peers { permanent_uuid: "4eeb203186214b028e7a6cb2226253ba" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 38095 } }
I20260808 14:54:53.800200 16752 ts_tablet_manager.cc:1428] T 91ad6f5660ab401cbe82658999873518 P ad39c7f3bbc64eb3b3bbd9e6ec99927a: Time spent starting tablet: real 0.015s user 0.011s sys 0.004s
I20260808 14:54:53.803808 16756 leader_election.cc:288] T 91ad6f5660ab401cbe82658999873518 P 4eeb203186214b028e7a6cb2226253ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 249e49a170694d89ab8d38853b0cef1d (127.26.206.195:45951), ad39c7f3bbc64eb3b3bbd9e6ec99927a (127.26.206.193:41223)
I20260808 14:54:53.808429 16744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:53.802174 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.194:49379 (local address 127.26.206.195:45951)
0808 14:54:53.802342 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0808 14:54:53.802348 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:54:53.802463 (+ 115us) server_negotiation.cc:407] Connection header received
0808 14:54:53.802654 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:54:53.802659 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:54:53.802722 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:54:53.802842 (+ 120us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:54:53.804235 (+ 1393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:53.804943 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:53.806747 (+ 1804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:53.807494 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:53.807735 (+ 241us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:53.807803 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0808 14:54:53.808091 (+ 288us) server_negotiation.cc:299] Negotiation successful
0808 14:54:53.808205 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260808 14:54:53.808549 16759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:53.801791 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.195:45951 (local address 127.26.206.194:49379)
0808 14:54:53.802355 (+ 564us) negotiation.cc:107] Waiting for socket to connect
0808 14:54:53.802376 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 14:54:53.802528 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:54:53.802997 (+ 469us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:54:53.803001 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:54:53.803020 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:54:53.804087 (+ 1067us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:54:53.804101 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:54:53.805074 (+ 973us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:54:53.805081 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:54:53.806555 (+ 1474us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:54:53.806566 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:54:53.807743 (+ 1177us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:54:53.807749 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:54:53.807930 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:53.807953 (+ 23us) client_negotiation.cc:769] Sending connection context
0808 14:54:53.808054 (+ 101us) client_negotiation.cc:240] Negotiation successful
0808 14:54:53.808177 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":404,"mutex_wait_us":22,"thread_start_us":557,"threads_started":1}
I20260808 14:54:53.809060 16746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:53.803492 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.194:40683 (local address 127.26.206.193:41223)
0808 14:54:53.803712 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0808 14:54:53.803718 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:54:53.803971 (+ 253us) server_negotiation.cc:407] Connection header received
0808 14:54:53.804257 (+ 286us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:54:53.804262 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:54:53.804338 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:54:53.804433 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:54:53.804916 (+ 483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:53.805596 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:53.807309 (+ 1713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:53.808137 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:53.808302 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:53.808361 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0808 14:54:53.808692 (+ 331us) server_negotiation.cc:299] Negotiation successful
0808 14:54:53.808817 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260808 14:54:53.809581 16760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:53.803087 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.193:41223 (local address 127.26.206.194:40683)
0808 14:54:53.803844 (+ 757us) negotiation.cc:107] Waiting for socket to connect
0808 14:54:53.803861 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 14:54:53.804108 (+ 247us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:54:53.804446 (+ 338us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:54:53.804451 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:54:53.804473 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:54:53.804779 (+ 306us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:54:53.804786 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:54:53.805745 (+ 959us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:54:53.805756 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:54:53.807110 (+ 1354us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:54:53.807121 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:54:53.808312 (+ 1191us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:54:53.808318 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:54:53.808501 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:53.808547 (+ 46us) client_negotiation.cc:769] Sending connection context
0808 14:54:53.809278 (+ 731us) client_negotiation.cc:240] Negotiation successful
0808 14:54:53.809364 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":602,"mutex_wait_us":21,"thread_start_us":577,"threads_started":1}
I20260808 14:54:53.809499 16685 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "91ad6f5660ab401cbe82658999873518" candidate_uuid: "4eeb203186214b028e7a6cb2226253ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "249e49a170694d89ab8d38853b0cef1d" is_pre_election: true
I20260808 14:54:53.809937 16685 raft_consensus.cc:2454] T 91ad6f5660ab401cbe82658999873518 P 249e49a170694d89ab8d38853b0cef1d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eeb203186214b028e7a6cb2226253ba in term 0.
I20260808 14:54:53.810559 16469 leader_election.cc:302] T 91ad6f5660ab401cbe82658999873518 P 4eeb203186214b028e7a6cb2226253ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 249e49a170694d89ab8d38853b0cef1d, 4eeb203186214b028e7a6cb2226253ba; no voters:
I20260808 14:54:53.810530 16405 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "91ad6f5660ab401cbe82658999873518" candidate_uuid: "4eeb203186214b028e7a6cb2226253ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad39c7f3bbc64eb3b3bbd9e6ec99927a" is_pre_election: true
I20260808 14:54:53.810945 16756 raft_consensus.cc:2781] T 91ad6f5660ab401cbe82658999873518 P 4eeb203186214b028e7a6cb2226253ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:54:53.811049 16756 raft_consensus.cc:482] T 91ad6f5660ab401cbe82658999873518 P 4eeb203186214b028e7a6cb2226253ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:54:53.811112 16756 raft_consensus.cc:3037] T 91ad6f5660ab401cbe82658999873518 P 4eeb203186214b028e7a6cb2226253ba [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:54:53.811069 16405 raft_consensus.cc:2454] T 91ad6f5660ab401cbe82658999873518 P ad39c7f3bbc64eb3b3bbd9e6ec99927a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eeb203186214b028e7a6cb2226253ba in term 0.
I20260808 14:54:53.813648 16756 raft_consensus.cc:504] T 91ad6f5660ab401cbe82658999873518 P 4eeb203186214b028e7a6cb2226253ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "249e49a170694d89ab8d38853b0cef1d" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 45951 } } peers { permanent_uuid: "ad39c7f3bbc64eb3b3bbd9e6ec99927a" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 41223 } } peers { permanent_uuid: "4eeb203186214b028e7a6cb2226253ba" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 38095 } }
I20260808 14:54:53.814246 16756 leader_election.cc:288] T 91ad6f5660ab401cbe82658999873518 P 4eeb203186214b028e7a6cb2226253ba [CANDIDATE]: Term 1 election: Requested vote from peers 249e49a170694d89ab8d38853b0cef1d (127.26.206.195:45951), ad39c7f3bbc64eb3b3bbd9e6ec99927a (127.26.206.193:41223)
I20260808 14:54:53.814669 16405 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "91ad6f5660ab401cbe82658999873518" candidate_uuid: "4eeb203186214b028e7a6cb2226253ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad39c7f3bbc64eb3b3bbd9e6ec99927a"
I20260808 14:54:53.814700 16685 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "91ad6f5660ab401cbe82658999873518" candidate_uuid: "4eeb203186214b028e7a6cb2226253ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "249e49a170694d89ab8d38853b0cef1d"
I20260808 14:54:53.814873 16405 raft_consensus.cc:3037] T 91ad6f5660ab401cbe82658999873518 P ad39c7f3bbc64eb3b3bbd9e6ec99927a [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:54:53.814920 16685 raft_consensus.cc:3037] T 91ad6f5660ab401cbe82658999873518 P 249e49a170694d89ab8d38853b0cef1d [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:54:53.817119 16405 raft_consensus.cc:2454] T 91ad6f5660ab401cbe82658999873518 P ad39c7f3bbc64eb3b3bbd9e6ec99927a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eeb203186214b028e7a6cb2226253ba in term 1.
I20260808 14:54:53.817242 16685 raft_consensus.cc:2454] T 91ad6f5660ab401cbe82658999873518 P 249e49a170694d89ab8d38853b0cef1d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eeb203186214b028e7a6cb2226253ba in term 1.
I20260808 14:54:53.817535 16471 leader_election.cc:302] T 91ad6f5660ab401cbe82658999873518 P 4eeb203186214b028e7a6cb2226253ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eeb203186214b028e7a6cb2226253ba, ad39c7f3bbc64eb3b3bbd9e6ec99927a; no voters:
I20260808 14:54:53.817927 16756 raft_consensus.cc:2781] T 91ad6f5660ab401cbe82658999873518 P 4eeb203186214b028e7a6cb2226253ba [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:54:53.818315 16756 raft_consensus.cc:686] T 91ad6f5660ab401cbe82658999873518 P 4eeb203186214b028e7a6cb2226253ba [term 1 LEADER]: Becoming Leader. State: Replica: 4eeb203186214b028e7a6cb2226253ba, State: Running, Role: LEADER
I20260808 14:54:53.818773 16756 consensus_queue.cc:237] T 91ad6f5660ab401cbe82658999873518 P 4eeb203186214b028e7a6cb2226253ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "249e49a170694d89ab8d38853b0cef1d" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 45951 } } peers { permanent_uuid: "ad39c7f3bbc64eb3b3bbd9e6ec99927a" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 41223 } } peers { permanent_uuid: "4eeb203186214b028e7a6cb2226253ba" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 38095 } }
I20260808 14:54:53.823310 16252 catalog_manager.cc:5495] T 91ad6f5660ab401cbe82658999873518 P 4eeb203186214b028e7a6cb2226253ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 4eeb203186214b028e7a6cb2226253ba (127.26.206.194). New cstate: current_term: 1 leader_uuid: "4eeb203186214b028e7a6cb2226253ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "249e49a170694d89ab8d38853b0cef1d" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 45951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad39c7f3bbc64eb3b3bbd9e6ec99927a" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 41223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4eeb203186214b028e7a6cb2226253ba" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 38095 } health_report { overall_health: HEALTHY } } }
I20260808 14:54:53.839378 16747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:53.834419 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39184 (local address 127.26.206.194:38095)
0808 14:54:53.834594 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0808 14:54:53.834598 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:54:53.834679 (+ 81us) server_negotiation.cc:407] Connection header received
0808 14:54:53.834834 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:54:53.834838 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:54:53.834918 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:54:53.835037 (+ 119us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:54:53.835401 (+ 364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:53.836155 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:53.837484 (+ 1329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:53.837878 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:53.837966 (+ 88us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:53.838427 (+ 461us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:54:53.838871 (+ 444us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:54:53.839072 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0808 14:54:53.839132 (+ 60us) server_negotiation.cc:299] Negotiation successful
0808 14:54:53.839165 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260808 14:54:53.847844 16685 raft_consensus.cc:1261] T 91ad6f5660ab401cbe82658999873518 P 249e49a170694d89ab8d38853b0cef1d [term 1 FOLLOWER]: Refusing update from remote peer 4eeb203186214b028e7a6cb2226253ba: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:54:53.847862 16405 raft_consensus.cc:1261] T 91ad6f5660ab401cbe82658999873518 P ad39c7f3bbc64eb3b3bbd9e6ec99927a [term 1 FOLLOWER]: Refusing update from remote peer 4eeb203186214b028e7a6cb2226253ba: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:54:53.848835 16761 consensus_queue.cc:1035] T 91ad6f5660ab401cbe82658999873518 P 4eeb203186214b028e7a6cb2226253ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad39c7f3bbc64eb3b3bbd9e6ec99927a" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 41223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:54:53.849236 16756 consensus_queue.cc:1035] T 91ad6f5660ab401cbe82658999873518 P 4eeb203186214b028e7a6cb2226253ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "249e49a170694d89ab8d38853b0cef1d" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 45951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:54:53.873340 16253 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57022:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:54:53.873643 16253 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57022:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:54:53.877699 16253 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1fab932c6fef443f9e23abbdf8b244c9: Sending DeleteTablet for 3 replicas of tablet 91ad6f5660ab401cbe82658999873518
I20260808 14:54:53.878824 16664 tablet_service.cc:1514] Processing DeleteTablet for tablet 91ad6f5660ab401cbe82658999873518 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:54:53 UTC) from {username='slave'} at 127.0.0.1:50276
I20260808 14:54:53.879524 16381 tablet_service.cc:1514] Processing DeleteTablet for tablet 91ad6f5660ab401cbe82658999873518 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:54:53 UTC) from {username='slave'} at 127.0.0.1:58230
I20260808 14:54:53.879449 16380 tablet_service.cc:1514] Processing DeleteTablet for tablet 91ad6f5660ab401cbe82658999873518 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:54:53 UTC) from {username='slave'} at 127.0.0.1:58230
I20260808 14:54:53.879752 16777 tablet_replica.cc:330] T 91ad6f5660ab401cbe82658999873518 P 249e49a170694d89ab8d38853b0cef1d: stopping tablet replica
I20260808 14:54:53.880167 16777 raft_consensus.cc:2229] T 91ad6f5660ab401cbe82658999873518 P 249e49a170694d89ab8d38853b0cef1d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:54:53.880152 16520 tablet_service.cc:1514] Processing DeleteTablet for tablet 91ad6f5660ab401cbe82658999873518 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:54:53 UTC) from {username='slave'} at 127.0.0.1:39176
I20260808 14:54:53.880347 16778 tablet_replica.cc:330] T 91ad6f5660ab401cbe82658999873518 P ad39c7f3bbc64eb3b3bbd9e6ec99927a: stopping tablet replica
I20260808 14:54:53.880641 16777 raft_consensus.cc:2258] T 91ad6f5660ab401cbe82658999873518 P 249e49a170694d89ab8d38853b0cef1d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:54:53.880697 16778 raft_consensus.cc:2229] T 91ad6f5660ab401cbe82658999873518 P ad39c7f3bbc64eb3b3bbd9e6ec99927a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:54:53.881108 16778 raft_consensus.cc:2258] T 91ad6f5660ab401cbe82658999873518 P ad39c7f3bbc64eb3b3bbd9e6ec99927a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:54:53.882237 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 16314
I20260808 14:54:53.883006 16777 ts_tablet_manager.cc:1905] T 91ad6f5660ab401cbe82658999873518 P 249e49a170694d89ab8d38853b0cef1d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:54:53.883006 16778 ts_tablet_manager.cc:1905] T 91ad6f5660ab401cbe82658999873518 P ad39c7f3bbc64eb3b3bbd9e6ec99927a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:54:53.889951 16777 ts_tablet_manager.cc:1918] T 91ad6f5660ab401cbe82658999873518 P 249e49a170694d89ab8d38853b0cef1d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:54:53.889951 16778 ts_tablet_manager.cc:1918] T 91ad6f5660ab401cbe82658999873518 P ad39c7f3bbc64eb3b3bbd9e6ec99927a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:54:53.890113 16777 log.cc:1196] T 91ad6f5660ab401cbe82658999873518 P 249e49a170694d89ab8d38853b0cef1d: Deleting WAL directory at /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200577490656-27451-0/minicluster-data/ts-2/wal/wals/91ad6f5660ab401cbe82658999873518
I20260808 14:54:53.890110 16778 log.cc:1196] T 91ad6f5660ab401cbe82658999873518 P ad39c7f3bbc64eb3b3bbd9e6ec99927a: Deleting WAL directory at /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200577490656-27451-0/minicluster-data/ts-0/wal/wals/91ad6f5660ab401cbe82658999873518
I20260808 14:54:53.890677 16778 ts_tablet_manager.cc:1939] T 91ad6f5660ab401cbe82658999873518 P ad39c7f3bbc64eb3b3bbd9e6ec99927a: Deleting consensus metadata
I20260808 14:54:53.890677 16777 ts_tablet_manager.cc:1939] T 91ad6f5660ab401cbe82658999873518 P 249e49a170694d89ab8d38853b0cef1d: Deleting consensus metadata
I20260808 14:54:53.891899 16779 tablet_replica.cc:330] T 91ad6f5660ab401cbe82658999873518 P 4eeb203186214b028e7a6cb2226253ba: stopping tablet replica
I20260808 14:54:53.892448 16239 catalog_manager.cc:4841] TS ad39c7f3bbc64eb3b3bbd9e6ec99927a (127.26.206.193:41223): tablet 91ad6f5660ab401cbe82658999873518 (table test-table [id=074096b170864a9f992186a9c80dc82e]) successfully deleted
W20260808 14:54:53.892891 16239 catalog_manager.cc:4808] TS ad39c7f3bbc64eb3b3bbd9e6ec99927a (127.26.206.193:41223): delete failed for tablet 91ad6f5660ab401cbe82658999873518 because the tablet was not found. No further retry: Not found: Tablet not found: 91ad6f5660ab401cbe82658999873518
I20260808 14:54:53.893191 16237 catalog_manager.cc:4841] TS 249e49a170694d89ab8d38853b0cef1d (127.26.206.195:45951): tablet 91ad6f5660ab401cbe82658999873518 (table test-table [id=074096b170864a9f992186a9c80dc82e]) successfully deleted
I20260808 14:54:53.893725 16779 raft_consensus.cc:2229] T 91ad6f5660ab401cbe82658999873518 P 4eeb203186214b028e7a6cb2226253ba [term 1 LEADER]: Raft consensus shutting down.
I20260808 14:54:53.894390 16779 raft_consensus.cc:2258] T 91ad6f5660ab401cbe82658999873518 P 4eeb203186214b028e7a6cb2226253ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:54:53.896414 16779 ts_tablet_manager.cc:1905] T 91ad6f5660ab401cbe82658999873518 P 4eeb203186214b028e7a6cb2226253ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:54:53.901878 16746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:53.883686 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58236 (local address 127.26.206.193:41223)
0808 14:54:53.883938 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0808 14:54:53.883947 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:54:53.896005 (+ 12058us) server_negotiation.cc:407] Connection header received
0808 14:54:53.896208 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:54:53.896212 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:54:53.896303 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:54:53.896416 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:54:53.896829 (+ 413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:53.897572 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:53.898847 (+ 1275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:53.899246 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:53.899390 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:53.900535 (+ 1145us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:54:53.900542 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:54:53.900554 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:54:53.901125 (+ 571us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:54:53.901168 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:54:53.901186 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:54:53.901325 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0808 14:54:53.901451 (+ 126us) server_negotiation.cc:299] Negotiation successful
0808 14:54:53.901562 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260808 14:54:53.902532 16445 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:54:53.903815 16779 ts_tablet_manager.cc:1918] T 91ad6f5660ab401cbe82658999873518 P 4eeb203186214b028e7a6cb2226253ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:54:53.904043 16779 log.cc:1196] T 91ad6f5660ab401cbe82658999873518 P 4eeb203186214b028e7a6cb2226253ba: Deleting WAL directory at /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200577490656-27451-0/minicluster-data/ts-1/wal/wals/91ad6f5660ab401cbe82658999873518
I20260808 14:54:53.904894 16779 ts_tablet_manager.cc:1939] T 91ad6f5660ab401cbe82658999873518 P 4eeb203186214b028e7a6cb2226253ba: Deleting consensus metadata
I20260808 14:54:53.906605 16239 catalog_manager.cc:4841] TS 4eeb203186214b028e7a6cb2226253ba (127.26.206.194:38095): tablet 91ad6f5660ab401cbe82658999873518 (table test-table [id=074096b170864a9f992186a9c80dc82e]) successfully deleted
I20260808 14:54:54.017886 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 16314
I20260808 14:54:54.040126 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 16454
I20260808 14:54:54.048180 16747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:54.041005 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39196 (local address 127.26.206.194:38095)
0808 14:54:54.041184 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0808 14:54:54.041188 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:54:54.041271 (+ 83us) server_negotiation.cc:407] Connection header received
0808 14:54:54.041472 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:54:54.041477 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:54:54.041590 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:54:54.041735 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:54:54.042131 (+ 396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:54.043023 (+ 892us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:54.044899 (+ 1876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:54.045328 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:54.045423 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:54.046583 (+ 1160us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:54:54.046592 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:54:54.046606 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:54:54.047242 (+ 636us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:54:54.047288 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:54:54.047307 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:54:54.047385 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0808 14:54:54.047602 (+ 217us) server_negotiation.cc:299] Negotiation successful
0808 14:54:54.047731 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260808 14:54:54.048961 16586 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:54:54.161578 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 16454
I20260808 14:54:54.185601 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 16595
I20260808 14:54:54.192687 16744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:54.186358 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50286 (local address 127.26.206.195:45951)
0808 14:54:54.186538 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0808 14:54:54.186545 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:54:54.186594 (+ 49us) server_negotiation.cc:407] Connection header received
0808 14:54:54.186828 (+ 234us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:54:54.186832 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:54:54.186921 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:54:54.187051 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:54:54.187469 (+ 418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:54.188312 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:54.189616 (+ 1304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:54.190021 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:54.190158 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:54.191310 (+ 1152us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:54:54.191319 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:54:54.191334 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:54:54.191954 (+ 620us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:54:54.192002 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:54:54.192027 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:54:54.192149 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0808 14:54:54.192298 (+ 149us) server_negotiation.cc:299] Negotiation successful
0808 14:54:54.192404 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260808 14:54:54.193325 16726 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:54:54.292143 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 16595
I20260808 14:54:54.313212 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 16221
I20260808 14:54:54.314350 16283 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:54:54.425873 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 16221
2026-08-08T14:54:54Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (2755 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200577490656-27451-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:54:54 dist-test-slave-6k22 krb5kdc[16787](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:54:54 dist-test-slave-6k22 krb5kdc[16787](info): set up 2 sockets
Aug 08 14:54:54 dist-test-slave-6k22 krb5kdc[16787](info): commencing operation
krb5kdc: starting...
W20260808 14:54:55.608407 27451 mini_kdc.cc:121] Time spent starting KDC: real 1.137s user 0.003s sys 0.039s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200577490656-27451-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200577490656-27451-0/krb5kdc/test-user.keytab.
Aug 08 14:54:55 dist-test-slave-6k22 krb5kdc[16787](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200895, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:54:55Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:54:55Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.206.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.206.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.206.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.254.keytab.
Entry for principal kudu/127.26.206.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.254.keytab.
I20260808 14:54:55.901036 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200577490656-27451-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200577490656-27451-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200577490656-27451-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.206.254:46021
--webserver_interface=127.26.206.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.254.keytab
--principal=kudu/127.26.206.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.206.212:46545
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.206.254:46021
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:54:56.235620 16803 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:54:56.235983 16803 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:54:56.236136 16803 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:54:56.243060 16803 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:54:56.243152 16803 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:54:56.243199 16803 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:54:56.243253 16803 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:54:56.243294 16803 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:54:56.252604 16803 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:46545
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200577490656-27451-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200577490656-27451-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.206.254:46021
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.254.keytab
--principal=kudu/127.26.206.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.206.254:46021
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.206.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200577490656-27451-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:54:56.253834 16803 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:54:56.255064 16803 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:54:56.266856 16808 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:54:56.266904 16809 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:54:56.266930 16811 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:54:56.268167 16803 server_base.cc:1034] running on GCE node
I20260808 14:54:56.268849 16803 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:54:56.270094 16803 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:54:56.271299 16803 hybrid_clock.cc:648] HybridClock initialized: now 1786200896271248 us; error 39 us; skew 500 ppm
I20260808 14:54:56.271706 16803 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:54:56 dist-test-slave-6k22 krb5kdc[16787](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200896, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:54:56.279950 16803 init.cc:377] Logged in from keytab as kudu/127.26.206.254@KRBTEST.COM (short username kudu)
I20260808 14:54:56.281440 16803 webserver.cc:460] Webserver started at http://127.26.206.254:41785/ using document root <none> and password file <none>
I20260808 14:54:56.282157 16803 fs_manager.cc:359] Metadata directory not provided
I20260808 14:54:56.282311 16803 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:54:56.282653 16803 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:54:56.285631 16803 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200577490656-27451-0/minicluster-data/master-0/data/instance:
uuid: "f26cbe4cd56d48c689f101862425fbee"
format_stamp: "Formatted at 2026-08-08 14:54:56 on dist-test-slave-6k22"
server_key: "6f0d887e745c396bd5a32abe40ecd884"
server_key_iv: "79cc68ecc302885d44f0e338419b6505"
server_key_version: "encryptionkey@0"
I20260808 14:54:56.286412 16803 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200577490656-27451-0/minicluster-data/master-0/wal/instance:
uuid: "f26cbe4cd56d48c689f101862425fbee"
format_stamp: "Formatted at 2026-08-08 14:54:56 on dist-test-slave-6k22"
server_key: "6f0d887e745c396bd5a32abe40ecd884"
server_key_iv: "79cc68ecc302885d44f0e338419b6505"
server_key_version: "encryptionkey@0"
I20260808 14:54:56.291428 16803 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.002s
I20260808 14:54:56.295323 16818 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:54:56.296666 16803 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 14:54:56.296851 16803 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200577490656-27451-0/minicluster-data/master-0/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200577490656-27451-0/minicluster-data/master-0/wal
uuid: "f26cbe4cd56d48c689f101862425fbee"
format_stamp: "Formatted at 2026-08-08 14:54:56 on dist-test-slave-6k22"
server_key: "6f0d887e745c396bd5a32abe40ecd884"
server_key_iv: "79cc68ecc302885d44f0e338419b6505"
server_key_version: "encryptionkey@0"
I20260808 14:54:56.297051 16803 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200577490656-27451-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200577490656-27451-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200577490656-27451-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:54:56.337213 16803 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:54:56.341502 16803 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:54:56.341799 16803 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:54:56.360936 16803 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.254:46021
I20260808 14:54:56.360960 16874 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.254:46021 every 8 connection(s)
I20260808 14:54:56.362344 16803 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
I20260808 14:54:56.366051 16875 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:54:56.368479 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 16803
I20260808 14:54:56.368678 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200577490656-27451-0/minicluster-data/master-0/wal/instance
I20260808 14:54:56.369236 27451 external_mini_cluster.cc:1428] Setting key 4527a2545e761341ff8900946ac6f2ae
I20260808 14:54:56.377609 16875 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f26cbe4cd56d48c689f101862425fbee: Bootstrap starting.
I20260808 14:54:56.380746 16875 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f26cbe4cd56d48c689f101862425fbee: Neither blocks nor log segments found. Creating new log.
I20260808 14:54:56.381764 16875 log.cc:824] T 00000000000000000000000000000000 P f26cbe4cd56d48c689f101862425fbee: Log is configured to *not* fsync() on all Append() calls
Aug 08 14:54:56 dist-test-slave-6k22 krb5kdc[16787](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200895, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.206.254@KRBTEST.COM
I20260808 14:54:56.384716 16875 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f26cbe4cd56d48c689f101862425fbee: No bootstrap required, opened a new log
I20260808 14:54:56.393826 16879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:56.371500 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40518 (local address 127.26.206.254:46021)
0808 14:54:56.372377 (+ 877us) server_negotiation.cc:206] Beginning negotiation
0808 14:54:56.372389 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 14:54:56.372428 (+ 39us) server_negotiation.cc:407] Connection header received
0808 14:54:56.374193 (+ 1765us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:54:56.374215 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:54:56.374630 (+ 415us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:54:56.375044 (+ 414us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:54:56.376633 (+ 1589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:56.377989 (+ 1356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:56.379287 (+ 1298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:56.380025 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:56.380224 (+ 199us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:56.384890 (+ 4666us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:54:56.384901 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:54:56.384918 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:54:56.384961 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:54:56.389217 (+ 4256us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:54:56.389883 (+ 666us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:54:56.389891 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:54:56.389899 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:54:56.390097 (+ 198us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:54:56.390474 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:54:56.390479 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:54:56.390482 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:54:56.391237 (+ 755us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:54:56.391524 (+ 287us) server_negotiation.cc:1035] Waiting for connection context
0808 14:54:56.391949 (+ 425us) server_negotiation.cc:299] Negotiation successful
0808 14:54:56.392391 (+ 442us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":672,"thread_start_us":366,"threads_started":1}
I20260808 14:54:56.395998 16875 raft_consensus.cc:348] T 00000000000000000000000000000000 P f26cbe4cd56d48c689f101862425fbee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f26cbe4cd56d48c689f101862425fbee" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 46021 } }
I20260808 14:54:56.396400 16875 raft_consensus.cc:374] T 00000000000000000000000000000000 P f26cbe4cd56d48c689f101862425fbee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:54:56.396508 16875 raft_consensus.cc:729] T 00000000000000000000000000000000 P f26cbe4cd56d48c689f101862425fbee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f26cbe4cd56d48c689f101862425fbee, State: Initialized, Role: FOLLOWER
I20260808 14:54:56.397130 16875 consensus_queue.cc:260] T 00000000000000000000000000000000 P f26cbe4cd56d48c689f101862425fbee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f26cbe4cd56d48c689f101862425fbee" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 46021 } }
I20260808 14:54:56.397388 16875 raft_consensus.cc:388] T 00000000000000000000000000000000 P f26cbe4cd56d48c689f101862425fbee [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:54:56.397517 16875 raft_consensus.cc:482] T 00000000000000000000000000000000 P f26cbe4cd56d48c689f101862425fbee [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:54:56.397691 16875 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f26cbe4cd56d48c689f101862425fbee [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:54:56.400012 16875 raft_consensus.cc:504] T 00000000000000000000000000000000 P f26cbe4cd56d48c689f101862425fbee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f26cbe4cd56d48c689f101862425fbee" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 46021 } }
I20260808 14:54:56.400516 16875 leader_election.cc:302] T 00000000000000000000000000000000 P f26cbe4cd56d48c689f101862425fbee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f26cbe4cd56d48c689f101862425fbee; no voters:
I20260808 14:54:56.401149 16875 leader_election.cc:288] T 00000000000000000000000000000000 P f26cbe4cd56d48c689f101862425fbee [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:54:56.401314 16881 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f26cbe4cd56d48c689f101862425fbee [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:54:56.403213 16875 sys_catalog.cc:564] T 00000000000000000000000000000000 P f26cbe4cd56d48c689f101862425fbee [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:54:56.407998 16881 raft_consensus.cc:686] T 00000000000000000000000000000000 P f26cbe4cd56d48c689f101862425fbee [term 1 LEADER]: Becoming Leader. State: Replica: f26cbe4cd56d48c689f101862425fbee, State: Running, Role: LEADER
I20260808 14:54:56.408720 16881 consensus_queue.cc:237] T 00000000000000000000000000000000 P f26cbe4cd56d48c689f101862425fbee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f26cbe4cd56d48c689f101862425fbee" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 46021 } }
I20260808 14:54:56.412057 16882 sys_catalog.cc:455] T 00000000000000000000000000000000 P f26cbe4cd56d48c689f101862425fbee [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f26cbe4cd56d48c689f101862425fbee" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f26cbe4cd56d48c689f101862425fbee" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 46021 } } }
I20260808 14:54:56.412169 16883 sys_catalog.cc:455] T 00000000000000000000000000000000 P f26cbe4cd56d48c689f101862425fbee [sys.catalog]: SysCatalogTable state changed. Reason: New leader f26cbe4cd56d48c689f101862425fbee. Latest consensus state: current_term: 1 leader_uuid: "f26cbe4cd56d48c689f101862425fbee" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f26cbe4cd56d48c689f101862425fbee" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 46021 } } }
I20260808 14:54:56.412509 16882 sys_catalog.cc:458] T 00000000000000000000000000000000 P f26cbe4cd56d48c689f101862425fbee [sys.catalog]: This master's current role is: LEADER
I20260808 14:54:56.412586 16883 sys_catalog.cc:458] T 00000000000000000000000000000000 P f26cbe4cd56d48c689f101862425fbee [sys.catalog]: This master's current role is: LEADER
W20260808 14:54:56.417196 16895 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f26cbe4cd56d48c689f101862425fbee: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 14:54:56.417338 16895 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 14:54:56.417493 16896 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:54:56.418959 16896 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:54:56.426474 16896 catalog_manager.cc:1347] Generated new cluster ID: 19bcfefb75744f648ea1bb2da31b34fe
I20260808 14:54:56.426582 16896 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:54:56.451300 16896 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:54:56.452631 16896 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:54:56.464674 16896 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f26cbe4cd56d48c689f101862425fbee: Generated new TSK 0
I20260808 14:54:56.465581 16896 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.206.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.206.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.206.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.193.keytab.
Entry for principal kudu/127.26.206.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.193.keytab.
I20260808 14:54:56.558459 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200577490656-27451-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200577490656-27451-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200577490656-27451-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200577490656-27451-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.206.193:0
--local_ip_for_outbound_sockets=127.26.206.193
--webserver_interface=127.26.206.193
--webserver_port=0
--tserver_master_addrs=127.26.206.254:46021
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.193.keytab
--principal=kudu/127.26.206.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.206.212:46545
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:54:56.918216 16905 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:54:56.918504 16905 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:54:56.918691 16905 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:54:56.925510 16905 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:54:56.925627 16905 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:54:56.925837 16905 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.206.193
I20260808 14:54:56.934760 16905 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:46545
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200577490656-27451-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200577490656-27451-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.193.keytab
--principal=kudu/127.26.206.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.206.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200577490656-27451-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.206.193
--webserver_port=0
--tserver_master_addrs=127.26.206.254:46021
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.206.193
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200577490656-27451-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:54:56.936048 16905 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:54:56.937294 16905 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:54:56.950075 16911 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:54:56.950052 16912 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:54:56.950256 16914 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:54:56.950969 16905 server_base.cc:1034] running on GCE node
I20260808 14:54:56.951535 16905 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:54:56.952481 16905 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:54:56.953698 16905 hybrid_clock.cc:648] HybridClock initialized: now 1786200896953659 us; error 51 us; skew 500 ppm
I20260808 14:54:56.954001 16905 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:54:56 dist-test-slave-6k22 krb5kdc[16787](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200896, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:54:56.957041 16905 init.cc:377] Logged in from keytab as kudu/127.26.206.193@KRBTEST.COM (short username kudu)
I20260808 14:54:56.958348 16905 webserver.cc:460] Webserver started at http://127.26.206.193:45063/ using document root <none> and password file <none>
I20260808 14:54:56.959021 16905 fs_manager.cc:359] Metadata directory not provided
I20260808 14:54:56.959169 16905 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:54:56.959481 16905 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:54:56.962337 16905 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200577490656-27451-0/minicluster-data/ts-0/data/instance:
uuid: "c5d124533a414d7d9e3e0494fdf78b01"
format_stamp: "Formatted at 2026-08-08 14:54:56 on dist-test-slave-6k22"
server_key: "06c42213abb3e74ffb189bb25ebe9c51"
server_key_iv: "e2243f1ba12e8d2a8856b8d5f074dcd8"
server_key_version: "encryptionkey@0"
I20260808 14:54:56.963104 16905 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200577490656-27451-0/minicluster-data/ts-0/wal/instance:
uuid: "c5d124533a414d7d9e3e0494fdf78b01"
format_stamp: "Formatted at 2026-08-08 14:54:56 on dist-test-slave-6k22"
server_key: "06c42213abb3e74ffb189bb25ebe9c51"
server_key_iv: "e2243f1ba12e8d2a8856b8d5f074dcd8"
server_key_version: "encryptionkey@0"
I20260808 14:54:56.968403 16905 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260808 14:54:56.971858 16921 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:54:56.973064 16905 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260808 14:54:56.973223 16905 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200577490656-27451-0/minicluster-data/ts-0/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200577490656-27451-0/minicluster-data/ts-0/wal
uuid: "c5d124533a414d7d9e3e0494fdf78b01"
format_stamp: "Formatted at 2026-08-08 14:54:56 on dist-test-slave-6k22"
server_key: "06c42213abb3e74ffb189bb25ebe9c51"
server_key_iv: "e2243f1ba12e8d2a8856b8d5f074dcd8"
server_key_version: "encryptionkey@0"
I20260808 14:54:56.973426 16905 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200577490656-27451-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200577490656-27451-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200577490656-27451-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:54:56.986334 16905 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:54:56.990108 16905 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:54:56.990403 16905 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:54:56.991292 16905 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:54:56.992600 16905 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:54:56.992717 16905 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:54:56.992867 16905 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:54:56.992950 16905 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:54:57.028127 16905 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.193:42005
I20260808 14:54:57.028164 17039 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.193:42005 every 8 connection(s)
I20260808 14:54:57.029563 16905 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200577490656-27451-0/minicluster-data/ts-0/data/info.pb
I20260808 14:54:57.033278 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 16905
I20260808 14:54:57.033509 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200577490656-27451-0/minicluster-data/ts-0/wal/instance
I20260808 14:54:57.034071 27451 external_mini_cluster.cc:1428] Setting key 2cee08398199cd65d132b1987494b67b
Aug 08 14:54:57 dist-test-slave-6k22 krb5kdc[16787](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200896, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.193@KRBTEST.COM for kudu/127.26.206.254@KRBTEST.COM
I20260808 14:54:57.049348 17042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:57.032087 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.193:39415 (local address 127.26.206.254:46021)
0808 14:54:57.032568 (+ 481us) server_negotiation.cc:206] Beginning negotiation
0808 14:54:57.032572 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:54:57.033518 (+ 946us) server_negotiation.cc:407] Connection header received
0808 14:54:57.035524 (+ 2006us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:54:57.035529 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:54:57.035654 (+ 125us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:54:57.035778 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:54:57.037392 (+ 1614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:57.038099 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:57.039688 (+ 1589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:57.040092 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:57.040224 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:57.043669 (+ 3445us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:54:57.043673 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:54:57.043676 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:54:57.043706 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:54:57.046256 (+ 2550us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:54:57.047007 (+ 751us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:54:57.047014 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:54:57.047018 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:54:57.047150 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:54:57.047619 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:54:57.047625 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:54:57.047629 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:54:57.047895 (+ 266us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:54:57.048056 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0808 14:54:57.048718 (+ 662us) server_negotiation.cc:299] Negotiation successful
0808 14:54:57.048963 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":383,"thread_start_us":273,"threads_started":1}
I20260808 14:54:57.050397 17043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:57.032541 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:46021 (local address 127.26.206.193:39415)
0808 14:54:57.033267 (+ 726us) negotiation.cc:107] Waiting for socket to connect
0808 14:54:57.033305 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 14:54:57.035235 (+ 1930us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:54:57.036058 (+ 823us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:54:57.036068 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:54:57.036670 (+ 602us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:54:57.037222 (+ 552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:54:57.037239 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:54:57.038273 (+ 1034us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:54:57.038277 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:54:57.039487 (+ 1210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:54:57.039499 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:54:57.040326 (+ 827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:54:57.040336 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:54:57.040585 (+ 249us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:57.041289 (+ 704us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:54:57.041311 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:54:57.043429 (+ 2118us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:54:57.046422 (+ 2993us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:54:57.046431 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:54:57.046445 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:54:57.046886 (+ 441us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:54:57.047280 (+ 394us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:54:57.047286 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:54:57.047293 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:54:57.047486 (+ 193us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:54:57.048029 (+ 543us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:54:57.048036 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:54:57.048367 (+ 331us) client_negotiation.cc:769] Sending connection context
0808 14:54:57.048627 (+ 260us) client_negotiation.cc:240] Negotiation successful
0808 14:54:57.049152 (+ 525us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":514,"thread_start_us":331,"threads_started":1}
I20260808 14:54:57.052034 17040 heartbeater.cc:347] Connected to a master server at 127.26.206.254:46021
I20260808 14:54:57.052359 17040 heartbeater.cc:464] Registering TS with master...
I20260808 14:54:57.053272 17040 heartbeater.cc:511] Master 127.26.206.254:46021 requested a full tablet report, sending...
I20260808 14:54:57.055497 16837 ts_manager.cc:194] Registered new tserver with Master: c5d124533a414d7d9e3e0494fdf78b01 (127.26.206.193:42005)
I20260808 14:54:57.056972 16837 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.206.193@KRBTEST.COM'} at 127.26.206.193:39415
WARNING: no policy specified for kudu/127.26.206.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.206.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.206.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.194.keytab.
Entry for principal kudu/127.26.206.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.194.keytab.
I20260808 14:54:57.102658 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200577490656-27451-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200577490656-27451-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200577490656-27451-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200577490656-27451-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.206.194:0
--local_ip_for_outbound_sockets=127.26.206.194
--webserver_interface=127.26.206.194
--webserver_port=0
--tserver_master_addrs=127.26.206.254:46021
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.194.keytab
--principal=kudu/127.26.206.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.206.212:46545
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:54:57.445709 17046 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:54:57.445978 17046 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:54:57.446144 17046 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:54:57.453243 17046 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:54:57.453379 17046 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:54:57.453552 17046 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.206.194
I20260808 14:54:57.463063 17046 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:46545
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200577490656-27451-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200577490656-27451-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.194.keytab
--principal=kudu/127.26.206.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.206.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200577490656-27451-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.206.194
--webserver_port=0
--tserver_master_addrs=127.26.206.254:46021
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.206.194
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200577490656-27451-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:54:57.464340 17046 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:54:57.465795 17046 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:54:57.479534 17053 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:54:57.479602 17055 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:54:57.479712 17057 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:54:57.480374 17046 server_base.cc:1034] running on GCE node
I20260808 14:54:57.480950 17046 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:54:57.481856 17046 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:54:57.483079 17046 hybrid_clock.cc:648] HybridClock initialized: now 1786200897483023 us; error 67 us; skew 500 ppm
I20260808 14:54:57.483399 17046 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:54:57 dist-test-slave-6k22 krb5kdc[16787](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200897, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:54:57.486560 17046 init.cc:377] Logged in from keytab as kudu/127.26.206.194@KRBTEST.COM (short username kudu)
I20260808 14:54:57.488132 17046 webserver.cc:460] Webserver started at http://127.26.206.194:46535/ using document root <none> and password file <none>
I20260808 14:54:57.488791 17046 fs_manager.cc:359] Metadata directory not provided
I20260808 14:54:57.488934 17046 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:54:57.489243 17046 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:54:57.492262 17046 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200577490656-27451-0/minicluster-data/ts-1/data/instance:
uuid: "174fc2250fce454d95aac0381e412422"
format_stamp: "Formatted at 2026-08-08 14:54:57 on dist-test-slave-6k22"
server_key: "e5e9043dbbb6edcc2046bbe6ea724afb"
server_key_iv: "a70b683c65dfcbd508f0c3f8d82a6245"
server_key_version: "encryptionkey@0"
I20260808 14:54:57.493008 17046 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200577490656-27451-0/minicluster-data/ts-1/wal/instance:
uuid: "174fc2250fce454d95aac0381e412422"
format_stamp: "Formatted at 2026-08-08 14:54:57 on dist-test-slave-6k22"
server_key: "e5e9043dbbb6edcc2046bbe6ea724afb"
server_key_iv: "a70b683c65dfcbd508f0c3f8d82a6245"
server_key_version: "encryptionkey@0"
I20260808 14:54:57.497959 17046 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260808 14:54:57.501451 17064 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:54:57.502712 17046 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 14:54:57.502884 17046 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200577490656-27451-0/minicluster-data/ts-1/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200577490656-27451-0/minicluster-data/ts-1/wal
uuid: "174fc2250fce454d95aac0381e412422"
format_stamp: "Formatted at 2026-08-08 14:54:57 on dist-test-slave-6k22"
server_key: "e5e9043dbbb6edcc2046bbe6ea724afb"
server_key_iv: "a70b683c65dfcbd508f0c3f8d82a6245"
server_key_version: "encryptionkey@0"
I20260808 14:54:57.503067 17046 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200577490656-27451-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200577490656-27451-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200577490656-27451-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:54:57.535045 17046 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:54:57.539482 17046 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:54:57.539815 17046 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:54:57.540759 17046 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:54:57.542054 17046 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:54:57.542156 17046 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:54:57.542317 17046 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:54:57.542390 17046 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:54:57.576304 17046 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.194:44975
I20260808 14:54:57.576411 17186 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.194:44975 every 8 connection(s)
I20260808 14:54:57.577759 17046 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200577490656-27451-0/minicluster-data/ts-1/data/info.pb
I20260808 14:54:57.583932 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 17046
I20260808 14:54:57.584144 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200577490656-27451-0/minicluster-data/ts-1/wal/instance
I20260808 14:54:57.584652 27451 external_mini_cluster.cc:1428] Setting key cfc32e17919cc7e60a6c91ccc05860d1
Aug 08 14:54:57 dist-test-slave-6k22 krb5kdc[16787](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200897, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.194@KRBTEST.COM for kudu/127.26.206.254@KRBTEST.COM
I20260808 14:54:57.598515 17190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:57.580345 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.194:43503 (local address 127.26.206.254:46021)
0808 14:54:57.580791 (+ 446us) server_negotiation.cc:206] Beginning negotiation
0808 14:54:57.580796 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:54:57.581741 (+ 945us) server_negotiation.cc:407] Connection header received
0808 14:54:57.583585 (+ 1844us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:54:57.583591 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:54:57.583684 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:54:57.583818 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:54:57.585581 (+ 1763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:57.586686 (+ 1105us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:57.588284 (+ 1598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:57.588733 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:57.588878 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:57.592769 (+ 3891us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:54:57.592774 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:54:57.592777 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:54:57.592808 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:54:57.595337 (+ 2529us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:54:57.596264 (+ 927us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:54:57.596267 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:54:57.596269 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:54:57.596387 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:54:57.596853 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:54:57.596856 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:54:57.596858 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:54:57.597116 (+ 258us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:54:57.597223 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0808 14:54:57.598074 (+ 851us) server_negotiation.cc:299] Negotiation successful
0808 14:54:57.598229 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":336,"thread_start_us":224,"threads_started":1}
I20260808 14:54:57.599973 17191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:57.580933 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:46021 (local address 127.26.206.194:43503)
0808 14:54:57.581588 (+ 655us) negotiation.cc:107] Waiting for socket to connect
0808 14:54:57.581625 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0808 14:54:57.583291 (+ 1666us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:54:57.584052 (+ 761us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:54:57.584087 (+ 35us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:54:57.584678 (+ 591us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:54:57.585401 (+ 723us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:54:57.585434 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:54:57.586856 (+ 1422us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:54:57.586868 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:54:57.588138 (+ 1270us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:54:57.588150 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:54:57.588968 (+ 818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:54:57.588976 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:54:57.589208 (+ 232us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:57.589907 (+ 699us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:54:57.589933 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:54:57.592557 (+ 2624us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:54:57.595475 (+ 2918us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:54:57.595487 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:54:57.595505 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:54:57.596154 (+ 649us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:54:57.596497 (+ 343us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:54:57.596504 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:54:57.596510 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:54:57.596741 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:54:57.597235 (+ 494us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:54:57.597245 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:54:57.597674 (+ 429us) client_negotiation.cc:769] Sending connection context
0808 14:54:57.597986 (+ 312us) client_negotiation.cc:240] Negotiation successful
0808 14:54:57.598553 (+ 567us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":441,"thread_start_us":277,"threads_started":1}
I20260808 14:54:57.601403 17187 heartbeater.cc:347] Connected to a master server at 127.26.206.254:46021
I20260808 14:54:57.601717 17187 heartbeater.cc:464] Registering TS with master...
I20260808 14:54:57.602568 17187 heartbeater.cc:511] Master 127.26.206.254:46021 requested a full tablet report, sending...
I20260808 14:54:57.604138 16837 ts_manager.cc:194] Registered new tserver with Master: 174fc2250fce454d95aac0381e412422 (127.26.206.194:44975)
I20260808 14:54:57.605033 16837 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.206.194@KRBTEST.COM'} at 127.26.206.194:43503
WARNING: no policy specified for kudu/127.26.206.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.206.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.206.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.195.keytab.
Entry for principal kudu/127.26.206.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.195.keytab.
I20260808 14:54:57.653231 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200577490656-27451-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200577490656-27451-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200577490656-27451-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200577490656-27451-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.206.195:0
--local_ip_for_outbound_sockets=127.26.206.195
--webserver_interface=127.26.206.195
--webserver_port=0
--tserver_master_addrs=127.26.206.254:46021
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.195.keytab
--principal=kudu/127.26.206.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.206.212:46545
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:54:57.984774 17194 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:54:57.985046 17194 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:54:57.985249 17194 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:54:57.992728 17194 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:54:57.992858 17194 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:54:57.993021 17194 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.206.195
I20260808 14:54:58.003422 17194 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:46545
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200577490656-27451-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200577490656-27451-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.195.keytab
--principal=kudu/127.26.206.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.206.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200577490656-27451-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.206.195
--webserver_port=0
--tserver_master_addrs=127.26.206.254:46021
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.206.195
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200577490656-27451-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:54:58.004815 17194 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:54:58.006129 17194 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:54:58.019205 17200 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:54:58.019349 17202 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:54:58.019379 17199 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:54:58.020046 17194 server_base.cc:1034] running on GCE node
I20260808 14:54:58.020682 17194 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:54:58.021610 17194 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:54:58.022797 17194 hybrid_clock.cc:648] HybridClock initialized: now 1786200898022745 us; error 58 us; skew 500 ppm
I20260808 14:54:58.023099 17194 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:54:58 dist-test-slave-6k22 krb5kdc[16787](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200898, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:54:58.026224 17194 init.cc:377] Logged in from keytab as kudu/127.26.206.195@KRBTEST.COM (short username kudu)
I20260808 14:54:58.027697 17194 webserver.cc:460] Webserver started at http://127.26.206.195:39201/ using document root <none> and password file <none>
I20260808 14:54:58.028354 17194 fs_manager.cc:359] Metadata directory not provided
I20260808 14:54:58.028483 17194 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:54:58.028812 17194 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:54:58.031752 17194 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200577490656-27451-0/minicluster-data/ts-2/data/instance:
uuid: "0901175b2d864ec3bc1f43a755ca085d"
format_stamp: "Formatted at 2026-08-08 14:54:58 on dist-test-slave-6k22"
server_key: "e760e279bd3b50a3bbc69d11dd69ded4"
server_key_iv: "b3e3bd7fead662097d92dc352e11a921"
server_key_version: "encryptionkey@0"
I20260808 14:54:58.032516 17194 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200577490656-27451-0/minicluster-data/ts-2/wal/instance:
uuid: "0901175b2d864ec3bc1f43a755ca085d"
format_stamp: "Formatted at 2026-08-08 14:54:58 on dist-test-slave-6k22"
server_key: "e760e279bd3b50a3bbc69d11dd69ded4"
server_key_iv: "b3e3bd7fead662097d92dc352e11a921"
server_key_version: "encryptionkey@0"
I20260808 14:54:58.037489 17194 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260808 14:54:58.041018 17211 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:54:58.042276 17194 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 14:54:58.042438 17194 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200577490656-27451-0/minicluster-data/ts-2/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200577490656-27451-0/minicluster-data/ts-2/wal
uuid: "0901175b2d864ec3bc1f43a755ca085d"
format_stamp: "Formatted at 2026-08-08 14:54:58 on dist-test-slave-6k22"
server_key: "e760e279bd3b50a3bbc69d11dd69ded4"
server_key_iv: "b3e3bd7fead662097d92dc352e11a921"
server_key_version: "encryptionkey@0"
I20260808 14:54:58.042622 17194 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200577490656-27451-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200577490656-27451-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200577490656-27451-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:54:58.058820 17194 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:54:58.060501 17040 heartbeater.cc:503] Master 127.26.206.254:46021 was elected leader, sending a full tablet report...
I20260808 14:54:58.063234 17194 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:54:58.063541 17194 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:54:58.064535 17194 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:54:58.065864 17194 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:54:58.065969 17194 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:54:58.066126 17194 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:54:58.066201 17194 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:54:58.099964 17194 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.195:42717
I20260808 14:54:58.100052 17328 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.195:42717 every 8 connection(s)
I20260808 14:54:58.101365 17194 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200577490656-27451-0/minicluster-data/ts-2/data/info.pb
I20260808 14:54:58.104442 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 17194
I20260808 14:54:58.104664 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200577490656-27451-0/minicluster-data/ts-2/wal/instance
I20260808 14:54:58.105288 27451 external_mini_cluster.cc:1428] Setting key cd4ac85397117a8991ecb73bf743f4fe
Aug 08 14:54:58 dist-test-slave-6k22 krb5kdc[16787](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200898, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.195@KRBTEST.COM for kudu/127.26.206.254@KRBTEST.COM
I20260808 14:54:58.121881 17331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:58.103990 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.195:50381 (local address 127.26.206.254:46021)
0808 14:54:58.104605 (+ 615us) server_negotiation.cc:206] Beginning negotiation
0808 14:54:58.104611 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:54:58.105671 (+ 1060us) server_negotiation.cc:407] Connection header received
0808 14:54:58.107913 (+ 2242us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:54:58.107917 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:54:58.107999 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:54:58.108121 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:54:58.109731 (+ 1610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:58.110607 (+ 876us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:58.112142 (+ 1535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:58.112515 (+ 373us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:58.112609 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:58.115935 (+ 3326us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:54:58.115939 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:54:58.115943 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:54:58.115975 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:54:58.118436 (+ 2461us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:54:58.119248 (+ 812us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:54:58.119256 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:54:58.119260 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:54:58.119406 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:54:58.119932 (+ 526us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:54:58.119937 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:54:58.119941 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:54:58.120326 (+ 385us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:54:58.120490 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0808 14:54:58.121243 (+ 753us) server_negotiation.cc:299] Negotiation successful
0808 14:54:58.121475 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":484,"thread_start_us":291,"threads_started":1}
I20260808 14:54:58.122848 17333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:58.104599 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:46021 (local address 127.26.206.195:50381)
0808 14:54:58.105492 (+ 893us) negotiation.cc:107] Waiting for socket to connect
0808 14:54:58.105547 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0808 14:54:58.107610 (+ 2063us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:54:58.108335 (+ 725us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:54:58.108344 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:54:58.108940 (+ 596us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:54:58.109564 (+ 624us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:54:58.109582 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:54:58.110736 (+ 1154us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:54:58.110739 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:54:58.112026 (+ 1287us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:54:58.112038 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:54:58.112700 (+ 662us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:54:58.112704 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:54:58.112892 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:58.113521 (+ 629us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:54:58.113541 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:54:58.115719 (+ 2178us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:54:58.118558 (+ 2839us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:54:58.118564 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:54:58.118576 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:54:58.119126 (+ 550us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:54:58.119559 (+ 433us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:54:58.119563 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:54:58.119597 (+ 34us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:54:58.119805 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:54:58.120452 (+ 647us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:54:58.120460 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:54:58.120829 (+ 369us) client_negotiation.cc:769] Sending connection context
0808 14:54:58.121148 (+ 319us) client_negotiation.cc:240] Negotiation successful
0808 14:54:58.121651 (+ 503us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":586,"thread_start_us":355,"threads_started":1}
I20260808 14:54:58.124222 17329 heartbeater.cc:347] Connected to a master server at 127.26.206.254:46021
I20260808 14:54:58.124511 17329 heartbeater.cc:464] Registering TS with master...
I20260808 14:54:58.125252 17329 heartbeater.cc:511] Master 127.26.206.254:46021 requested a full tablet report, sending...
I20260808 14:54:58.126664 16837 ts_manager.cc:194] Registered new tserver with Master: 0901175b2d864ec3bc1f43a755ca085d (127.26.206.195:42717)
I20260808 14:54:58.127468 16837 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.206.195@KRBTEST.COM'} at 127.26.206.195:50381
I20260808 14:54:58.132975 27451 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 14:54:58.149108 17331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:58.137045 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40526 (local address 127.26.206.254:46021)
0808 14:54:58.137190 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0808 14:54:58.137194 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:54:58.137634 (+ 440us) server_negotiation.cc:407] Connection header received
0808 14:54:58.137750 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:54:58.137753 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:54:58.137822 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:54:58.137899 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:54:58.139267 (+ 1368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:58.140026 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:58.141329 (+ 1303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:58.141694 (+ 365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:58.141780 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:58.144098 (+ 2318us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:54:58.144103 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:54:58.144106 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:54:58.144132 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:54:58.146657 (+ 2525us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:54:58.147321 (+ 664us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:54:58.147325 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:54:58.147327 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:54:58.147485 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:54:58.147854 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:54:58.147857 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:54:58.147859 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:54:58.148144 (+ 285us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:54:58.148356 (+ 212us) server_negotiation.cc:1035] Waiting for connection context
0808 14:54:58.148616 (+ 260us) server_negotiation.cc:299] Negotiation successful
0808 14:54:58.148774 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260808 14:54:58.152540 16837 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40526:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:54:58.159168 16837 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:54:58.181710 17346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:58.170752 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.193:42005 (local address 127.0.0.1:44848)
0808 14:54:58.172847 (+ 2095us) negotiation.cc:107] Waiting for socket to connect
0808 14:54:58.172902 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0808 14:54:58.173084 (+ 182us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:54:58.174051 (+ 967us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:54:58.174059 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:54:58.174087 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:54:58.174454 (+ 367us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:54:58.174465 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:54:58.176301 (+ 1836us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:54:58.176306 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:54:58.178763 (+ 2457us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:54:58.178779 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:54:58.180831 (+ 2052us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:54:58.180837 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:54:58.181031 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:58.181077 (+ 46us) client_negotiation.cc:769] Sending connection context
0808 14:54:58.181195 (+ 118us) client_negotiation.cc:240] Negotiation successful
0808 14:54:58.181375 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1848,"threads_started":1}
I20260808 14:54:58.182569 17343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:58.170736 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44848 (local address 127.26.206.193:42005)
0808 14:54:58.171699 (+ 963us) server_negotiation.cc:206] Beginning negotiation
0808 14:54:58.171711 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 14:54:58.173026 (+ 1315us) server_negotiation.cc:407] Connection header received
0808 14:54:58.173372 (+ 346us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:54:58.173381 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:54:58.173615 (+ 234us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:54:58.173789 (+ 174us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:54:58.174618 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:58.176135 (+ 1517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:58.178941 (+ 2806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:58.180340 (+ 1399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:58.180511 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:58.180699 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0808 14:54:58.182072 (+ 1373us) server_negotiation.cc:299] Negotiation successful
0808 14:54:58.182229 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":701,"thread_start_us":908,"threads_started":1}
I20260808 14:54:58.191267 17346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:58.171204 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.194:44975 (local address 127.0.0.1:36662)
0808 14:54:58.182943 (+ 11739us) negotiation.cc:107] Waiting for socket to connect
0808 14:54:58.182963 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 14:54:58.183064 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:54:58.184021 (+ 957us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:54:58.184026 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:54:58.184049 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:54:58.184228 (+ 179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:54:58.184240 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:54:58.186229 (+ 1989us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:54:58.186233 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:54:58.188410 (+ 2177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:54:58.188424 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:54:58.190512 (+ 2088us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:54:58.190518 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:54:58.190705 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:58.190738 (+ 33us) client_negotiation.cc:769] Sending connection context
0808 14:54:58.190833 (+ 95us) client_negotiation.cc:240] Negotiation successful
0808 14:54:58.190963 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11622,"thread_start_us":1236,"threads_started":1}
I20260808 14:54:58.192191 17347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:58.171484 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36662 (local address 127.26.206.194:44975)
0808 14:54:58.172012 (+ 528us) server_negotiation.cc:206] Beginning negotiation
0808 14:54:58.172020 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:54:58.183190 (+ 11170us) server_negotiation.cc:407] Connection header received
0808 14:54:58.183315 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:54:58.183323 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:54:58.183579 (+ 256us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:54:58.183775 (+ 196us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:54:58.184564 (+ 789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:58.186055 (+ 1491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:58.188616 (+ 2561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:58.190074 (+ 1458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:58.190233 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:58.190411 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0808 14:54:58.191711 (+ 1300us) server_negotiation.cc:299] Negotiation successful
0808 14:54:58.191873 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":392,"thread_start_us":350,"threads_started":1}
I20260808 14:54:58.198956 17349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:58.183649 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57656 (local address 127.26.206.195:42717)
0808 14:54:58.192919 (+ 9270us) server_negotiation.cc:206] Beginning negotiation
0808 14:54:58.192927 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:54:58.192958 (+ 31us) server_negotiation.cc:407] Connection header received
0808 14:54:58.193034 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:54:58.193039 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:54:58.193195 (+ 156us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:54:58.193408 (+ 213us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:54:58.193965 (+ 557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:58.194946 (+ 981us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:58.196895 (+ 1949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:58.198006 (+ 1111us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:58.198157 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:58.198263 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0808 14:54:58.198614 (+ 351us) server_negotiation.cc:299] Negotiation successful
0808 14:54:58.198724 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9085,"thread_start_us":8930,"threads_started":1}
I20260808 14:54:58.199005 17348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:58.173290 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.195:42717 (local address 127.0.0.1:57656)
0808 14:54:58.184084 (+ 10794us) negotiation.cc:107] Waiting for socket to connect
0808 14:54:58.184104 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 14:54:58.184204 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:54:58.193387 (+ 9183us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:54:58.193392 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:54:58.193420 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:54:58.193769 (+ 349us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:54:58.193778 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:54:58.195081 (+ 1303us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:54:58.195087 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:54:58.196656 (+ 1569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:54:58.196697 (+ 41us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:54:58.198206 (+ 1509us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:54:58.198213 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:54:58.198433 (+ 220us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:58.198468 (+ 35us) client_negotiation.cc:769] Sending connection context
0808 14:54:58.198568 (+ 100us) client_negotiation.cc:240] Negotiation successful
0808 14:54:58.198689 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10678,"thread_start_us":14139,"threads_started":1}
I20260808 14:54:58.196774 17115 tablet_service.cc:1467] Processing CreateTablet for tablet 16a3b3f4b6c04bf5a76a42509c52ffda (DEFAULT_TABLE table=test-table [id=5167cb7cf8324ea2a2f4fcb9dfc898e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:54:58.200399 17115 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 16a3b3f4b6c04bf5a76a42509c52ffda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:54:58.200186 16971 tablet_service.cc:1467] Processing CreateTablet for tablet 16a3b3f4b6c04bf5a76a42509c52ffda (DEFAULT_TABLE table=test-table [id=5167cb7cf8324ea2a2f4fcb9dfc898e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:54:58.201555 16971 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 16a3b3f4b6c04bf5a76a42509c52ffda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:54:58.202425 17261 tablet_service.cc:1467] Processing CreateTablet for tablet 16a3b3f4b6c04bf5a76a42509c52ffda (DEFAULT_TABLE table=test-table [id=5167cb7cf8324ea2a2f4fcb9dfc898e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:54:58.203879 17261 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 16a3b3f4b6c04bf5a76a42509c52ffda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:54:58.214972 17351 tablet_bootstrap.cc:492] T 16a3b3f4b6c04bf5a76a42509c52ffda P 0901175b2d864ec3bc1f43a755ca085d: Bootstrap starting.
I20260808 14:54:58.216959 17352 tablet_bootstrap.cc:492] T 16a3b3f4b6c04bf5a76a42509c52ffda P 174fc2250fce454d95aac0381e412422: Bootstrap starting.
I20260808 14:54:58.219420 17351 tablet_bootstrap.cc:654] T 16a3b3f4b6c04bf5a76a42509c52ffda P 0901175b2d864ec3bc1f43a755ca085d: Neither blocks nor log segments found. Creating new log.
I20260808 14:54:58.220409 17352 tablet_bootstrap.cc:654] T 16a3b3f4b6c04bf5a76a42509c52ffda P 174fc2250fce454d95aac0381e412422: Neither blocks nor log segments found. Creating new log.
I20260808 14:54:58.220798 17351 log.cc:824] T 16a3b3f4b6c04bf5a76a42509c52ffda P 0901175b2d864ec3bc1f43a755ca085d: Log is configured to *not* fsync() on all Append() calls
I20260808 14:54:58.221732 17352 log.cc:824] T 16a3b3f4b6c04bf5a76a42509c52ffda P 174fc2250fce454d95aac0381e412422: Log is configured to *not* fsync() on all Append() calls
I20260808 14:54:58.222224 17353 tablet_bootstrap.cc:492] T 16a3b3f4b6c04bf5a76a42509c52ffda P c5d124533a414d7d9e3e0494fdf78b01: Bootstrap starting.
I20260808 14:54:58.224920 17351 tablet_bootstrap.cc:492] T 16a3b3f4b6c04bf5a76a42509c52ffda P 0901175b2d864ec3bc1f43a755ca085d: No bootstrap required, opened a new log
I20260808 14:54:58.225198 17351 ts_tablet_manager.cc:1397] T 16a3b3f4b6c04bf5a76a42509c52ffda P 0901175b2d864ec3bc1f43a755ca085d: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.006s
I20260808 14:54:58.226082 17353 tablet_bootstrap.cc:654] T 16a3b3f4b6c04bf5a76a42509c52ffda P c5d124533a414d7d9e3e0494fdf78b01: Neither blocks nor log segments found. Creating new log.
I20260808 14:54:58.227278 17353 log.cc:824] T 16a3b3f4b6c04bf5a76a42509c52ffda P c5d124533a414d7d9e3e0494fdf78b01: Log is configured to *not* fsync() on all Append() calls
I20260808 14:54:58.227710 17352 tablet_bootstrap.cc:492] T 16a3b3f4b6c04bf5a76a42509c52ffda P 174fc2250fce454d95aac0381e412422: No bootstrap required, opened a new log
I20260808 14:54:58.228009 17352 ts_tablet_manager.cc:1397] T 16a3b3f4b6c04bf5a76a42509c52ffda P 174fc2250fce454d95aac0381e412422: Time spent bootstrapping tablet: real 0.011s user 0.010s sys 0.000s
I20260808 14:54:58.230125 17353 tablet_bootstrap.cc:492] T 16a3b3f4b6c04bf5a76a42509c52ffda P c5d124533a414d7d9e3e0494fdf78b01: No bootstrap required, opened a new log
I20260808 14:54:58.230396 17353 ts_tablet_manager.cc:1397] T 16a3b3f4b6c04bf5a76a42509c52ffda P c5d124533a414d7d9e3e0494fdf78b01: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260808 14:54:58.233269 17351 raft_consensus.cc:348] T 16a3b3f4b6c04bf5a76a42509c52ffda P 0901175b2d864ec3bc1f43a755ca085d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d124533a414d7d9e3e0494fdf78b01" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 42005 } } peers { permanent_uuid: "174fc2250fce454d95aac0381e412422" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 44975 } } peers { permanent_uuid: "0901175b2d864ec3bc1f43a755ca085d" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 42717 } }
I20260808 14:54:58.233621 17351 raft_consensus.cc:374] T 16a3b3f4b6c04bf5a76a42509c52ffda P 0901175b2d864ec3bc1f43a755ca085d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:54:58.233784 17351 raft_consensus.cc:729] T 16a3b3f4b6c04bf5a76a42509c52ffda P 0901175b2d864ec3bc1f43a755ca085d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0901175b2d864ec3bc1f43a755ca085d, State: Initialized, Role: FOLLOWER
I20260808 14:54:58.234442 17351 consensus_queue.cc:260] T 16a3b3f4b6c04bf5a76a42509c52ffda P 0901175b2d864ec3bc1f43a755ca085d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d124533a414d7d9e3e0494fdf78b01" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 42005 } } peers { permanent_uuid: "174fc2250fce454d95aac0381e412422" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 44975 } } peers { permanent_uuid: "0901175b2d864ec3bc1f43a755ca085d" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 42717 } }
I20260808 14:54:58.238296 17352 raft_consensus.cc:348] T 16a3b3f4b6c04bf5a76a42509c52ffda P 174fc2250fce454d95aac0381e412422 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d124533a414d7d9e3e0494fdf78b01" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 42005 } } peers { permanent_uuid: "174fc2250fce454d95aac0381e412422" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 44975 } } peers { permanent_uuid: "0901175b2d864ec3bc1f43a755ca085d" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 42717 } }
I20260808 14:54:58.238729 17352 raft_consensus.cc:374] T 16a3b3f4b6c04bf5a76a42509c52ffda P 174fc2250fce454d95aac0381e412422 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:54:58.238842 17352 raft_consensus.cc:729] T 16a3b3f4b6c04bf5a76a42509c52ffda P 174fc2250fce454d95aac0381e412422 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 174fc2250fce454d95aac0381e412422, State: Initialized, Role: FOLLOWER
I20260808 14:54:58.239508 17329 heartbeater.cc:503] Master 127.26.206.254:46021 was elected leader, sending a full tablet report...
I20260808 14:54:58.239411 17352 consensus_queue.cc:260] T 16a3b3f4b6c04bf5a76a42509c52ffda P 174fc2250fce454d95aac0381e412422 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d124533a414d7d9e3e0494fdf78b01" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 42005 } } peers { permanent_uuid: "174fc2250fce454d95aac0381e412422" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 44975 } } peers { permanent_uuid: "0901175b2d864ec3bc1f43a755ca085d" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 42717 } }
I20260808 14:54:58.240204 17351 ts_tablet_manager.cc:1428] T 16a3b3f4b6c04bf5a76a42509c52ffda P 0901175b2d864ec3bc1f43a755ca085d: Time spent starting tablet: real 0.015s user 0.004s sys 0.011s
I20260808 14:54:58.241086 17353 raft_consensus.cc:348] T 16a3b3f4b6c04bf5a76a42509c52ffda P c5d124533a414d7d9e3e0494fdf78b01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d124533a414d7d9e3e0494fdf78b01" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 42005 } } peers { permanent_uuid: "174fc2250fce454d95aac0381e412422" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 44975 } } peers { permanent_uuid: "0901175b2d864ec3bc1f43a755ca085d" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 42717 } }
I20260808 14:54:58.241441 17187 heartbeater.cc:503] Master 127.26.206.254:46021 was elected leader, sending a full tablet report...
I20260808 14:54:58.241496 17353 raft_consensus.cc:374] T 16a3b3f4b6c04bf5a76a42509c52ffda P c5d124533a414d7d9e3e0494fdf78b01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:54:58.241580 17353 raft_consensus.cc:729] T 16a3b3f4b6c04bf5a76a42509c52ffda P c5d124533a414d7d9e3e0494fdf78b01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5d124533a414d7d9e3e0494fdf78b01, State: Initialized, Role: FOLLOWER
I20260808 14:54:58.242210 17353 consensus_queue.cc:260] T 16a3b3f4b6c04bf5a76a42509c52ffda P c5d124533a414d7d9e3e0494fdf78b01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d124533a414d7d9e3e0494fdf78b01" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 42005 } } peers { permanent_uuid: "174fc2250fce454d95aac0381e412422" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 44975 } } peers { permanent_uuid: "0901175b2d864ec3bc1f43a755ca085d" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 42717 } }
I20260808 14:54:58.243261 17352 ts_tablet_manager.cc:1428] T 16a3b3f4b6c04bf5a76a42509c52ffda P 174fc2250fce454d95aac0381e412422: Time spent starting tablet: real 0.015s user 0.014s sys 0.000s
I20260808 14:54:58.244611 17353 ts_tablet_manager.cc:1428] T 16a3b3f4b6c04bf5a76a42509c52ffda P c5d124533a414d7d9e3e0494fdf78b01: Time spent starting tablet: real 0.014s user 0.006s sys 0.008s
W20260808 14:54:58.282016 17041 tablet.cc:2369] T 16a3b3f4b6c04bf5a76a42509c52ffda P c5d124533a414d7d9e3e0494fdf78b01: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 14:54:58.330022 17189 tablet.cc:2369] T 16a3b3f4b6c04bf5a76a42509c52ffda P 174fc2250fce454d95aac0381e412422: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 14:54:58.353077 17330 tablet.cc:2369] T 16a3b3f4b6c04bf5a76a42509c52ffda P 0901175b2d864ec3bc1f43a755ca085d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:54:58.377736 17359 raft_consensus.cc:482] T 16a3b3f4b6c04bf5a76a42509c52ffda P c5d124533a414d7d9e3e0494fdf78b01 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:54:58.378034 17359 raft_consensus.cc:504] T 16a3b3f4b6c04bf5a76a42509c52ffda P c5d124533a414d7d9e3e0494fdf78b01 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d124533a414d7d9e3e0494fdf78b01" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 42005 } } peers { permanent_uuid: "174fc2250fce454d95aac0381e412422" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 44975 } } peers { permanent_uuid: "0901175b2d864ec3bc1f43a755ca085d" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 42717 } }
I20260808 14:54:58.379827 17359 leader_election.cc:288] T 16a3b3f4b6c04bf5a76a42509c52ffda P c5d124533a414d7d9e3e0494fdf78b01 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 174fc2250fce454d95aac0381e412422 (127.26.206.194:44975), 0901175b2d864ec3bc1f43a755ca085d (127.26.206.195:42717)
I20260808 14:54:58.386305 17347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:58.380360 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.193:55577 (local address 127.26.206.194:44975)
0808 14:54:58.380615 (+ 255us) server_negotiation.cc:206] Beginning negotiation
0808 14:54:58.380621 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:54:58.380855 (+ 234us) server_negotiation.cc:407] Connection header received
0808 14:54:58.381117 (+ 262us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:54:58.381122 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:54:58.381210 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:54:58.381280 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:54:58.382093 (+ 813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:58.382821 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:58.384580 (+ 1759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:58.385330 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:58.385503 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:58.385580 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0808 14:54:58.385910 (+ 330us) server_negotiation.cc:299] Negotiation successful
0808 14:54:58.386033 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260808 14:54:58.386358 17349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:58.381002 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.193:36449 (local address 127.26.206.195:42717)
0808 14:54:58.381205 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0808 14:54:58.381210 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:54:58.381585 (+ 375us) server_negotiation.cc:407] Connection header received
0808 14:54:58.381668 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:54:58.381672 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:54:58.381744 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:54:58.381846 (+ 102us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:54:58.382370 (+ 524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:58.383068 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:58.384704 (+ 1636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:58.385434 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:58.385605 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:58.385679 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 14:54:58.385992 (+ 313us) server_negotiation.cc:299] Negotiation successful
0808 14:54:58.386113 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260808 14:54:58.386418 17360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:58.380053 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.194:44975 (local address 127.26.206.193:55577)
0808 14:54:58.380709 (+ 656us) negotiation.cc:107] Waiting for socket to connect
0808 14:54:58.380725 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 14:54:58.380919 (+ 194us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:54:58.381445 (+ 526us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:54:58.381448 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:54:58.381487 (+ 39us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:54:58.381927 (+ 440us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:54:58.381940 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:54:58.382955 (+ 1015us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:54:58.382961 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:54:58.384414 (+ 1453us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:54:58.384424 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:54:58.385529 (+ 1105us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:54:58.385535 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:54:58.385714 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:58.385737 (+ 23us) client_negotiation.cc:769] Sending connection context
0808 14:54:58.385879 (+ 142us) client_negotiation.cc:240] Negotiation successful
0808 14:54:58.386001 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":515,"mutex_wait_us":1,"thread_start_us":298,"threads_started":1}
I20260808 14:54:58.386512 17361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:58.380765 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.195:42717 (local address 127.26.206.193:36449)
0808 14:54:58.381429 (+ 664us) negotiation.cc:107] Waiting for socket to connect
0808 14:54:58.381443 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 14:54:58.381561 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:54:58.381864 (+ 303us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:54:58.381867 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:54:58.381886 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:54:58.382217 (+ 331us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:54:58.382224 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:54:58.383205 (+ 981us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:54:58.383211 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:54:58.384555 (+ 1344us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:54:58.384564 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:54:58.385651 (+ 1087us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:54:58.385657 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:54:58.385837 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:58.385859 (+ 22us) client_negotiation.cc:769] Sending connection context
0808 14:54:58.385965 (+ 106us) client_negotiation.cc:240] Negotiation successful
0808 14:54:58.386084 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":573,"mutex_wait_us":22,"thread_start_us":330,"threads_started":1}
I20260808 14:54:58.387436 17281 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "16a3b3f4b6c04bf5a76a42509c52ffda" candidate_uuid: "c5d124533a414d7d9e3e0494fdf78b01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0901175b2d864ec3bc1f43a755ca085d" is_pre_election: true
I20260808 14:54:58.387436 17138 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "16a3b3f4b6c04bf5a76a42509c52ffda" candidate_uuid: "c5d124533a414d7d9e3e0494fdf78b01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "174fc2250fce454d95aac0381e412422" is_pre_election: true
I20260808 14:54:58.387939 17281 raft_consensus.cc:2454] T 16a3b3f4b6c04bf5a76a42509c52ffda P 0901175b2d864ec3bc1f43a755ca085d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5d124533a414d7d9e3e0494fdf78b01 in term 0.
I20260808 14:54:58.387964 17138 raft_consensus.cc:2454] T 16a3b3f4b6c04bf5a76a42509c52ffda P 174fc2250fce454d95aac0381e412422 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5d124533a414d7d9e3e0494fdf78b01 in term 0.
I20260808 14:54:58.388573 16924 leader_election.cc:302] T 16a3b3f4b6c04bf5a76a42509c52ffda P c5d124533a414d7d9e3e0494fdf78b01 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0901175b2d864ec3bc1f43a755ca085d, c5d124533a414d7d9e3e0494fdf78b01; no voters:
I20260808 14:54:58.388914 17359 raft_consensus.cc:2781] T 16a3b3f4b6c04bf5a76a42509c52ffda P c5d124533a414d7d9e3e0494fdf78b01 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:54:58.389052 17359 raft_consensus.cc:482] T 16a3b3f4b6c04bf5a76a42509c52ffda P c5d124533a414d7d9e3e0494fdf78b01 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:54:58.389147 17359 raft_consensus.cc:3037] T 16a3b3f4b6c04bf5a76a42509c52ffda P c5d124533a414d7d9e3e0494fdf78b01 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:54:58.391319 17359 raft_consensus.cc:504] T 16a3b3f4b6c04bf5a76a42509c52ffda P c5d124533a414d7d9e3e0494fdf78b01 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d124533a414d7d9e3e0494fdf78b01" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 42005 } } peers { permanent_uuid: "174fc2250fce454d95aac0381e412422" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 44975 } } peers { permanent_uuid: "0901175b2d864ec3bc1f43a755ca085d" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 42717 } }
I20260808 14:54:58.391925 17359 leader_election.cc:288] T 16a3b3f4b6c04bf5a76a42509c52ffda P c5d124533a414d7d9e3e0494fdf78b01 [CANDIDATE]: Term 1 election: Requested vote from peers 174fc2250fce454d95aac0381e412422 (127.26.206.194:44975), 0901175b2d864ec3bc1f43a755ca085d (127.26.206.195:42717)
I20260808 14:54:58.392324 17138 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "16a3b3f4b6c04bf5a76a42509c52ffda" candidate_uuid: "c5d124533a414d7d9e3e0494fdf78b01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "174fc2250fce454d95aac0381e412422"
I20260808 14:54:58.392438 17281 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "16a3b3f4b6c04bf5a76a42509c52ffda" candidate_uuid: "c5d124533a414d7d9e3e0494fdf78b01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0901175b2d864ec3bc1f43a755ca085d"
I20260808 14:54:58.392518 17138 raft_consensus.cc:3037] T 16a3b3f4b6c04bf5a76a42509c52ffda P 174fc2250fce454d95aac0381e412422 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:54:58.392661 17281 raft_consensus.cc:3037] T 16a3b3f4b6c04bf5a76a42509c52ffda P 0901175b2d864ec3bc1f43a755ca085d [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:54:58.394719 17138 raft_consensus.cc:2454] T 16a3b3f4b6c04bf5a76a42509c52ffda P 174fc2250fce454d95aac0381e412422 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5d124533a414d7d9e3e0494fdf78b01 in term 1.
I20260808 14:54:58.394925 17281 raft_consensus.cc:2454] T 16a3b3f4b6c04bf5a76a42509c52ffda P 0901175b2d864ec3bc1f43a755ca085d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5d124533a414d7d9e3e0494fdf78b01 in term 1.
I20260808 14:54:58.395100 16924 leader_election.cc:302] T 16a3b3f4b6c04bf5a76a42509c52ffda P c5d124533a414d7d9e3e0494fdf78b01 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 174fc2250fce454d95aac0381e412422, c5d124533a414d7d9e3e0494fdf78b01; no voters:
I20260808 14:54:58.395368 17359 raft_consensus.cc:2781] T 16a3b3f4b6c04bf5a76a42509c52ffda P c5d124533a414d7d9e3e0494fdf78b01 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:54:58.395885 17359 raft_consensus.cc:686] T 16a3b3f4b6c04bf5a76a42509c52ffda P c5d124533a414d7d9e3e0494fdf78b01 [term 1 LEADER]: Becoming Leader. State: Replica: c5d124533a414d7d9e3e0494fdf78b01, State: Running, Role: LEADER
I20260808 14:54:58.396358 17359 consensus_queue.cc:237] T 16a3b3f4b6c04bf5a76a42509c52ffda P c5d124533a414d7d9e3e0494fdf78b01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d124533a414d7d9e3e0494fdf78b01" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 42005 } } peers { permanent_uuid: "174fc2250fce454d95aac0381e412422" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 44975 } } peers { permanent_uuid: "0901175b2d864ec3bc1f43a755ca085d" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 42717 } }
I20260808 14:54:58.401000 16834 catalog_manager.cc:5495] T 16a3b3f4b6c04bf5a76a42509c52ffda P c5d124533a414d7d9e3e0494fdf78b01 reported cstate change: term changed from 0 to 1, leader changed from <none> to c5d124533a414d7d9e3e0494fdf78b01 (127.26.206.193). New cstate: current_term: 1 leader_uuid: "c5d124533a414d7d9e3e0494fdf78b01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d124533a414d7d9e3e0494fdf78b01" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 42005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "174fc2250fce454d95aac0381e412422" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 44975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0901175b2d864ec3bc1f43a755ca085d" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 42717 } health_report { overall_health: UNKNOWN } } }
I20260808 14:54:58.427172 17343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:58.421886 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47248 (local address 127.26.206.193:42005)
0808 14:54:58.422076 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0808 14:54:58.422082 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:54:58.422147 (+ 65us) server_negotiation.cc:407] Connection header received
0808 14:54:58.422383 (+ 236us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:54:58.422386 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:54:58.422457 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:54:58.422610 (+ 153us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:54:58.422963 (+ 353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:58.423698 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:58.425048 (+ 1350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:58.425446 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:58.425579 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:58.426108 (+ 529us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:54:58.426580 (+ 472us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:54:58.426749 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0808 14:54:58.426819 (+ 70us) server_negotiation.cc:299] Negotiation successful
0808 14:54:58.426897 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260808 14:54:58.435019 17281 raft_consensus.cc:1261] T 16a3b3f4b6c04bf5a76a42509c52ffda P 0901175b2d864ec3bc1f43a755ca085d [term 1 FOLLOWER]: Refusing update from remote peer c5d124533a414d7d9e3e0494fdf78b01: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:54:58.435071 17138 raft_consensus.cc:1261] T 16a3b3f4b6c04bf5a76a42509c52ffda P 174fc2250fce454d95aac0381e412422 [term 1 FOLLOWER]: Refusing update from remote peer c5d124533a414d7d9e3e0494fdf78b01: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:54:58.436018 17362 consensus_queue.cc:1035] T 16a3b3f4b6c04bf5a76a42509c52ffda P c5d124533a414d7d9e3e0494fdf78b01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "174fc2250fce454d95aac0381e412422" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 44975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:54:58.436391 17359 consensus_queue.cc:1035] T 16a3b3f4b6c04bf5a76a42509c52ffda P c5d124533a414d7d9e3e0494fdf78b01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0901175b2d864ec3bc1f43a755ca085d" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 42717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:54:58.448000 17365 mvcc.cc:205] Tried to move back new op lower bound from 7316278879980347392 to 7316278879835054080. Current Snapshot: MvccSnapshot[applied={T|T < 7316278879980347392}]
I20260808 14:54:58.451198 17367 mvcc.cc:205] Tried to move back new op lower bound from 7316278879980347392 to 7316278879835054080. Current Snapshot: MvccSnapshot[applied={T|T < 7316278879980347392}]
I20260808 14:54:58.459976 16834 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40526:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:54:58.460247 16834 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40526:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:54:58.463698 16834 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f26cbe4cd56d48c689f101862425fbee: Sending DeleteTablet for 3 replicas of tablet 16a3b3f4b6c04bf5a76a42509c52ffda
I20260808 14:54:58.464848 17115 tablet_service.cc:1514] Processing DeleteTablet for tablet 16a3b3f4b6c04bf5a76a42509c52ffda with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:54:58 UTC) from {username='kudu', principal='kudu/127.26.206.254@KRBTEST.COM'} at 127.0.0.1:36662
I20260808 14:54:58.464879 17261 tablet_service.cc:1514] Processing DeleteTablet for tablet 16a3b3f4b6c04bf5a76a42509c52ffda with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:54:58 UTC) from {username='kudu', principal='kudu/127.26.206.254@KRBTEST.COM'} at 127.0.0.1:57656
I20260808 14:54:58.465544 16971 tablet_service.cc:1514] Processing DeleteTablet for tablet 16a3b3f4b6c04bf5a76a42509c52ffda with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:54:58 UTC) from {username='kudu', principal='kudu/127.26.206.254@KRBTEST.COM'} at 127.0.0.1:44848
I20260808 14:54:58.465750 17375 tablet_replica.cc:330] T 16a3b3f4b6c04bf5a76a42509c52ffda P 174fc2250fce454d95aac0381e412422: stopping tablet replica
I20260808 14:54:58.466243 17375 raft_consensus.cc:2229] T 16a3b3f4b6c04bf5a76a42509c52ffda P 174fc2250fce454d95aac0381e412422 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:54:58.466671 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 16905
I20260808 14:54:58.466976 17375 raft_consensus.cc:2258] T 16a3b3f4b6c04bf5a76a42509c52ffda P 174fc2250fce454d95aac0381e412422 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:54:58.469630 17375 ts_tablet_manager.cc:1905] T 16a3b3f4b6c04bf5a76a42509c52ffda P 174fc2250fce454d95aac0381e412422: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:54:58.476078 17377 tablet_replica.cc:330] T 16a3b3f4b6c04bf5a76a42509c52ffda P c5d124533a414d7d9e3e0494fdf78b01: stopping tablet replica
I20260808 14:54:58.476539 17377 raft_consensus.cc:2229] T 16a3b3f4b6c04bf5a76a42509c52ffda P c5d124533a414d7d9e3e0494fdf78b01 [term 1 LEADER]: Raft consensus shutting down.
I20260808 14:54:58.477278 17377 raft_consensus.cc:2258] T 16a3b3f4b6c04bf5a76a42509c52ffda P c5d124533a414d7d9e3e0494fdf78b01 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:54:58.477450 17375 ts_tablet_manager.cc:1918] T 16a3b3f4b6c04bf5a76a42509c52ffda P 174fc2250fce454d95aac0381e412422: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:54:58.477643 17375 log.cc:1196] T 16a3b3f4b6c04bf5a76a42509c52ffda P 174fc2250fce454d95aac0381e412422: Deleting WAL directory at /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200577490656-27451-0/minicluster-data/ts-1/wal/wals/16a3b3f4b6c04bf5a76a42509c52ffda
I20260808 14:54:58.478228 17375 ts_tablet_manager.cc:1939] T 16a3b3f4b6c04bf5a76a42509c52ffda P 174fc2250fce454d95aac0381e412422: Deleting consensus metadata
I20260808 14:54:58.479687 17377 ts_tablet_manager.cc:1905] T 16a3b3f4b6c04bf5a76a42509c52ffda P c5d124533a414d7d9e3e0494fdf78b01: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:54:58.480093 16821 catalog_manager.cc:4841] TS 174fc2250fce454d95aac0381e412422 (127.26.206.194:44975): tablet 16a3b3f4b6c04bf5a76a42509c52ffda (table test-table [id=5167cb7cf8324ea2a2f4fcb9dfc898e6]) successfully deleted
I20260808 14:54:58.484827 17376 tablet_replica.cc:330] T 16a3b3f4b6c04bf5a76a42509c52ffda P 0901175b2d864ec3bc1f43a755ca085d: stopping tablet replica
I20260808 14:54:58.485253 17376 raft_consensus.cc:2229] T 16a3b3f4b6c04bf5a76a42509c52ffda P 0901175b2d864ec3bc1f43a755ca085d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:54:58.485795 17376 raft_consensus.cc:2258] T 16a3b3f4b6c04bf5a76a42509c52ffda P 0901175b2d864ec3bc1f43a755ca085d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:54:58.486043 17377 ts_tablet_manager.cc:1918] T 16a3b3f4b6c04bf5a76a42509c52ffda P c5d124533a414d7d9e3e0494fdf78b01: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:54:58.486529 17377 log.cc:1196] T 16a3b3f4b6c04bf5a76a42509c52ffda P c5d124533a414d7d9e3e0494fdf78b01: Deleting WAL directory at /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200577490656-27451-0/minicluster-data/ts-0/wal/wals/16a3b3f4b6c04bf5a76a42509c52ffda
I20260808 14:54:58.487324 17377 ts_tablet_manager.cc:1939] T 16a3b3f4b6c04bf5a76a42509c52ffda P c5d124533a414d7d9e3e0494fdf78b01: Deleting consensus metadata
I20260808 14:54:58.488174 17376 ts_tablet_manager.cc:1905] T 16a3b3f4b6c04bf5a76a42509c52ffda P 0901175b2d864ec3bc1f43a755ca085d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:54:58.489319 16822 catalog_manager.cc:4841] TS c5d124533a414d7d9e3e0494fdf78b01 (127.26.206.193:42005): tablet 16a3b3f4b6c04bf5a76a42509c52ffda (table test-table [id=5167cb7cf8324ea2a2f4fcb9dfc898e6]) successfully deleted
I20260808 14:54:58.493870 17376 ts_tablet_manager.cc:1918] T 16a3b3f4b6c04bf5a76a42509c52ffda P 0901175b2d864ec3bc1f43a755ca085d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:54:58.494048 17376 log.cc:1196] T 16a3b3f4b6c04bf5a76a42509c52ffda P 0901175b2d864ec3bc1f43a755ca085d: Deleting WAL directory at /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200577490656-27451-0/minicluster-data/ts-2/wal/wals/16a3b3f4b6c04bf5a76a42509c52ffda
I20260808 14:54:58.494491 17376 ts_tablet_manager.cc:1939] T 16a3b3f4b6c04bf5a76a42509c52ffda P 0901175b2d864ec3bc1f43a755ca085d: Deleting consensus metadata
Aug 08 14:54:58 dist-test-slave-6k22 krb5kdc[16787](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200895, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.206.193@KRBTEST.COM
I20260808 14:54:58.496240 16821 catalog_manager.cc:4841] TS 0901175b2d864ec3bc1f43a755ca085d (127.26.206.195:42717): tablet 16a3b3f4b6c04bf5a76a42509c52ffda (table test-table [id=5167cb7cf8324ea2a2f4fcb9dfc898e6]) successfully deleted
I20260808 14:54:58.504482 17343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:58.467991 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47254 (local address 127.26.206.193:42005)
0808 14:54:58.468165 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0808 14:54:58.468172 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:54:58.484138 (+ 15966us) server_negotiation.cc:407] Connection header received
0808 14:54:58.484361 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:54:58.484368 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:54:58.484466 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:54:58.484584 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:54:58.486661 (+ 2077us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:58.488150 (+ 1489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:58.490360 (+ 2210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:58.491130 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:58.491270 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:58.496858 (+ 5588us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:54:58.496873 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:54:58.496892 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:54:58.496942 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:54:58.501348 (+ 4406us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:54:58.502109 (+ 761us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:54:58.502118 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:54:58.502123 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:54:58.502313 (+ 190us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:54:58.502656 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:54:58.502661 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:54:58.502665 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:54:58.503114 (+ 449us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:54:58.503522 (+ 408us) server_negotiation.cc:1035] Waiting for connection context
0808 14:54:58.503797 (+ 275us) server_negotiation.cc:299] Negotiation successful
0808 14:54:58.504060 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260808 14:54:58.505223 17035 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:54:58.602617 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 16905
I20260808 14:54:58.624478 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 17046
Aug 08 14:54:58 dist-test-slave-6k22 krb5kdc[16787](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200895, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.206.194@KRBTEST.COM
I20260808 14:54:58.639750 17347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:58.625358 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38290 (local address 127.26.206.194:44975)
0808 14:54:58.625560 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0808 14:54:58.625564 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:54:58.625581 (+ 17us) server_negotiation.cc:407] Connection header received
0808 14:54:58.625637 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:54:58.625640 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:54:58.625699 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:54:58.625789 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:54:58.627040 (+ 1251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:58.627841 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:58.629150 (+ 1309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:58.629531 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:58.629617 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:58.633882 (+ 4265us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:54:58.633895 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:54:58.633910 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:54:58.633942 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:54:58.636928 (+ 2986us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:54:58.637664 (+ 736us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:54:58.637671 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:54:58.637673 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:54:58.637803 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:54:58.638125 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:54:58.638127 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:54:58.638129 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:54:58.638528 (+ 399us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:54:58.638751 (+ 223us) server_negotiation.cc:1035] Waiting for connection context
0808 14:54:58.639000 (+ 249us) server_negotiation.cc:299] Negotiation successful
0808 14:54:58.639162 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260808 14:54:58.640443 17182 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:54:58.733139 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 17046
I20260808 14:54:58.753732 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 17194
Aug 08 14:54:58 dist-test-slave-6k22 krb5kdc[16787](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200895, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.206.195@KRBTEST.COM
I20260808 14:54:58.768340 17349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:58.754602 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54672 (local address 127.26.206.195:42717)
0808 14:54:58.754805 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0808 14:54:58.754810 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:54:58.754831 (+ 21us) server_negotiation.cc:407] Connection header received
0808 14:54:58.754955 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:54:58.754959 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:54:58.755025 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:54:58.755114 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:54:58.756479 (+ 1365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:58.757179 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:58.758372 (+ 1193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:58.758765 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:58.758856 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:58.763198 (+ 4342us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:54:58.763212 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:54:58.763228 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:54:58.763263 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:54:58.765997 (+ 2734us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:54:58.766542 (+ 545us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:54:58.766548 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:54:58.766550 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:54:58.766682 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:54:58.766979 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:54:58.766982 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:54:58.766984 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:54:58.767307 (+ 323us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:54:58.767517 (+ 210us) server_negotiation.cc:1035] Waiting for connection context
0808 14:54:58.767793 (+ 276us) server_negotiation.cc:299] Negotiation successful
0808 14:54:58.767943 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260808 14:54:58.768954 17324 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:54:58.857627 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 17194
I20260808 14:54:58.877591 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 16803
I20260808 14:54:58.878720 16869 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:54:58.989200 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 16803
2026-08-08T14:54:59Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (4563 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-08T14:54:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:54:59Z Disabled control of system clock
I20260808 14:54:59.083918 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200577490656-27451-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200577490656-27451-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200577490656-27451-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.206.254:43807
--webserver_interface=127.26.206.254
--webserver_port=0
--builtin_ntp_servers=127.26.206.212:44285
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.206.254:43807
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 14:54:59.421051 17388 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:54:59.421340 17388 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:54:59.421422 17388 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:54:59.428613 17388 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:54:59.428723 17388 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:54:59.428769 17388 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:54:59.428825 17388 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:54:59.428869 17388 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:54:59.437834 17388 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:44285
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200577490656-27451-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200577490656-27451-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.206.254:43807
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.206.254:43807
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.206.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200577490656-27451-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:54:59.439078 17388 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:54:59.440829 17388 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:54:59.452455 17393 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:54:59.452558 17394 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:54:59.452491 17398 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:54:59.453639 17388 server_base.cc:1034] running on GCE node
I20260808 14:54:59.454332 17388 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:54:59.455650 17388 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:54:59.456857 17388 hybrid_clock.cc:648] HybridClock initialized: now 1786200899456824 us; error 31 us; skew 500 ppm
I20260808 14:54:59.457218 17388 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 14:54:59.459435 17388 webserver.cc:460] Webserver started at http://127.26.206.254:35481/ using document root <none> and password file <none>
I20260808 14:54:59.460126 17388 fs_manager.cc:359] Metadata directory not provided
I20260808 14:54:59.460240 17388 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:54:59.460597 17388 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:54:59.463362 17388 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200577490656-27451-0/minicluster-data/master-0/data/instance:
uuid: "25518fa76f7043039280f2c852480bb5"
format_stamp: "Formatted at 2026-08-08 14:54:59 on dist-test-slave-6k22"
server_key: "5ef92c0cd4ce07412daf39b290ff7d31"
server_key_iv: "5a3f16f09151a117a8db452f03b2d56c"
server_key_version: "encryptionkey@0"
I20260808 14:54:59.464283 17388 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200577490656-27451-0/minicluster-data/master-0/wal/instance:
uuid: "25518fa76f7043039280f2c852480bb5"
format_stamp: "Formatted at 2026-08-08 14:54:59 on dist-test-slave-6k22"
server_key: "5ef92c0cd4ce07412daf39b290ff7d31"
server_key_iv: "5a3f16f09151a117a8db452f03b2d56c"
server_key_version: "encryptionkey@0"
I20260808 14:54:59.469339 17388 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260808 14:54:59.472782 17405 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:54:59.474143 17388 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260808 14:54:59.474323 17388 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200577490656-27451-0/minicluster-data/master-0/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200577490656-27451-0/minicluster-data/master-0/wal
uuid: "25518fa76f7043039280f2c852480bb5"
format_stamp: "Formatted at 2026-08-08 14:54:59 on dist-test-slave-6k22"
server_key: "5ef92c0cd4ce07412daf39b290ff7d31"
server_key_iv: "5a3f16f09151a117a8db452f03b2d56c"
server_key_version: "encryptionkey@0"
I20260808 14:54:59.474538 17388 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200577490656-27451-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200577490656-27451-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200577490656-27451-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:54:59.492684 17388 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:54:59.493515 17388 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:54:59.493826 17388 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:54:59.512354 17388 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.254:43807
I20260808 14:54:59.512385 17462 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.254:43807 every 8 connection(s)
I20260808 14:54:59.513622 17388 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
I20260808 14:54:59.517161 17463 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:54:59.521631 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 17388
I20260808 14:54:59.521832 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200577490656-27451-0/minicluster-data/master-0/wal/instance
I20260808 14:54:59.522392 27451 external_mini_cluster.cc:1428] Setting key 74d30626fee42d6b07851398bad5571b
I20260808 14:54:59.528692 17463 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 25518fa76f7043039280f2c852480bb5: Bootstrap starting.
I20260808 14:54:59.531651 17463 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 25518fa76f7043039280f2c852480bb5: Neither blocks nor log segments found. Creating new log.
I20260808 14:54:59.532734 17463 log.cc:824] T 00000000000000000000000000000000 P 25518fa76f7043039280f2c852480bb5: Log is configured to *not* fsync() on all Append() calls
I20260808 14:54:59.536147 17463 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 25518fa76f7043039280f2c852480bb5: No bootstrap required, opened a new log
I20260808 14:54:59.536448 17466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:54:59.524396 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42818 (local address 127.26.206.254:43807)
0808 14:54:59.525364 (+ 968us) server_negotiation.cc:206] Beginning negotiation
0808 14:54:59.525375 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 14:54:59.525436 (+ 61us) server_negotiation.cc:407] Connection header received
0808 14:54:59.527359 (+ 1923us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:54:59.527388 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:54:59.527873 (+ 485us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:54:59.528238 (+ 365us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:54:59.528799 (+ 561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:59.530100 (+ 1301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:59.531433 (+ 1333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:54:59.532246 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:54:59.532461 (+ 215us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:54:59.533772 (+ 1311us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:54:59.533780 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:54:59.533796 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:54:59.534418 (+ 622us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:54:59.534524 (+ 106us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:54:59.534549 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:54:59.534662 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0808 14:54:59.534870 (+ 208us) server_negotiation.cc:299] Negotiation successful
0808 14:54:59.535171 (+ 301us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":552,"thread_start_us":327,"threads_started":1}
I20260808 14:54:59.544179 17463 raft_consensus.cc:348] T 00000000000000000000000000000000 P 25518fa76f7043039280f2c852480bb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25518fa76f7043039280f2c852480bb5" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 43807 } }
I20260808 14:54:59.544495 17463 raft_consensus.cc:374] T 00000000000000000000000000000000 P 25518fa76f7043039280f2c852480bb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:54:59.544569 17463 raft_consensus.cc:729] T 00000000000000000000000000000000 P 25518fa76f7043039280f2c852480bb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25518fa76f7043039280f2c852480bb5, State: Initialized, Role: FOLLOWER
I20260808 14:54:59.545110 17463 consensus_queue.cc:260] T 00000000000000000000000000000000 P 25518fa76f7043039280f2c852480bb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25518fa76f7043039280f2c852480bb5" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 43807 } }
I20260808 14:54:59.545315 17463 raft_consensus.cc:388] T 00000000000000000000000000000000 P 25518fa76f7043039280f2c852480bb5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:54:59.545409 17463 raft_consensus.cc:482] T 00000000000000000000000000000000 P 25518fa76f7043039280f2c852480bb5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:54:59.545553 17463 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 25518fa76f7043039280f2c852480bb5 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:54:59.547747 17463 raft_consensus.cc:504] T 00000000000000000000000000000000 P 25518fa76f7043039280f2c852480bb5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25518fa76f7043039280f2c852480bb5" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 43807 } }
I20260808 14:54:59.548205 17463 leader_election.cc:302] T 00000000000000000000000000000000 P 25518fa76f7043039280f2c852480bb5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 25518fa76f7043039280f2c852480bb5; no voters:
I20260808 14:54:59.548743 17463 leader_election.cc:288] T 00000000000000000000000000000000 P 25518fa76f7043039280f2c852480bb5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:54:59.548895 17468 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 25518fa76f7043039280f2c852480bb5 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:54:59.549630 17468 raft_consensus.cc:686] T 00000000000000000000000000000000 P 25518fa76f7043039280f2c852480bb5 [term 1 LEADER]: Becoming Leader. State: Replica: 25518fa76f7043039280f2c852480bb5, State: Running, Role: LEADER
I20260808 14:54:59.550169 17468 consensus_queue.cc:237] T 00000000000000000000000000000000 P 25518fa76f7043039280f2c852480bb5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25518fa76f7043039280f2c852480bb5" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 43807 } }
I20260808 14:54:59.550858 17463 sys_catalog.cc:564] T 00000000000000000000000000000000 P 25518fa76f7043039280f2c852480bb5 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:54:59.553052 17469 sys_catalog.cc:455] T 00000000000000000000000000000000 P 25518fa76f7043039280f2c852480bb5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "25518fa76f7043039280f2c852480bb5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25518fa76f7043039280f2c852480bb5" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 43807 } } }
I20260808 14:54:59.553053 17470 sys_catalog.cc:455] T 00000000000000000000000000000000 P 25518fa76f7043039280f2c852480bb5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 25518fa76f7043039280f2c852480bb5. Latest consensus state: current_term: 1 leader_uuid: "25518fa76f7043039280f2c852480bb5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25518fa76f7043039280f2c852480bb5" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 43807 } } }
I20260808 14:54:59.553524 17469 sys_catalog.cc:458] T 00000000000000000000000000000000 P 25518fa76f7043039280f2c852480bb5 [sys.catalog]: This master's current role is: LEADER
I20260808 14:54:59.553573 17470 sys_catalog.cc:458] T 00000000000000000000000000000000 P 25518fa76f7043039280f2c852480bb5 [sys.catalog]: This master's current role is: LEADER
I20260808 14:54:59.555068 17474 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:54:59.560478 17474 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:54:59.569692 17474 catalog_manager.cc:1347] Generated new cluster ID: 64a6b28df53b49e1a41cfdfb59373009
I20260808 14:54:59.569849 17474 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:54:59.585091 17474 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:54:59.586330 17474 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:54:59.597882 17474 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 25518fa76f7043039280f2c852480bb5: Generated new TSK 0
I20260808 14:54:59.598688 17474 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:54:59.603875 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200577490656-27451-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200577490656-27451-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200577490656-27451-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200577490656-27451-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.206.193:0
--local_ip_for_outbound_sockets=127.26.206.193
--webserver_interface=127.26.206.193
--webserver_port=0
--tserver_master_addrs=127.26.206.254:43807
--builtin_ntp_servers=127.26.206.212:44285
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 14:54:59.945662 17492 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:54:59.945940 17492 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:54:59.946059 17492 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:54:59.953280 17492 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:54:59.953395 17492 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:54:59.953570 17492 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.206.193
I20260808 14:54:59.962558 17492 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:44285
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200577490656-27451-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200577490656-27451-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.206.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200577490656-27451-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.206.193
--webserver_port=0
--tserver_master_addrs=127.26.206.254:43807
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.206.193
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200577490656-27451-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:54:59.963915 17492 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:54:59.965600 17492 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:54:59.978776 17498 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:54:59.978911 17500 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:54:59.979300 17502 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:54:59.979669 17492 server_base.cc:1034] running on GCE node
I20260808 14:54:59.980235 17492 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:54:59.981158 17492 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:54:59.982359 17492 hybrid_clock.cc:648] HybridClock initialized: now 1786200899982311 us; error 37 us; skew 500 ppm
I20260808 14:54:59.982673 17492 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 14:54:59.984941 17492 webserver.cc:460] Webserver started at http://127.26.206.193:33055/ using document root <none> and password file <none>
I20260808 14:54:59.985621 17492 fs_manager.cc:359] Metadata directory not provided
I20260808 14:54:59.985740 17492 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:54:59.986078 17492 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:54:59.988955 17492 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200577490656-27451-0/minicluster-data/ts-0/data/instance:
uuid: "81710886ea2446219031751df9a3272c"
format_stamp: "Formatted at 2026-08-08 14:54:59 on dist-test-slave-6k22"
server_key: "38ca641825ac39497d2a96e1e269e68a"
server_key_iv: "42d57da2ea4ae39f634bfc0f9680a7c7"
server_key_version: "encryptionkey@0"
I20260808 14:54:59.989739 17492 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200577490656-27451-0/minicluster-data/ts-0/wal/instance:
uuid: "81710886ea2446219031751df9a3272c"
format_stamp: "Formatted at 2026-08-08 14:54:59 on dist-test-slave-6k22"
server_key: "38ca641825ac39497d2a96e1e269e68a"
server_key_iv: "42d57da2ea4ae39f634bfc0f9680a7c7"
server_key_version: "encryptionkey@0"
I20260808 14:54:59.994796 17492 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260808 14:54:59.998243 17508 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:54:59.999502 17492 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 14:54:59.999723 17492 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200577490656-27451-0/minicluster-data/ts-0/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200577490656-27451-0/minicluster-data/ts-0/wal
uuid: "81710886ea2446219031751df9a3272c"
format_stamp: "Formatted at 2026-08-08 14:54:59 on dist-test-slave-6k22"
server_key: "38ca641825ac39497d2a96e1e269e68a"
server_key_iv: "42d57da2ea4ae39f634bfc0f9680a7c7"
server_key_version: "encryptionkey@0"
I20260808 14:54:59.999959 17492 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200577490656-27451-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200577490656-27451-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200577490656-27451-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:55:00.025308 17492 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:55:00.026145 17492 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:55:00.026461 17492 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:55:00.027453 17492 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:55:00.028999 17492 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:55:00.029124 17492 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:55:00.029265 17492 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:55:00.029361 17492 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:55:00.062507 17492 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.193:39055
I20260808 14:55:00.062595 17628 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.193:39055 every 8 connection(s)
I20260808 14:55:00.063851 17492 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200577490656-27451-0/minicluster-data/ts-0/data/info.pb
I20260808 14:55:00.069059 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 17492
I20260808 14:55:00.069244 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200577490656-27451-0/minicluster-data/ts-0/wal/instance
I20260808 14:55:00.069815 27451 external_mini_cluster.cc:1428] Setting key 12e04e320f8613635700bccbc843cca0
I20260808 14:55:00.072573 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200577490656-27451-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200577490656-27451-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200577490656-27451-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200577490656-27451-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.206.194:0
--local_ip_for_outbound_sockets=127.26.206.194
--webserver_interface=127.26.206.194
--webserver_port=0
--tserver_master_addrs=127.26.206.254:43807
--builtin_ntp_servers=127.26.206.212:44285
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 14:55:00.076860 17631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:00.066316 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.193:48327 (local address 127.26.206.254:43807)
0808 14:55:00.066766 (+ 450us) server_negotiation.cc:206] Beginning negotiation
0808 14:55:00.066770 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:55:00.067862 (+ 1092us) server_negotiation.cc:407] Connection header received
0808 14:55:00.070252 (+ 2390us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:55:00.070257 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:55:00.070326 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:55:00.070466 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:55:00.071507 (+ 1041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:00.072332 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:00.074077 (+ 1745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:00.074490 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:00.074623 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:55:00.076015 (+ 1392us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:55:00.076020 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:55:00.076023 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:55:00.076039 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:55:00.076078 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:55:00.076089 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:55:00.076205 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0808 14:55:00.076416 (+ 211us) server_negotiation.cc:299] Negotiation successful
0808 14:55:00.076511 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":340,"thread_start_us":245,"threads_started":1}
I20260808 14:55:00.077788 17632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:00.066813 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:43807 (local address 127.26.206.193:48327)
0808 14:55:00.067711 (+ 898us) negotiation.cc:107] Waiting for socket to connect
0808 14:55:00.067751 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 14:55:00.069949 (+ 2198us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:55:00.070703 (+ 754us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:55:00.070712 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:55:00.070803 (+ 91us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:55:00.071335 (+ 532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:55:00.071352 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:55:00.072494 (+ 1142us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:55:00.072498 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:55:00.073922 (+ 1424us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:55:00.073934 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:55:00.074743 (+ 809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:55:00.074750 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:55:00.074958 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:55:00.075702 (+ 744us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 14:55:00.075705 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:55:00.075742 (+ 37us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 14:55:00.075815 (+ 73us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:55:00.076207 (+ 392us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:55:00.076221 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:55:00.076232 (+ 11us) client_negotiation.cc:769] Sending connection context
0808 14:55:00.076406 (+ 174us) client_negotiation.cc:240] Negotiation successful
0808 14:55:00.076786 (+ 380us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":435,"thread_start_us":263,"threads_started":1}
I20260808 14:55:00.079389 17629 heartbeater.cc:347] Connected to a master server at 127.26.206.254:43807
I20260808 14:55:00.079715 17629 heartbeater.cc:464] Registering TS with master...
I20260808 14:55:00.080428 17629 heartbeater.cc:511] Master 127.26.206.254:43807 requested a full tablet report, sending...
I20260808 14:55:00.082629 17424 ts_manager.cc:194] Registered new tserver with Master: 81710886ea2446219031751df9a3272c (127.26.206.193:39055)
I20260808 14:55:00.084787 17424 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.26.206.193:48327
W20260808 14:55:00.405731 17633 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:55:00.406008 17633 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:55:00.406168 17633 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:55:00.413178 17633 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:55:00.413277 17633 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:55:00.413404 17633 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.206.194
I20260808 14:55:00.422029 17633 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:44285
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200577490656-27451-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200577490656-27451-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.206.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200577490656-27451-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.206.194
--webserver_port=0
--tserver_master_addrs=127.26.206.254:43807
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.206.194
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200577490656-27451-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:55:00.423245 17633 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:55:00.425019 17633 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:55:00.438357 17640 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:55:00.438331 17639 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:55:00.438797 17644 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:55:00.439103 17633 server_base.cc:1034] running on GCE node
I20260808 14:55:00.439785 17633 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:55:00.440701 17633 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:55:00.441926 17633 hybrid_clock.cc:648] HybridClock initialized: now 1786200900441893 us; error 46 us; skew 500 ppm
I20260808 14:55:00.442221 17633 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 14:55:00.444411 17633 webserver.cc:460] Webserver started at http://127.26.206.194:44331/ using document root <none> and password file <none>
I20260808 14:55:00.445051 17633 fs_manager.cc:359] Metadata directory not provided
I20260808 14:55:00.445180 17633 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:55:00.445493 17633 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:55:00.448268 17633 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200577490656-27451-0/minicluster-data/ts-1/data/instance:
uuid: "5c39747b17c347b88fb77397dd7a5257"
format_stamp: "Formatted at 2026-08-08 14:55:00 on dist-test-slave-6k22"
server_key: "092523fc4e7fae0f34cc2137b554ccf1"
server_key_iv: "9b59382815fbdd0a189402bcfabe6229"
server_key_version: "encryptionkey@0"
I20260808 14:55:00.449069 17633 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200577490656-27451-0/minicluster-data/ts-1/wal/instance:
uuid: "5c39747b17c347b88fb77397dd7a5257"
format_stamp: "Formatted at 2026-08-08 14:55:00 on dist-test-slave-6k22"
server_key: "092523fc4e7fae0f34cc2137b554ccf1"
server_key_iv: "9b59382815fbdd0a189402bcfabe6229"
server_key_version: "encryptionkey@0"
I20260808 14:55:00.454067 17633 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260808 14:55:00.457480 17650 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:55:00.458739 17633 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 14:55:00.458916 17633 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200577490656-27451-0/minicluster-data/ts-1/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200577490656-27451-0/minicluster-data/ts-1/wal
uuid: "5c39747b17c347b88fb77397dd7a5257"
format_stamp: "Formatted at 2026-08-08 14:55:00 on dist-test-slave-6k22"
server_key: "092523fc4e7fae0f34cc2137b554ccf1"
server_key_iv: "9b59382815fbdd0a189402bcfabe6229"
server_key_version: "encryptionkey@0"
I20260808 14:55:00.459123 17633 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200577490656-27451-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200577490656-27451-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200577490656-27451-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:55:00.490945 17633 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:55:00.491945 17633 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:55:00.492268 17633 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:55:00.493256 17633 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:55:00.494731 17633 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:55:00.494871 17633 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:55:00.495002 17633 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:55:00.495095 17633 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:55:00.531860 17633 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.194:33533
I20260808 14:55:00.531949 17772 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.194:33533 every 8 connection(s)
I20260808 14:55:00.533190 17633 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200577490656-27451-0/minicluster-data/ts-1/data/info.pb
I20260808 14:55:00.535706 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 17633
I20260808 14:55:00.535919 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200577490656-27451-0/minicluster-data/ts-1/wal/instance
I20260808 14:55:00.536402 27451 external_mini_cluster.cc:1428] Setting key 230f09d6645584251ee60b1d9f7ee6db
I20260808 14:55:00.539551 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200577490656-27451-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200577490656-27451-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200577490656-27451-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200577490656-27451-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.206.195:0
--local_ip_for_outbound_sockets=127.26.206.195
--webserver_interface=127.26.206.195
--webserver_port=0
--tserver_master_addrs=127.26.206.254:43807
--builtin_ntp_servers=127.26.206.212:44285
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 14:55:00.547722 17631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:00.535842 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.194:45669 (local address 127.26.206.254:43807)
0808 14:55:00.536077 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0808 14:55:00.536084 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:55:00.537747 (+ 1663us) server_negotiation.cc:407] Connection header received
0808 14:55:00.540338 (+ 2591us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:55:00.540342 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:55:00.540406 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:55:00.540490 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:55:00.541887 (+ 1397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:00.542556 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:00.544932 (+ 2376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:00.545325 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:00.545416 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:55:00.546989 (+ 1573us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:55:00.546994 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:55:00.546997 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:55:00.547013 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:55:00.547044 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:55:00.547055 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:55:00.547122 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0808 14:55:00.547375 (+ 253us) server_negotiation.cc:299] Negotiation successful
0808 14:55:00.547445 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260808 14:55:00.549172 17775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:00.536518 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:43807 (local address 127.26.206.194:45669)
0808 14:55:00.537572 (+ 1054us) negotiation.cc:107] Waiting for socket to connect
0808 14:55:00.537633 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0808 14:55:00.540019 (+ 2386us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:55:00.540768 (+ 749us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:55:00.540782 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:55:00.540899 (+ 117us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:55:00.541704 (+ 805us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:55:00.541744 (+ 40us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:55:00.542727 (+ 983us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:55:00.542734 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:55:00.544807 (+ 2073us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:55:00.544823 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:55:00.545533 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:55:00.545542 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:55:00.545868 (+ 326us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:55:00.546644 (+ 776us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 14:55:00.546651 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:55:00.546714 (+ 63us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 14:55:00.546812 (+ 98us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:55:00.547152 (+ 340us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:55:00.547166 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:55:00.547176 (+ 10us) client_negotiation.cc:769] Sending connection context
0808 14:55:00.547360 (+ 184us) client_negotiation.cc:240] Negotiation successful
0808 14:55:00.547775 (+ 415us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":509,"thread_start_us":321,"threads_started":1}
I20260808 14:55:00.550514 17773 heartbeater.cc:347] Connected to a master server at 127.26.206.254:43807
I20260808 14:55:00.550825 17773 heartbeater.cc:464] Registering TS with master...
I20260808 14:55:00.551760 17773 heartbeater.cc:511] Master 127.26.206.254:43807 requested a full tablet report, sending...
I20260808 14:55:00.553176 17424 ts_manager.cc:194] Registered new tserver with Master: 5c39747b17c347b88fb77397dd7a5257 (127.26.206.194:33533)
I20260808 14:55:00.554358 17424 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.26.206.194:45669
W20260808 14:55:00.876260 17776 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:55:00.876508 17776 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:55:00.876590 17776 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:55:00.883958 17776 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:55:00.884065 17776 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:55:00.884163 17776 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.206.195
I20260808 14:55:00.892753 17776 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:44285
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200577490656-27451-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200577490656-27451-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.206.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200577490656-27451-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.206.195
--webserver_port=0
--tserver_master_addrs=127.26.206.254:43807
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.206.195
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200577490656-27451-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:55:00.893860 17776 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:55:00.895514 17776 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:55:00.908471 17784 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:55:00.908560 17781 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:55:00.908535 17782 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:55:00.909042 17776 server_base.cc:1034] running on GCE node
I20260808 14:55:00.909726 17776 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:55:00.910600 17776 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:55:00.911834 17776 hybrid_clock.cc:648] HybridClock initialized: now 1786200900911796 us; error 56 us; skew 500 ppm
I20260808 14:55:00.912137 17776 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 14:55:00.914198 17776 webserver.cc:460] Webserver started at http://127.26.206.195:44229/ using document root <none> and password file <none>
I20260808 14:55:00.914851 17776 fs_manager.cc:359] Metadata directory not provided
I20260808 14:55:00.915081 17776 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:55:00.915462 17776 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:55:00.918601 17776 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200577490656-27451-0/minicluster-data/ts-2/data/instance:
uuid: "3bb80ccaa90c46a7bc52647ee8610bc0"
format_stamp: "Formatted at 2026-08-08 14:55:00 on dist-test-slave-6k22"
server_key: "c4db66e39be03d92839e910342046182"
server_key_iv: "60f85941a0b594668189af2077ef6f4f"
server_key_version: "encryptionkey@0"
I20260808 14:55:00.919438 17776 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200577490656-27451-0/minicluster-data/ts-2/wal/instance:
uuid: "3bb80ccaa90c46a7bc52647ee8610bc0"
format_stamp: "Formatted at 2026-08-08 14:55:00 on dist-test-slave-6k22"
server_key: "c4db66e39be03d92839e910342046182"
server_key_iv: "60f85941a0b594668189af2077ef6f4f"
server_key_version: "encryptionkey@0"
I20260808 14:55:00.924777 17776 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.001s
I20260808 14:55:00.928381 17790 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:55:00.929612 17776 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 14:55:00.929793 17776 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200577490656-27451-0/minicluster-data/ts-2/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200577490656-27451-0/minicluster-data/ts-2/wal
uuid: "3bb80ccaa90c46a7bc52647ee8610bc0"
format_stamp: "Formatted at 2026-08-08 14:55:00 on dist-test-slave-6k22"
server_key: "c4db66e39be03d92839e910342046182"
server_key_iv: "60f85941a0b594668189af2077ef6f4f"
server_key_version: "encryptionkey@0"
I20260808 14:55:00.930016 17776 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200577490656-27451-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200577490656-27451-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200577490656-27451-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:55:00.945621 17776 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:55:00.946388 17776 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:55:00.946684 17776 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:55:00.947589 17776 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:55:00.948944 17776 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:55:00.949060 17776 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:55:00.949188 17776 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:55:00.949272 17776 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:55:00.981660 17776 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.195:41109
I20260808 14:55:00.981716 17913 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.195:41109 every 8 connection(s)
I20260808 14:55:00.982895 17776 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200577490656-27451-0/minicluster-data/ts-2/data/info.pb
I20260808 14:55:00.992990 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 17776
I20260808 14:55:00.993189 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200577490656-27451-0/minicluster-data/ts-2/wal/instance
I20260808 14:55:00.993817 27451 external_mini_cluster.cc:1428] Setting key eef14cc9b1ca17b8a9b4bb29682e4ba8
I20260808 14:55:00.994748 17631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:00.985449 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.195:44995 (local address 127.26.206.254:43807)
0808 14:55:00.985626 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0808 14:55:00.985630 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:55:00.986952 (+ 1322us) server_negotiation.cc:407] Connection header received
0808 14:55:00.988660 (+ 1708us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:55:00.988664 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:55:00.988733 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:55:00.988824 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:55:00.989787 (+ 963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:00.990517 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:00.992009 (+ 1492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:00.992392 (+ 383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:00.992487 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:55:00.993990 (+ 1503us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:55:00.993994 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:55:00.993997 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:55:00.994015 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:55:00.994044 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:55:00.994055 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:55:00.994119 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0808 14:55:00.994375 (+ 256us) server_negotiation.cc:299] Negotiation successful
0808 14:55:00.994473 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260808 14:55:00.996402 17916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:00.985888 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:43807 (local address 127.26.206.195:44995)
0808 14:55:00.986794 (+ 906us) negotiation.cc:107] Waiting for socket to connect
0808 14:55:00.986835 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 14:55:00.988412 (+ 1577us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:55:00.989011 (+ 599us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:55:00.989019 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:55:00.989099 (+ 80us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:55:00.989636 (+ 537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:55:00.989652 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:55:00.990632 (+ 980us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:55:00.990635 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:55:00.991889 (+ 1254us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:55:00.991900 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:55:00.992566 (+ 666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:55:00.992570 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:55:00.992894 (+ 324us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:55:00.993618 (+ 724us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 14:55:00.993621 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:55:00.993669 (+ 48us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 14:55:00.993752 (+ 83us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:55:00.994153 (+ 401us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:55:00.994162 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:55:00.994169 (+ 7us) client_negotiation.cc:769] Sending connection context
0808 14:55:00.994330 (+ 161us) client_negotiation.cc:240] Negotiation successful
0808 14:55:00.994656 (+ 326us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":499,"thread_start_us":293,"threads_started":1}
I20260808 14:55:00.997782 17914 heartbeater.cc:347] Connected to a master server at 127.26.206.254:43807
I20260808 14:55:00.998024 17914 heartbeater.cc:464] Registering TS with master...
I20260808 14:55:00.998701 17914 heartbeater.cc:511] Master 127.26.206.254:43807 requested a full tablet report, sending...
I20260808 14:55:01.000131 17424 ts_manager.cc:194] Registered new tserver with Master: 3bb80ccaa90c46a7bc52647ee8610bc0 (127.26.206.195:41109)
I20260808 14:55:01.000882 17424 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.26.206.195:44995
I20260808 14:55:01.009128 27451 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 14:55:01.018366 17631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:01.013147 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42820 (local address 127.26.206.254:43807)
0808 14:55:01.013294 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0808 14:55:01.013298 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:55:01.013740 (+ 442us) server_negotiation.cc:407] Connection header received
0808 14:55:01.013867 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:55:01.013870 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:55:01.013955 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:55:01.014031 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:55:01.014463 (+ 432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:01.015117 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:01.016435 (+ 1318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:01.016825 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:01.016917 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:55:01.017828 (+ 911us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:55:01.017833 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:55:01.017836 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:55:01.017851 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:55:01.017878 (+ 27us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:55:01.017889 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:55:01.017966 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0808 14:55:01.018076 (+ 110us) server_negotiation.cc:299] Negotiation successful
0808 14:55:01.018141 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260808 14:55:01.021868 17424 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42820:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:55:01.028548 17424 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:55:01.065338 17929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:01.040580 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42432 (local address 127.26.206.194:33533)
0808 14:55:01.053661 (+ 13081us) server_negotiation.cc:206] Beginning negotiation
0808 14:55:01.053672 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 14:55:01.055712 (+ 2040us) server_negotiation.cc:407] Connection header received
0808 14:55:01.055941 (+ 229us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:55:01.055948 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:55:01.056130 (+ 182us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:55:01.056329 (+ 199us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:55:01.057405 (+ 1076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:01.058855 (+ 1450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:01.062115 (+ 3260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:01.063683 (+ 1568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:01.063817 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:55:01.064037 (+ 220us) server_negotiation.cc:1035] Waiting for connection context
0808 14:55:01.064788 (+ 751us) server_negotiation.cc:299] Negotiation successful
0808 14:55:01.064979 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12876,"thread_start_us":13082,"threads_started":1}
I20260808 14:55:01.065421 17932 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:01.043426 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55016 (local address 127.26.206.195:41109)
0808 14:55:01.049099 (+ 5673us) server_negotiation.cc:206] Beginning negotiation
0808 14:55:01.049111 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 14:55:01.056463 (+ 7352us) server_negotiation.cc:407] Connection header received
0808 14:55:01.056840 (+ 377us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:55:01.056850 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:55:01.057105 (+ 255us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:55:01.057302 (+ 197us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:55:01.057975 (+ 673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:01.059487 (+ 1512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:01.061924 (+ 2437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:01.063494 (+ 1570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:01.063818 (+ 324us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:55:01.064045 (+ 227us) server_negotiation.cc:1035] Waiting for connection context
0808 14:55:01.064810 (+ 765us) server_negotiation.cc:299] Negotiation successful
0808 14:55:01.065002 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5477,"thread_start_us":5329,"threads_started":1}
I20260808 14:55:01.066301 17928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:01.040380 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54698 (local address 127.26.206.193:39055)
0808 14:55:01.054347 (+ 13967us) server_negotiation.cc:206] Beginning negotiation
0808 14:55:01.054356 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:55:01.055282 (+ 926us) server_negotiation.cc:407] Connection header received
0808 14:55:01.055861 (+ 579us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:55:01.055871 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:55:01.056131 (+ 260us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:55:01.056330 (+ 199us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:55:01.057081 (+ 751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:01.058979 (+ 1898us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:01.062122 (+ 3143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:01.063871 (+ 1749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:01.064039 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:55:01.064252 (+ 213us) server_negotiation.cc:1035] Waiting for connection context
0808 14:55:01.065700 (+ 1448us) server_negotiation.cc:299] Negotiation successful
0808 14:55:01.065882 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13747,"thread_start_us":13613,"threads_started":1}
I20260808 14:55:01.066422 17926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:01.042680 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.195:41109 (local address 127.0.0.1:55016)
0808 14:55:01.056334 (+ 13654us) negotiation.cc:107] Waiting for socket to connect
0808 14:55:01.056351 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 14:55:01.056605 (+ 254us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:55:01.057317 (+ 712us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:55:01.057324 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:55:01.057357 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:55:01.057751 (+ 394us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:55:01.057765 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:55:01.059726 (+ 1961us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:55:01.059729 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:55:01.061628 (+ 1899us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:55:01.061642 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:55:01.064279 (+ 2637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:55:01.064287 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:55:01.064518 (+ 231us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:55:01.064581 (+ 63us) client_negotiation.cc:769] Sending connection context
0808 14:55:01.065706 (+ 1125us) client_negotiation.cc:240] Negotiation successful
0808 14:55:01.066040 (+ 334us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13506,"mutex_wait_us":26,"thread_start_us":11858,"threads_started":1}
I20260808 14:55:01.066705 17927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:01.040319 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.194:33533 (local address 127.0.0.1:42432)
0808 14:55:01.055535 (+ 15216us) negotiation.cc:107] Waiting for socket to connect
0808 14:55:01.055593 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0808 14:55:01.055765 (+ 172us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:55:01.056631 (+ 866us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:55:01.056635 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:55:01.056710 (+ 75us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:55:01.057215 (+ 505us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:55:01.057232 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:55:01.059000 (+ 1768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:55:01.059003 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:55:01.061881 (+ 2878us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:55:01.061895 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:55:01.064235 (+ 2340us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:55:01.064242 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:55:01.064498 (+ 256us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:55:01.064578 (+ 80us) client_negotiation.cc:769] Sending connection context
0808 14:55:01.065925 (+ 1347us) client_negotiation.cc:240] Negotiation successful
0808 14:55:01.066063 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14949,"mutex_wait_us":173,"thread_start_us":14931,"threads_started":1}
I20260808 14:55:01.067068 17931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:01.040081 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.193:39055 (local address 127.0.0.1:54698)
0808 14:55:01.055107 (+ 15026us) negotiation.cc:107] Waiting for socket to connect
0808 14:55:01.055152 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 14:55:01.055504 (+ 352us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:55:01.056363 (+ 859us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:55:01.056376 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:55:01.056416 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:55:01.056891 (+ 475us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:55:01.056902 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:55:01.059128 (+ 2226us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:55:01.059132 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:55:01.061881 (+ 2749us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:55:01.061895 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:55:01.065260 (+ 3365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:55:01.065265 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:55:01.065468 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:55:01.065530 (+ 62us) client_negotiation.cc:769] Sending connection context
0808 14:55:01.066554 (+ 1024us) client_negotiation.cc:240] Negotiation successful
0808 14:55:01.066724 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14691,"mutex_wait_us":133,"thread_start_us":15951,"threads_started":1}
I20260808 14:55:01.070101 17846 tablet_service.cc:1467] Processing CreateTablet for tablet 8e779cc220f946968890c39887fcd102 (DEFAULT_TABLE table=test-table [id=dbaa403bf50742d6b5a547b3bcef6d62]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:55:01.070613 17703 tablet_service.cc:1467] Processing CreateTablet for tablet 8e779cc220f946968890c39887fcd102 (DEFAULT_TABLE table=test-table [id=dbaa403bf50742d6b5a547b3bcef6d62]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:55:01.071545 17846 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8e779cc220f946968890c39887fcd102. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:55:01.072003 17703 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8e779cc220f946968890c39887fcd102. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:55:01.073892 17561 tablet_service.cc:1467] Processing CreateTablet for tablet 8e779cc220f946968890c39887fcd102 (DEFAULT_TABLE table=test-table [id=dbaa403bf50742d6b5a547b3bcef6d62]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:55:01.075201 17561 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8e779cc220f946968890c39887fcd102. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:55:01.083915 17933 tablet_bootstrap.cc:492] T 8e779cc220f946968890c39887fcd102 P 5c39747b17c347b88fb77397dd7a5257: Bootstrap starting.
I20260808 14:55:01.086082 17934 tablet_bootstrap.cc:492] T 8e779cc220f946968890c39887fcd102 P 3bb80ccaa90c46a7bc52647ee8610bc0: Bootstrap starting.
I20260808 14:55:01.087695 17629 heartbeater.cc:503] Master 127.26.206.254:43807 was elected leader, sending a full tablet report...
I20260808 14:55:01.089084 17933 tablet_bootstrap.cc:654] T 8e779cc220f946968890c39887fcd102 P 5c39747b17c347b88fb77397dd7a5257: Neither blocks nor log segments found. Creating new log.
I20260808 14:55:01.089813 17934 tablet_bootstrap.cc:654] T 8e779cc220f946968890c39887fcd102 P 3bb80ccaa90c46a7bc52647ee8610bc0: Neither blocks nor log segments found. Creating new log.
I20260808 14:55:01.090167 17935 tablet_bootstrap.cc:492] T 8e779cc220f946968890c39887fcd102 P 81710886ea2446219031751df9a3272c: Bootstrap starting.
I20260808 14:55:01.090983 17933 log.cc:824] T 8e779cc220f946968890c39887fcd102 P 5c39747b17c347b88fb77397dd7a5257: Log is configured to *not* fsync() on all Append() calls
I20260808 14:55:01.091070 17934 log.cc:824] T 8e779cc220f946968890c39887fcd102 P 3bb80ccaa90c46a7bc52647ee8610bc0: Log is configured to *not* fsync() on all Append() calls
I20260808 14:55:01.093307 17935 tablet_bootstrap.cc:654] T 8e779cc220f946968890c39887fcd102 P 81710886ea2446219031751df9a3272c: Neither blocks nor log segments found. Creating new log.
I20260808 14:55:01.094096 17933 tablet_bootstrap.cc:492] T 8e779cc220f946968890c39887fcd102 P 5c39747b17c347b88fb77397dd7a5257: No bootstrap required, opened a new log
I20260808 14:55:01.094385 17933 ts_tablet_manager.cc:1397] T 8e779cc220f946968890c39887fcd102 P 5c39747b17c347b88fb77397dd7a5257: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.002s
I20260808 14:55:01.094489 17934 tablet_bootstrap.cc:492] T 8e779cc220f946968890c39887fcd102 P 3bb80ccaa90c46a7bc52647ee8610bc0: No bootstrap required, opened a new log
I20260808 14:55:01.094560 17935 log.cc:824] T 8e779cc220f946968890c39887fcd102 P 81710886ea2446219031751df9a3272c: Log is configured to *not* fsync() on all Append() calls
I20260808 14:55:01.094784 17934 ts_tablet_manager.cc:1397] T 8e779cc220f946968890c39887fcd102 P 3bb80ccaa90c46a7bc52647ee8610bc0: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.008s
I20260808 14:55:01.097483 17935 tablet_bootstrap.cc:492] T 8e779cc220f946968890c39887fcd102 P 81710886ea2446219031751df9a3272c: No bootstrap required, opened a new log
I20260808 14:55:01.097723 17935 ts_tablet_manager.cc:1397] T 8e779cc220f946968890c39887fcd102 P 81710886ea2446219031751df9a3272c: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.000s
I20260808 14:55:01.102819 17933 raft_consensus.cc:348] T 8e779cc220f946968890c39887fcd102 P 5c39747b17c347b88fb77397dd7a5257 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81710886ea2446219031751df9a3272c" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 39055 } } peers { permanent_uuid: "5c39747b17c347b88fb77397dd7a5257" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 33533 } } peers { permanent_uuid: "3bb80ccaa90c46a7bc52647ee8610bc0" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 41109 } }
I20260808 14:55:01.103318 17933 raft_consensus.cc:374] T 8e779cc220f946968890c39887fcd102 P 5c39747b17c347b88fb77397dd7a5257 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:55:01.103437 17933 raft_consensus.cc:729] T 8e779cc220f946968890c39887fcd102 P 5c39747b17c347b88fb77397dd7a5257 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c39747b17c347b88fb77397dd7a5257, State: Initialized, Role: FOLLOWER
I20260808 14:55:01.104169 17933 consensus_queue.cc:260] T 8e779cc220f946968890c39887fcd102 P 5c39747b17c347b88fb77397dd7a5257 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81710886ea2446219031751df9a3272c" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 39055 } } peers { permanent_uuid: "5c39747b17c347b88fb77397dd7a5257" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 33533 } } peers { permanent_uuid: "3bb80ccaa90c46a7bc52647ee8610bc0" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 41109 } }
I20260808 14:55:01.104988 17934 raft_consensus.cc:348] T 8e779cc220f946968890c39887fcd102 P 3bb80ccaa90c46a7bc52647ee8610bc0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81710886ea2446219031751df9a3272c" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 39055 } } peers { permanent_uuid: "5c39747b17c347b88fb77397dd7a5257" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 33533 } } peers { permanent_uuid: "3bb80ccaa90c46a7bc52647ee8610bc0" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 41109 } }
I20260808 14:55:01.105427 17773 heartbeater.cc:503] Master 127.26.206.254:43807 was elected leader, sending a full tablet report...
I20260808 14:55:01.105461 17934 raft_consensus.cc:374] T 8e779cc220f946968890c39887fcd102 P 3bb80ccaa90c46a7bc52647ee8610bc0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:55:01.105561 17934 raft_consensus.cc:729] T 8e779cc220f946968890c39887fcd102 P 3bb80ccaa90c46a7bc52647ee8610bc0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bb80ccaa90c46a7bc52647ee8610bc0, State: Initialized, Role: FOLLOWER
I20260808 14:55:01.106177 17933 ts_tablet_manager.cc:1428] T 8e779cc220f946968890c39887fcd102 P 5c39747b17c347b88fb77397dd7a5257: Time spent starting tablet: real 0.012s user 0.012s sys 0.000s
I20260808 14:55:01.106210 17934 consensus_queue.cc:260] T 8e779cc220f946968890c39887fcd102 P 3bb80ccaa90c46a7bc52647ee8610bc0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81710886ea2446219031751df9a3272c" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 39055 } } peers { permanent_uuid: "5c39747b17c347b88fb77397dd7a5257" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 33533 } } peers { permanent_uuid: "3bb80ccaa90c46a7bc52647ee8610bc0" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 41109 } }
I20260808 14:55:01.107877 17914 heartbeater.cc:503] Master 127.26.206.254:43807 was elected leader, sending a full tablet report...
I20260808 14:55:01.108510 17934 ts_tablet_manager.cc:1428] T 8e779cc220f946968890c39887fcd102 P 3bb80ccaa90c46a7bc52647ee8610bc0: Time spent starting tablet: real 0.014s user 0.013s sys 0.000s
I20260808 14:55:01.108430 17935 raft_consensus.cc:348] T 8e779cc220f946968890c39887fcd102 P 81710886ea2446219031751df9a3272c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81710886ea2446219031751df9a3272c" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 39055 } } peers { permanent_uuid: "5c39747b17c347b88fb77397dd7a5257" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 33533 } } peers { permanent_uuid: "3bb80ccaa90c46a7bc52647ee8610bc0" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 41109 } }
I20260808 14:55:01.108845 17935 raft_consensus.cc:374] T 8e779cc220f946968890c39887fcd102 P 81710886ea2446219031751df9a3272c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:55:01.108912 17935 raft_consensus.cc:729] T 8e779cc220f946968890c39887fcd102 P 81710886ea2446219031751df9a3272c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81710886ea2446219031751df9a3272c, State: Initialized, Role: FOLLOWER
I20260808 14:55:01.109532 17935 consensus_queue.cc:260] T 8e779cc220f946968890c39887fcd102 P 81710886ea2446219031751df9a3272c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81710886ea2446219031751df9a3272c" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 39055 } } peers { permanent_uuid: "5c39747b17c347b88fb77397dd7a5257" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 33533 } } peers { permanent_uuid: "3bb80ccaa90c46a7bc52647ee8610bc0" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 41109 } }
I20260808 14:55:01.116762 17935 ts_tablet_manager.cc:1428] T 8e779cc220f946968890c39887fcd102 P 81710886ea2446219031751df9a3272c: Time spent starting tablet: real 0.019s user 0.016s sys 0.004s
I20260808 14:55:01.125617 17941 raft_consensus.cc:482] T 8e779cc220f946968890c39887fcd102 P 81710886ea2446219031751df9a3272c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:55:01.125866 17941 raft_consensus.cc:504] T 8e779cc220f946968890c39887fcd102 P 81710886ea2446219031751df9a3272c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81710886ea2446219031751df9a3272c" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 39055 } } peers { permanent_uuid: "5c39747b17c347b88fb77397dd7a5257" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 33533 } } peers { permanent_uuid: "3bb80ccaa90c46a7bc52647ee8610bc0" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 41109 } }
I20260808 14:55:01.127629 17941 leader_election.cc:288] T 8e779cc220f946968890c39887fcd102 P 81710886ea2446219031751df9a3272c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5c39747b17c347b88fb77397dd7a5257 (127.26.206.194:33533), 3bb80ccaa90c46a7bc52647ee8610bc0 (127.26.206.195:41109)
I20260808 14:55:01.133911 17932 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:01.128233 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.193:48099 (local address 127.26.206.195:41109)
0808 14:55:01.128572 (+ 339us) server_negotiation.cc:206] Beginning negotiation
0808 14:55:01.128580 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:55:01.128884 (+ 304us) server_negotiation.cc:407] Connection header received
0808 14:55:01.129111 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:55:01.129115 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:55:01.129170 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:55:01.129285 (+ 115us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:55:01.129772 (+ 487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:01.130457 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:01.132250 (+ 1793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:01.132990 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:01.133184 (+ 194us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:55:01.133253 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0808 14:55:01.133579 (+ 326us) server_negotiation.cc:299] Negotiation successful
0808 14:55:01.133694 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":157}
I20260808 14:55:01.133999 17942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:01.127846 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.195:41109 (local address 127.26.206.193:48099)
0808 14:55:01.128751 (+ 905us) negotiation.cc:107] Waiting for socket to connect
0808 14:55:01.128790 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 14:55:01.128966 (+ 176us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:55:01.129295 (+ 329us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:55:01.129299 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:55:01.129355 (+ 56us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:55:01.129641 (+ 286us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:55:01.129650 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:55:01.130574 (+ 924us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:55:01.130581 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:55:01.132062 (+ 1481us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:55:01.132073 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:55:01.133180 (+ 1107us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:55:01.133186 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:55:01.133342 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:55:01.133397 (+ 55us) client_negotiation.cc:769] Sending connection context
0808 14:55:01.133505 (+ 108us) client_negotiation.cc:240] Negotiation successful
0808 14:55:01.133630 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":795,"mutex_wait_us":53,"spinlock_wait_cycles":29568,"thread_start_us":624,"threads_started":1}
I20260808 14:55:01.134954 17929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:01.128109 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.206.193:56041 (local address 127.26.206.194:33533)
0808 14:55:01.128350 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0808 14:55:01.128358 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:55:01.129279 (+ 921us) server_negotiation.cc:407] Connection header received
0808 14:55:01.129485 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:55:01.129491 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:55:01.129580 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:55:01.129688 (+ 108us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:55:01.130252 (+ 564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:01.130953 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:01.132815 (+ 1862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:01.133887 (+ 1072us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:01.134071 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:55:01.134137 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0808 14:55:01.134561 (+ 424us) server_negotiation.cc:299] Negotiation successful
0808 14:55:01.134703 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260808 14:55:01.135051 17943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:01.128093 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.194:33533 (local address 127.26.206.193:56041)
0808 14:55:01.129149 (+ 1056us) negotiation.cc:107] Waiting for socket to connect
0808 14:55:01.129172 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 14:55:01.129336 (+ 164us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:55:01.129715 (+ 379us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:55:01.129720 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:55:01.129744 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:55:01.130072 (+ 328us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:55:01.130081 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:55:01.131102 (+ 1021us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:55:01.131107 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:55:01.132630 (+ 1523us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:55:01.132643 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:55:01.134091 (+ 1448us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:55:01.134098 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:55:01.134377 (+ 279us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:55:01.134417 (+ 40us) client_negotiation.cc:769] Sending connection context
0808 14:55:01.134533 (+ 116us) client_negotiation.cc:240] Negotiation successful
0808 14:55:01.134658 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":939,"mutex_wait_us":2,"thread_start_us":702,"threads_started":1}
I20260808 14:55:01.135084 17867 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e779cc220f946968890c39887fcd102" candidate_uuid: "81710886ea2446219031751df9a3272c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bb80ccaa90c46a7bc52647ee8610bc0" is_pre_election: true
I20260808 14:55:01.135679 17867 raft_consensus.cc:2454] T 8e779cc220f946968890c39887fcd102 P 3bb80ccaa90c46a7bc52647ee8610bc0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81710886ea2446219031751df9a3272c in term 0.
I20260808 14:55:01.136157 17724 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e779cc220f946968890c39887fcd102" candidate_uuid: "81710886ea2446219031751df9a3272c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c39747b17c347b88fb77397dd7a5257" is_pre_election: true
I20260808 14:55:01.136328 17511 leader_election.cc:302] T 8e779cc220f946968890c39887fcd102 P 81710886ea2446219031751df9a3272c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bb80ccaa90c46a7bc52647ee8610bc0, 81710886ea2446219031751df9a3272c; no voters:
I20260808 14:55:01.136655 17724 raft_consensus.cc:2454] T 8e779cc220f946968890c39887fcd102 P 5c39747b17c347b88fb77397dd7a5257 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81710886ea2446219031751df9a3272c in term 0.
I20260808 14:55:01.136710 17941 raft_consensus.cc:2781] T 8e779cc220f946968890c39887fcd102 P 81710886ea2446219031751df9a3272c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:55:01.136859 17941 raft_consensus.cc:482] T 8e779cc220f946968890c39887fcd102 P 81710886ea2446219031751df9a3272c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:55:01.136978 17941 raft_consensus.cc:3037] T 8e779cc220f946968890c39887fcd102 P 81710886ea2446219031751df9a3272c [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:55:01.139183 17941 raft_consensus.cc:504] T 8e779cc220f946968890c39887fcd102 P 81710886ea2446219031751df9a3272c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81710886ea2446219031751df9a3272c" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 39055 } } peers { permanent_uuid: "5c39747b17c347b88fb77397dd7a5257" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 33533 } } peers { permanent_uuid: "3bb80ccaa90c46a7bc52647ee8610bc0" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 41109 } }
I20260808 14:55:01.139904 17941 leader_election.cc:288] T 8e779cc220f946968890c39887fcd102 P 81710886ea2446219031751df9a3272c [CANDIDATE]: Term 1 election: Requested vote from peers 5c39747b17c347b88fb77397dd7a5257 (127.26.206.194:33533), 3bb80ccaa90c46a7bc52647ee8610bc0 (127.26.206.195:41109)
I20260808 14:55:01.140352 17724 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e779cc220f946968890c39887fcd102" candidate_uuid: "81710886ea2446219031751df9a3272c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c39747b17c347b88fb77397dd7a5257"
I20260808 14:55:01.140403 17867 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e779cc220f946968890c39887fcd102" candidate_uuid: "81710886ea2446219031751df9a3272c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bb80ccaa90c46a7bc52647ee8610bc0"
I20260808 14:55:01.140588 17724 raft_consensus.cc:3037] T 8e779cc220f946968890c39887fcd102 P 5c39747b17c347b88fb77397dd7a5257 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:55:01.140645 17867 raft_consensus.cc:3037] T 8e779cc220f946968890c39887fcd102 P 3bb80ccaa90c46a7bc52647ee8610bc0 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:55:01.142834 17724 raft_consensus.cc:2454] T 8e779cc220f946968890c39887fcd102 P 5c39747b17c347b88fb77397dd7a5257 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81710886ea2446219031751df9a3272c in term 1.
I20260808 14:55:01.142995 17867 raft_consensus.cc:2454] T 8e779cc220f946968890c39887fcd102 P 3bb80ccaa90c46a7bc52647ee8610bc0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81710886ea2446219031751df9a3272c in term 1.
I20260808 14:55:01.143288 17510 leader_election.cc:302] T 8e779cc220f946968890c39887fcd102 P 81710886ea2446219031751df9a3272c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c39747b17c347b88fb77397dd7a5257, 81710886ea2446219031751df9a3272c; no voters:
I20260808 14:55:01.143630 17941 raft_consensus.cc:2781] T 8e779cc220f946968890c39887fcd102 P 81710886ea2446219031751df9a3272c [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:55:01.144059 17941 raft_consensus.cc:686] T 8e779cc220f946968890c39887fcd102 P 81710886ea2446219031751df9a3272c [term 1 LEADER]: Becoming Leader. State: Replica: 81710886ea2446219031751df9a3272c, State: Running, Role: LEADER
I20260808 14:55:01.144549 17941 consensus_queue.cc:237] T 8e779cc220f946968890c39887fcd102 P 81710886ea2446219031751df9a3272c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81710886ea2446219031751df9a3272c" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 39055 } } peers { permanent_uuid: "5c39747b17c347b88fb77397dd7a5257" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 33533 } } peers { permanent_uuid: "3bb80ccaa90c46a7bc52647ee8610bc0" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 41109 } }
I20260808 14:55:01.149501 17424 catalog_manager.cc:5495] T 8e779cc220f946968890c39887fcd102 P 81710886ea2446219031751df9a3272c reported cstate change: term changed from 0 to 1, leader changed from <none> to 81710886ea2446219031751df9a3272c (127.26.206.193). New cstate: current_term: 1 leader_uuid: "81710886ea2446219031751df9a3272c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81710886ea2446219031751df9a3272c" member_type: VOTER last_known_addr { host: "127.26.206.193" port: 39055 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c39747b17c347b88fb77397dd7a5257" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 33533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3bb80ccaa90c46a7bc52647ee8610bc0" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 41109 } health_report { overall_health: UNKNOWN } } }
I20260808 14:55:01.182185 17928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:01.176976 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54704 (local address 127.26.206.193:39055)
0808 14:55:01.177224 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0808 14:55:01.177229 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:55:01.177247 (+ 18us) server_negotiation.cc:407] Connection header received
0808 14:55:01.177439 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:55:01.177442 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:55:01.177535 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:55:01.177656 (+ 121us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:55:01.178041 (+ 385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:01.178752 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:01.180230 (+ 1478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:01.180637 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:01.180730 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:55:01.181126 (+ 396us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:55:01.181623 (+ 497us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:55:01.181726 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0808 14:55:01.181843 (+ 117us) server_negotiation.cc:299] Negotiation successful
0808 14:55:01.181901 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260808 14:55:01.189981 17867 raft_consensus.cc:1261] T 8e779cc220f946968890c39887fcd102 P 3bb80ccaa90c46a7bc52647ee8610bc0 [term 1 FOLLOWER]: Refusing update from remote peer 81710886ea2446219031751df9a3272c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:55:01.189982 17724 raft_consensus.cc:1261] T 8e779cc220f946968890c39887fcd102 P 5c39747b17c347b88fb77397dd7a5257 [term 1 FOLLOWER]: Refusing update from remote peer 81710886ea2446219031751df9a3272c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:55:01.190917 17944 consensus_queue.cc:1035] T 8e779cc220f946968890c39887fcd102 P 81710886ea2446219031751df9a3272c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bb80ccaa90c46a7bc52647ee8610bc0" member_type: VOTER last_known_addr { host: "127.26.206.195" port: 41109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:55:01.191295 17941 consensus_queue.cc:1035] T 8e779cc220f946968890c39887fcd102 P 81710886ea2446219031751df9a3272c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c39747b17c347b88fb77397dd7a5257" member_type: VOTER last_known_addr { host: "127.26.206.194" port: 33533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:55:01.216845 17424 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42820:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:55:01.217127 17424 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42820:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:55:01.220733 17424 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 25518fa76f7043039280f2c852480bb5: Sending DeleteTablet for 3 replicas of tablet 8e779cc220f946968890c39887fcd102
I20260808 14:55:01.221838 17561 tablet_service.cc:1514] Processing DeleteTablet for tablet 8e779cc220f946968890c39887fcd102 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:55:01 UTC) from {username='slave'} at 127.0.0.1:54698
I20260808 14:55:01.221845 17703 tablet_service.cc:1514] Processing DeleteTablet for tablet 8e779cc220f946968890c39887fcd102 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:55:01 UTC) from {username='slave'} at 127.0.0.1:42432
I20260808 14:55:01.222030 17846 tablet_service.cc:1514] Processing DeleteTablet for tablet 8e779cc220f946968890c39887fcd102 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:55:01 UTC) from {username='slave'} at 127.0.0.1:55016
I20260808 14:55:01.223202 17961 tablet_replica.cc:330] T 8e779cc220f946968890c39887fcd102 P 3bb80ccaa90c46a7bc52647ee8610bc0: stopping tablet replica
I20260808 14:55:01.223194 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 17492
I20260808 14:55:01.223802 17961 raft_consensus.cc:2229] T 8e779cc220f946968890c39887fcd102 P 3bb80ccaa90c46a7bc52647ee8610bc0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:55:01.224485 17961 raft_consensus.cc:2258] T 8e779cc220f946968890c39887fcd102 P 3bb80ccaa90c46a7bc52647ee8610bc0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:55:01.229915 17961 ts_tablet_manager.cc:1905] T 8e779cc220f946968890c39887fcd102 P 3bb80ccaa90c46a7bc52647ee8610bc0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:55:01.232038 17959 tablet_replica.cc:330] T 8e779cc220f946968890c39887fcd102 P 81710886ea2446219031751df9a3272c: stopping tablet replica
I20260808 14:55:01.232254 17960 tablet_replica.cc:330] T 8e779cc220f946968890c39887fcd102 P 5c39747b17c347b88fb77397dd7a5257: stopping tablet replica
I20260808 14:55:01.232513 17959 raft_consensus.cc:2229] T 8e779cc220f946968890c39887fcd102 P 81710886ea2446219031751df9a3272c [term 1 LEADER]: Raft consensus shutting down.
I20260808 14:55:01.232700 17960 raft_consensus.cc:2229] T 8e779cc220f946968890c39887fcd102 P 5c39747b17c347b88fb77397dd7a5257 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:55:01.233219 17960 raft_consensus.cc:2258] T 8e779cc220f946968890c39887fcd102 P 5c39747b17c347b88fb77397dd7a5257 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:55:01.233861 17959 raft_consensus.cc:2258] T 8e779cc220f946968890c39887fcd102 P 81710886ea2446219031751df9a3272c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:55:01.235661 17960 ts_tablet_manager.cc:1905] T 8e779cc220f946968890c39887fcd102 P 5c39747b17c347b88fb77397dd7a5257: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:55:01.235950 17959 ts_tablet_manager.cc:1905] T 8e779cc220f946968890c39887fcd102 P 81710886ea2446219031751df9a3272c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:55:01.240283 17961 ts_tablet_manager.cc:1918] T 8e779cc220f946968890c39887fcd102 P 3bb80ccaa90c46a7bc52647ee8610bc0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:55:01.240486 17961 log.cc:1196] T 8e779cc220f946968890c39887fcd102 P 3bb80ccaa90c46a7bc52647ee8610bc0: Deleting WAL directory at /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200577490656-27451-0/minicluster-data/ts-2/wal/wals/8e779cc220f946968890c39887fcd102
I20260808 14:55:01.241065 17961 ts_tablet_manager.cc:1939] T 8e779cc220f946968890c39887fcd102 P 3bb80ccaa90c46a7bc52647ee8610bc0: Deleting consensus metadata
I20260808 14:55:01.242865 17407 catalog_manager.cc:4841] TS 3bb80ccaa90c46a7bc52647ee8610bc0 (127.26.206.195:41109): tablet 8e779cc220f946968890c39887fcd102 (table test-table [id=dbaa403bf50742d6b5a547b3bcef6d62]) successfully deleted
I20260808 14:55:01.244051 17959 ts_tablet_manager.cc:1918] T 8e779cc220f946968890c39887fcd102 P 81710886ea2446219031751df9a3272c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:55:01.244289 17959 log.cc:1196] T 8e779cc220f946968890c39887fcd102 P 81710886ea2446219031751df9a3272c: Deleting WAL directory at /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200577490656-27451-0/minicluster-data/ts-0/wal/wals/8e779cc220f946968890c39887fcd102
I20260808 14:55:01.244927 17959 ts_tablet_manager.cc:1939] T 8e779cc220f946968890c39887fcd102 P 81710886ea2446219031751df9a3272c: Deleting consensus metadata
I20260808 14:55:01.245687 17928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:01.225481 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54708 (local address 127.26.206.193:39055)
0808 14:55:01.225684 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0808 14:55:01.225692 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:55:01.236934 (+ 11242us) server_negotiation.cc:407] Connection header received
0808 14:55:01.237420 (+ 486us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:55:01.237426 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:55:01.237531 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:55:01.237616 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:55:01.238318 (+ 702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:01.239627 (+ 1309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:01.241643 (+ 2016us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:01.242339 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:01.242442 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:55:01.244011 (+ 1569us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:55:01.244022 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:55:01.244040 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:55:01.244794 (+ 754us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:55:01.244857 (+ 63us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:55:01.244883 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:55:01.244962 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0808 14:55:01.245206 (+ 244us) server_negotiation.cc:299] Negotiation successful
0808 14:55:01.245322 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260808 14:55:01.246806 17624 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:55:01.246899 17408 catalog_manager.cc:4841] TS 81710886ea2446219031751df9a3272c (127.26.206.193:39055): tablet 8e779cc220f946968890c39887fcd102 (table test-table [id=dbaa403bf50742d6b5a547b3bcef6d62]) successfully deleted
I20260808 14:55:01.251890 17960 ts_tablet_manager.cc:1918] T 8e779cc220f946968890c39887fcd102 P 5c39747b17c347b88fb77397dd7a5257: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:55:01.252038 17960 log.cc:1196] T 8e779cc220f946968890c39887fcd102 P 5c39747b17c347b88fb77397dd7a5257: Deleting WAL directory at /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200577490656-27451-0/minicluster-data/ts-1/wal/wals/8e779cc220f946968890c39887fcd102
I20260808 14:55:01.252616 17960 ts_tablet_manager.cc:1939] T 8e779cc220f946968890c39887fcd102 P 5c39747b17c347b88fb77397dd7a5257: Deleting consensus metadata
I20260808 14:55:01.254179 17406 catalog_manager.cc:4841] TS 5c39747b17c347b88fb77397dd7a5257 (127.26.206.194:33533): tablet 8e779cc220f946968890c39887fcd102 (table test-table [id=dbaa403bf50742d6b5a547b3bcef6d62]) successfully deleted
I20260808 14:55:01.342326 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 17492
I20260808 14:55:01.360796 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 17633
I20260808 14:55:01.372321 17929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:01.361614 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42442 (local address 127.26.206.194:33533)
0808 14:55:01.361801 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0808 14:55:01.361806 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:55:01.361940 (+ 134us) server_negotiation.cc:407] Connection header received
0808 14:55:01.362080 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:55:01.362084 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:55:01.362181 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:55:01.362274 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:55:01.362686 (+ 412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:01.363458 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:01.364826 (+ 1368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:01.365224 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:01.365315 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:55:01.370856 (+ 5541us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:55:01.370864 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:55:01.370878 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:55:01.371486 (+ 608us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:55:01.371548 (+ 62us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:55:01.371790 (+ 242us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:55:01.371885 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0808 14:55:01.371991 (+ 106us) server_negotiation.cc:299] Negotiation successful
0808 14:55:01.372080 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260808 14:55:01.373034 17768 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:55:01.460207 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 17633
I20260808 14:55:01.479993 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 17776
I20260808 14:55:01.486634 17932 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:01.480789 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55020 (local address 127.26.206.195:41109)
0808 14:55:01.480953 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0808 14:55:01.480958 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:55:01.481006 (+ 48us) server_negotiation.cc:407] Connection header received
0808 14:55:01.481158 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:55:01.481162 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:55:01.481254 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:55:01.481347 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:55:01.481792 (+ 445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:01.482539 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:01.483894 (+ 1355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:01.484269 (+ 375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:01.484358 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:55:01.485404 (+ 1046us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:55:01.485411 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:55:01.485426 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:55:01.486021 (+ 595us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:55:01.486066 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:55:01.486084 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:55:01.486179 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0808 14:55:01.486293 (+ 114us) server_negotiation.cc:299] Negotiation successful
0808 14:55:01.486375 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260808 14:55:01.487323 17909 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:55:01.575075 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 17776
I20260808 14:55:01.595935 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 17388
I20260808 14:55:01.597110 17458 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:55:01.707032 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 17388
2026-08-08T14:55:01Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (2721 ms)
[----------] 6 tests from EncryptionPolicyTest (21911 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786200577490656-27451-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:55:01 dist-test-slave-6k22 krb5kdc[17970](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:55:01 dist-test-slave-6k22 krb5kdc[17970](info): set up 2 sockets
Aug 08 14:55:01 dist-test-slave-6k22 krb5kdc[17970](info): commencing operation
krb5kdc: starting...
W20260808 14:55:02.910076 27451 mini_kdc.cc:121] Time spent starting KDC: real 1.152s user 0.001s sys 0.043s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786200577490656-27451-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786200577490656-27451-0/krb5kdc/test-user.keytab.
Aug 08 14:55:03 dist-test-slave-6k22 krb5kdc[17970](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200903, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:55:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:55:03Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786200577490656-27451-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786200577490656-27451-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 14:55:03.209354 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786200577490656-27451-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786200577490656-27451-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786200577490656-27451-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46415
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786200577490656-27451-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39347
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46415
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:55:03.556252 17984 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:55:03.556576 17984 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:55:03.556754 17984 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:55:03.563764 17984 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:55:03.563894 17984 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:55:03.563992 17984 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:55:03.564087 17984 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:55:03.564164 17984 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:55:03.573439 17984 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39347
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786200577490656-27451-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786200577490656-27451-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46415
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786200577490656-27451-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46415
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786200577490656-27451-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:55:03.574658 17984 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:55:03.575922 17984 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:55:03.587880 17990 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:55:03.587777 17989 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:55:03.588006 17992 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:55:03.589313 17984 server_base.cc:1034] running on GCE node
I20260808 14:55:03.590095 17984 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:55:03.591404 17984 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:55:03.592628 17984 hybrid_clock.cc:648] HybridClock initialized: now 1786200903592582 us; error 60 us; skew 500 ppm
I20260808 14:55:03.592999 17984 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:55:03 dist-test-slave-6k22 krb5kdc[17970](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200903, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:55:03.596014 17984 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 14:55:03.597486 17984 webserver.cc:460] Webserver started at http://127.0.0.1:33937/ using document root <none> and password file <none>
I20260808 14:55:03.598109 17984 fs_manager.cc:359] Metadata directory not provided
I20260808 14:55:03.598245 17984 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:55:03.598565 17984 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:55:03.601423 17984 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786200577490656-27451-0/minicluster-data/master-0/data/instance:
uuid: "36120e533edc4c49a852e1b6a770552a"
format_stamp: "Formatted at 2026-08-08 14:55:03 on dist-test-slave-6k22"
server_key: "58de08c1abae20d91904e76fac628383"
server_key_iv: "ede959d72a85cc7e168d8af3c846166d"
server_key_version: "encryptionkey@0"
I20260808 14:55:03.602136 17984 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786200577490656-27451-0/minicluster-data/master-0/wal/instance:
uuid: "36120e533edc4c49a852e1b6a770552a"
format_stamp: "Formatted at 2026-08-08 14:55:03 on dist-test-slave-6k22"
server_key: "58de08c1abae20d91904e76fac628383"
server_key_iv: "ede959d72a85cc7e168d8af3c846166d"
server_key_version: "encryptionkey@0"
I20260808 14:55:03.607034 17984 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260808 14:55:03.610423 18000 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:55:03.611680 17984 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260808 14:55:03.611882 17984 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786200577490656-27451-0/minicluster-data/master-0/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786200577490656-27451-0/minicluster-data/master-0/wal
uuid: "36120e533edc4c49a852e1b6a770552a"
format_stamp: "Formatted at 2026-08-08 14:55:03 on dist-test-slave-6k22"
server_key: "58de08c1abae20d91904e76fac628383"
server_key_iv: "ede959d72a85cc7e168d8af3c846166d"
server_key_version: "encryptionkey@0"
I20260808 14:55:03.612079 17984 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786200577490656-27451-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786200577490656-27451-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786200577490656-27451-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:55:03.625821 17984 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:55:03.629730 17984 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:55:03.630004 17984 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:55:03.648772 17984 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46415
I20260808 14:55:03.648803 18056 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46415 every 8 connection(s)
I20260808 14:55:03.650182 17984 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
I20260808 14:55:03.653894 18057 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:55:03.658669 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 17984
I20260808 14:55:03.658910 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786200577490656-27451-0/minicluster-data/master-0/wal/instance
I20260808 14:55:03.659822 27451 external_mini_cluster.cc:1428] Setting key 72f422eb81840af3332ecd458648a9a9
I20260808 14:55:03.665583 18057 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 36120e533edc4c49a852e1b6a770552a: Bootstrap starting.
I20260808 14:55:03.669348 18057 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 36120e533edc4c49a852e1b6a770552a: Neither blocks nor log segments found. Creating new log.
I20260808 14:55:03.670542 18057 log.cc:824] T 00000000000000000000000000000000 P 36120e533edc4c49a852e1b6a770552a: Log is configured to *not* fsync() on all Append() calls
I20260808 14:55:03.673429 18057 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 36120e533edc4c49a852e1b6a770552a: No bootstrap required, opened a new log
Aug 08 14:55:03 dist-test-slave-6k22 krb5kdc[17970](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200903, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260808 14:55:03.684168 18060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:03.661767 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57185 (local address 127.0.0.1:46415)
0808 14:55:03.662598 (+ 831us) server_negotiation.cc:206] Beginning negotiation
0808 14:55:03.662610 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 14:55:03.662649 (+ 39us) server_negotiation.cc:407] Connection header received
0808 14:55:03.664399 (+ 1750us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:55:03.664421 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:55:03.664783 (+ 362us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:55:03.665082 (+ 299us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:55:03.666807 (+ 1725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:03.668185 (+ 1378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:03.670003 (+ 1818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:03.670675 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:03.670837 (+ 162us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:55:03.675302 (+ 4465us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:55:03.675313 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:55:03.675336 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:55:03.675378 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:55:03.679453 (+ 4075us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:55:03.680208 (+ 755us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:55:03.680227 (+ 19us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:55:03.680236 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:55:03.680450 (+ 214us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:55:03.681010 (+ 560us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:55:03.681015 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:55:03.681019 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:55:03.681731 (+ 712us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:55:03.682076 (+ 345us) server_negotiation.cc:1035] Waiting for connection context
0808 14:55:03.682442 (+ 366us) server_negotiation.cc:299] Negotiation successful
0808 14:55:03.682812 (+ 370us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":607,"thread_start_us":411,"threads_started":1}
I20260808 14:55:03.684299 18057 raft_consensus.cc:348] T 00000000000000000000000000000000 P 36120e533edc4c49a852e1b6a770552a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "36120e533edc4c49a852e1b6a770552a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46415 } }
I20260808 14:55:03.684759 18057 raft_consensus.cc:374] T 00000000000000000000000000000000 P 36120e533edc4c49a852e1b6a770552a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:55:03.684873 18057 raft_consensus.cc:729] T 00000000000000000000000000000000 P 36120e533edc4c49a852e1b6a770552a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36120e533edc4c49a852e1b6a770552a, State: Initialized, Role: FOLLOWER
I20260808 14:55:03.685541 18057 consensus_queue.cc:260] T 00000000000000000000000000000000 P 36120e533edc4c49a852e1b6a770552a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "36120e533edc4c49a852e1b6a770552a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46415 } }
I20260808 14:55:03.685865 18057 raft_consensus.cc:388] T 00000000000000000000000000000000 P 36120e533edc4c49a852e1b6a770552a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:55:03.686008 18057 raft_consensus.cc:482] T 00000000000000000000000000000000 P 36120e533edc4c49a852e1b6a770552a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:55:03.686213 18057 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 36120e533edc4c49a852e1b6a770552a [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:55:03.688552 27451 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:55:03.689067 18057 raft_consensus.cc:504] T 00000000000000000000000000000000 P 36120e533edc4c49a852e1b6a770552a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "36120e533edc4c49a852e1b6a770552a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46415 } }
I20260808 14:55:03.689532 18057 leader_election.cc:302] T 00000000000000000000000000000000 P 36120e533edc4c49a852e1b6a770552a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 36120e533edc4c49a852e1b6a770552a; no voters:
I20260808 14:55:03.690155 18057 leader_election.cc:288] T 00000000000000000000000000000000 P 36120e533edc4c49a852e1b6a770552a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:55:03.690315 18062 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 36120e533edc4c49a852e1b6a770552a [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:55:03.690968 18062 raft_consensus.cc:686] T 00000000000000000000000000000000 P 36120e533edc4c49a852e1b6a770552a [term 1 LEADER]: Becoming Leader. State: Replica: 36120e533edc4c49a852e1b6a770552a, State: Running, Role: LEADER
I20260808 14:55:03.691632 18062 consensus_queue.cc:237] T 00000000000000000000000000000000 P 36120e533edc4c49a852e1b6a770552a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "36120e533edc4c49a852e1b6a770552a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46415 } }
I20260808 14:55:03.694975 18064 sys_catalog.cc:455] T 00000000000000000000000000000000 P 36120e533edc4c49a852e1b6a770552a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "36120e533edc4c49a852e1b6a770552a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "36120e533edc4c49a852e1b6a770552a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46415 } } }
I20260808 14:55:03.695518 18064 sys_catalog.cc:458] T 00000000000000000000000000000000 P 36120e533edc4c49a852e1b6a770552a [sys.catalog]: This master's current role is: LEADER
I20260808 14:55:03.697108 18062 sys_catalog.cc:455] T 00000000000000000000000000000000 P 36120e533edc4c49a852e1b6a770552a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 36120e533edc4c49a852e1b6a770552a. Latest consensus state: current_term: 1 leader_uuid: "36120e533edc4c49a852e1b6a770552a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "36120e533edc4c49a852e1b6a770552a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46415 } } }
I20260808 14:55:03.697744 18062 sys_catalog.cc:458] T 00000000000000000000000000000000 P 36120e533edc4c49a852e1b6a770552a [sys.catalog]: This master's current role is: LEADER
I20260808 14:55:03.703526 18057 sys_catalog.cc:564] T 00000000000000000000000000000000 P 36120e533edc4c49a852e1b6a770552a [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:55:03.703787 18068 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:55:03.711625 18068 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:55:03.723170 18060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:03.703202 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38387 (local address 127.0.0.1:46415)
0808 14:55:03.703376 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0808 14:55:03.703382 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:55:03.703850 (+ 468us) server_negotiation.cc:407] Connection header received
0808 14:55:03.704058 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:55:03.704063 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:55:03.704141 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:55:03.704248 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:55:03.705753 (+ 1505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:03.707438 (+ 1685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:03.709428 (+ 1990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:03.710127 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:03.710245 (+ 118us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:55:03.713689 (+ 3444us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:55:03.713700 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:55:03.713706 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:55:03.713748 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:55:03.717782 (+ 4034us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:55:03.718826 (+ 1044us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:55:03.718832 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:55:03.718836 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:55:03.718974 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:55:03.719571 (+ 597us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:55:03.719576 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:55:03.719579 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:55:03.720045 (+ 466us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:55:03.720306 (+ 261us) server_negotiation.cc:1035] Waiting for connection context
0808 14:55:03.722600 (+ 2294us) server_negotiation.cc:299] Negotiation successful
0808 14:55:03.722796 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":68}
I20260808 14:55:03.726017 18068 catalog_manager.cc:1347] Generated new cluster ID: a79472d79b8d4a66b4dda1a4f98b62f7
I20260808 14:55:03.726136 18068 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:55:03.748638 18068 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:55:03.750097 18068 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:55:03.757910 18068 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 36120e533edc4c49a852e1b6a770552a: Generated new TSK 0
I20260808 14:55:03.758709 18068 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:55:03.773116 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 17984
I20260808 14:55:03.774256 18052 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:55:03.864776 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 17984
W20260808 14:55:03.885387 17968 connection.cc:535] client connection to 127.0.0.1:46415 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:46415): Connection reset by peer (error 104)
2026-08-08T14:55:03Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (2147 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786200577490656-27451-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:55:03 dist-test-slave-6k22 krb5kdc[18092](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:55:03 dist-test-slave-6k22 krb5kdc[18092](info): set up 2 sockets
Aug 08 14:55:03 dist-test-slave-6k22 krb5kdc[18092](info): commencing operation
krb5kdc: starting...
W20260808 14:55:05.029522 27451 mini_kdc.cc:121] Time spent starting KDC: real 1.125s user 0.000s sys 0.041s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786200577490656-27451-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786200577490656-27451-0/krb5kdc/test-user.keytab.
Aug 08 14:55:05 dist-test-slave-6k22 krb5kdc[18092](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200905, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:55:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:55:05Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786200577490656-27451-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786200577490656-27451-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 14:55:05.333204 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786200577490656-27451-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786200577490656-27451-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786200577490656-27451-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33715
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786200577490656-27451-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39709
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:33715
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:55:05.668915 18105 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:55:05.669263 18105 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:55:05.669440 18105 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:55:05.676520 18105 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:55:05.676666 18105 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:55:05.676780 18105 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:55:05.676883 18105 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:55:05.676970 18105 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:55:05.686590 18105 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39709
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786200577490656-27451-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786200577490656-27451-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:33715
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786200577490656-27451-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33715
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786200577490656-27451-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:55:05.687836 18105 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:55:05.689103 18105 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:55:05.701035 18110 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:55:05.701069 18114 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:55:05.701141 18111 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:55:05.702116 18105 server_base.cc:1034] running on GCE node
I20260808 14:55:05.702822 18105 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:55:05.704195 18105 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:55:05.705426 18105 hybrid_clock.cc:648] HybridClock initialized: now 1786200905705396 us; error 39 us; skew 500 ppm
I20260808 14:55:05.705786 18105 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:55:05 dist-test-slave-6k22 krb5kdc[18092](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200905, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:55:05.708910 18105 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 14:55:05.710425 18105 webserver.cc:460] Webserver started at http://127.0.0.1:43147/ using document root <none> and password file <none>
I20260808 14:55:05.711073 18105 fs_manager.cc:359] Metadata directory not provided
I20260808 14:55:05.711220 18105 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:55:05.711632 18105 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:55:05.714488 18105 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786200577490656-27451-0/minicluster-data/master-0/data/instance:
uuid: "57b00732c231463dba29e360e8727e45"
format_stamp: "Formatted at 2026-08-08 14:55:05 on dist-test-slave-6k22"
server_key: "f74786946133c7c3dd263e25a4c2f5f6"
server_key_iv: "8f8a1b8e2a56d000f9e9836b0ba9f9f6"
server_key_version: "encryptionkey@0"
I20260808 14:55:05.715236 18105 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786200577490656-27451-0/minicluster-data/master-0/wal/instance:
uuid: "57b00732c231463dba29e360e8727e45"
format_stamp: "Formatted at 2026-08-08 14:55:05 on dist-test-slave-6k22"
server_key: "f74786946133c7c3dd263e25a4c2f5f6"
server_key_iv: "8f8a1b8e2a56d000f9e9836b0ba9f9f6"
server_key_version: "encryptionkey@0"
I20260808 14:55:05.720715 18105 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.002s
I20260808 14:55:05.724143 18121 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:55:05.725397 18105 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 14:55:05.725605 18105 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786200577490656-27451-0/minicluster-data/master-0/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786200577490656-27451-0/minicluster-data/master-0/wal
uuid: "57b00732c231463dba29e360e8727e45"
format_stamp: "Formatted at 2026-08-08 14:55:05 on dist-test-slave-6k22"
server_key: "f74786946133c7c3dd263e25a4c2f5f6"
server_key_iv: "8f8a1b8e2a56d000f9e9836b0ba9f9f6"
server_key_version: "encryptionkey@0"
I20260808 14:55:05.725809 18105 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786200577490656-27451-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786200577490656-27451-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786200577490656-27451-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:55:05.755044 18105 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:55:05.759003 18105 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:55:05.759305 18105 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:55:05.777848 18105 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:33715
I20260808 14:55:05.777927 18174 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:33715 every 8 connection(s)
I20260808 14:55:05.779203 18105 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
I20260808 14:55:05.782743 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 18105
I20260808 14:55:05.782845 18175 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:55:05.782963 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786200577490656-27451-0/minicluster-data/master-0/wal/instance
I20260808 14:55:05.783416 27451 external_mini_cluster.cc:1428] Setting key dd6dacbe4b19ede9f70c140f8ee8dfdc
I20260808 14:55:05.797938 18178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:05.785233 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52937 (local address 127.0.0.1:33715)
0808 14:55:05.786066 (+ 833us) server_negotiation.cc:206] Beginning negotiation
0808 14:55:05.786081 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 14:55:05.786132 (+ 51us) server_negotiation.cc:407] Connection header received
0808 14:55:05.788009 (+ 1877us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:55:05.788036 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:55:05.788512 (+ 476us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:55:05.788944 (+ 432us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:55:05.789440 (+ 496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:05.791389 (+ 1949us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:05.792856 (+ 1467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:05.793915 (+ 1059us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:05.794094 (+ 179us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:55:05.795257 (+ 1163us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:55:05.795267 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:55:05.795283 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:55:05.795996 (+ 713us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:55:05.796082 (+ 86us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:55:05.796111 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:55:05.796256 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0808 14:55:05.796527 (+ 271us) server_negotiation.cc:299] Negotiation successful
0808 14:55:05.796680 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":578,"thread_start_us":353,"threads_started":1}
I20260808 14:55:05.797988 18175 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 57b00732c231463dba29e360e8727e45: Bootstrap starting.
I20260808 14:55:05.801167 18175 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 57b00732c231463dba29e360e8727e45: Neither blocks nor log segments found. Creating new log.
I20260808 14:55:05.801699 27451 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:55:05.802383 18175 log.cc:824] T 00000000000000000000000000000000 P 57b00732c231463dba29e360e8727e45: Log is configured to *not* fsync() on all Append() calls
I20260808 14:55:05.805627 18175 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 57b00732c231463dba29e360e8727e45: No bootstrap required, opened a new log
I20260808 14:55:05.813257 18178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:05.806807 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43017 (local address 127.0.0.1:33715)
0808 14:55:05.806972 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0808 14:55:05.806978 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:55:05.807270 (+ 292us) server_negotiation.cc:407] Connection header received
0808 14:55:05.807418 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:55:05.807425 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:55:05.807506 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:55:05.807635 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:55:05.808111 (+ 476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:05.809281 (+ 1170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:05.810627 (+ 1346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:05.811343 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:05.811470 (+ 127us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:55:05.812534 (+ 1064us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:55:05.812540 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:55:05.812545 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:55:05.812563 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:55:05.812611 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:55:05.812630 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:55:05.812741 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0808 14:55:05.812877 (+ 136us) server_negotiation.cc:299] Negotiation successful
0808 14:55:05.812929 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260808 14:55:05.815703 18175 raft_consensus.cc:348] T 00000000000000000000000000000000 P 57b00732c231463dba29e360e8727e45 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57b00732c231463dba29e360e8727e45" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33715 } }
I20260808 14:55:05.816036 18175 raft_consensus.cc:374] T 00000000000000000000000000000000 P 57b00732c231463dba29e360e8727e45 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:55:05.816141 18175 raft_consensus.cc:729] T 00000000000000000000000000000000 P 57b00732c231463dba29e360e8727e45 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57b00732c231463dba29e360e8727e45, State: Initialized, Role: FOLLOWER
I20260808 14:55:05.816684 18175 consensus_queue.cc:260] T 00000000000000000000000000000000 P 57b00732c231463dba29e360e8727e45 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57b00732c231463dba29e360e8727e45" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33715 } }
I20260808 14:55:05.816919 18175 raft_consensus.cc:388] T 00000000000000000000000000000000 P 57b00732c231463dba29e360e8727e45 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:55:05.817063 18175 raft_consensus.cc:482] T 00000000000000000000000000000000 P 57b00732c231463dba29e360e8727e45 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:55:05.817225 18175 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 57b00732c231463dba29e360e8727e45 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:55:05.819379 18175 raft_consensus.cc:504] T 00000000000000000000000000000000 P 57b00732c231463dba29e360e8727e45 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57b00732c231463dba29e360e8727e45" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33715 } }
I20260808 14:55:05.819942 18175 leader_election.cc:302] T 00000000000000000000000000000000 P 57b00732c231463dba29e360e8727e45 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 57b00732c231463dba29e360e8727e45; no voters:
I20260808 14:55:05.820427 18175 leader_election.cc:288] T 00000000000000000000000000000000 P 57b00732c231463dba29e360e8727e45 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:55:05.820569 18185 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 57b00732c231463dba29e360e8727e45 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:55:05.821362 18185 raft_consensus.cc:686] T 00000000000000000000000000000000 P 57b00732c231463dba29e360e8727e45 [term 1 LEADER]: Becoming Leader. State: Replica: 57b00732c231463dba29e360e8727e45, State: Running, Role: LEADER
I20260808 14:55:05.821911 18185 consensus_queue.cc:237] T 00000000000000000000000000000000 P 57b00732c231463dba29e360e8727e45 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57b00732c231463dba29e360e8727e45" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33715 } }
I20260808 14:55:05.822503 18175 sys_catalog.cc:564] T 00000000000000000000000000000000 P 57b00732c231463dba29e360e8727e45 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:55:05.824764 18188 sys_catalog.cc:455] T 00000000000000000000000000000000 P 57b00732c231463dba29e360e8727e45 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 57b00732c231463dba29e360e8727e45. Latest consensus state: current_term: 1 leader_uuid: "57b00732c231463dba29e360e8727e45" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57b00732c231463dba29e360e8727e45" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33715 } } }
I20260808 14:55:05.824873 18187 sys_catalog.cc:455] T 00000000000000000000000000000000 P 57b00732c231463dba29e360e8727e45 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "57b00732c231463dba29e360e8727e45" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57b00732c231463dba29e360e8727e45" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33715 } } }
I20260808 14:55:05.825166 18188 sys_catalog.cc:458] T 00000000000000000000000000000000 P 57b00732c231463dba29e360e8727e45 [sys.catalog]: This master's current role is: LEADER
I20260808 14:55:05.825253 18187 sys_catalog.cc:458] T 00000000000000000000000000000000 P 57b00732c231463dba29e360e8727e45 [sys.catalog]: This master's current role is: LEADER
I20260808 14:55:05.826156 18194 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:55:05.832653 18194 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:55:05.841182 18194 catalog_manager.cc:1347] Generated new cluster ID: 1d56265818534aa6819de73497db8f72
I20260808 14:55:05.841291 18194 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:55:05.864120 18194 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:55:05.865407 18194 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:55:05.877149 18194 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 57b00732c231463dba29e360e8727e45: Generated new TSK 0
I20260808 14:55:05.877952 18194 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:55:05.889568 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 18105
W20260808 14:55:05.890664 18170 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:52937
W20260808 14:55:05.891388 27451 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 18105: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 14:55:05.891604 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 18105
W20260808 14:55:05.911940 18089 connection.cc:535] client connection to 127.0.0.1:33715 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:33715): Connection reset by peer (error 104)
2026-08-08T14:55:05Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (2026 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786200577490656-27451-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:55:06 dist-test-slave-6k22 krb5kdc[18208](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:55:06 dist-test-slave-6k22 krb5kdc[18208](info): set up 2 sockets
Aug 08 14:55:06 dist-test-slave-6k22 krb5kdc[18208](info): commencing operation
krb5kdc: starting...
W20260808 14:55:07.073218 27451 mini_kdc.cc:121] Time spent starting KDC: real 1.142s user 0.004s sys 0.038s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786200577490656-27451-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786200577490656-27451-0/krb5kdc/test-user.keytab.
Aug 08 14:55:07 dist-test-slave-6k22 krb5kdc[18208](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200907, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:55:07Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:55:07Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786200577490656-27451-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786200577490656-27451-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 14:55:07.378485 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786200577490656-27451-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786200577490656-27451-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786200577490656-27451-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34727
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786200577490656-27451-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41693
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34727
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:55:07.712523 18224 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:55:07.712787 18224 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:55:07.712877 18224 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:55:07.719828 18224 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:55:07.719930 18224 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:55:07.719982 18224 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:55:07.720049 18224 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:55:07.720091 18224 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:55:07.729242 18224 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41693
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786200577490656-27451-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786200577490656-27451-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34727
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786200577490656-27451-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34727
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786200577490656-27451-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:55:07.730409 18224 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:55:07.731664 18224 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:55:07.743476 18230 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:55:07.743480 18231 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:55:07.743872 18233 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:55:07.744519 18224 server_base.cc:1034] running on GCE node
I20260808 14:55:07.745282 18224 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:55:07.746572 18224 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:55:07.747803 18224 hybrid_clock.cc:648] HybridClock initialized: now 1786200907747777 us; error 38 us; skew 500 ppm
I20260808 14:55:07.748147 18224 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:55:07 dist-test-slave-6k22 krb5kdc[18208](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200907, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:55:07.754700 18224 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 14:55:07.756214 18224 webserver.cc:460] Webserver started at http://127.0.0.1:42121/ using document root <none> and password file <none>
I20260808 14:55:07.756861 18224 fs_manager.cc:359] Metadata directory not provided
I20260808 14:55:07.757009 18224 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:55:07.757326 18224 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:55:07.760289 18224 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786200577490656-27451-0/minicluster-data/master-0/data/instance:
uuid: "198333ff23b84a34b7188087d318d5db"
format_stamp: "Formatted at 2026-08-08 14:55:07 on dist-test-slave-6k22"
server_key: "11a7979634e023dbd7333f80e1029d54"
server_key_iv: "6e68caf5dbc4d161d50322de9433c16c"
server_key_version: "encryptionkey@0"
I20260808 14:55:07.761046 18224 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786200577490656-27451-0/minicluster-data/master-0/wal/instance:
uuid: "198333ff23b84a34b7188087d318d5db"
format_stamp: "Formatted at 2026-08-08 14:55:07 on dist-test-slave-6k22"
server_key: "11a7979634e023dbd7333f80e1029d54"
server_key_iv: "6e68caf5dbc4d161d50322de9433c16c"
server_key_version: "encryptionkey@0"
I20260808 14:55:07.765967 18224 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260808 14:55:07.769258 18240 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:55:07.770498 18224 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 14:55:07.770684 18224 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786200577490656-27451-0/minicluster-data/master-0/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786200577490656-27451-0/minicluster-data/master-0/wal
uuid: "198333ff23b84a34b7188087d318d5db"
format_stamp: "Formatted at 2026-08-08 14:55:07 on dist-test-slave-6k22"
server_key: "11a7979634e023dbd7333f80e1029d54"
server_key_iv: "6e68caf5dbc4d161d50322de9433c16c"
server_key_version: "encryptionkey@0"
I20260808 14:55:07.770880 18224 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786200577490656-27451-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786200577490656-27451-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786200577490656-27451-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:55:07.776544 18224 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:55:07.780313 18224 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:55:07.780596 18224 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:55:07.798574 18224 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34727
I20260808 14:55:07.798651 18293 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34727 every 8 connection(s)
I20260808 14:55:07.799933 18224 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
I20260808 14:55:07.803324 18294 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:55:07.808192 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 18224
I20260808 14:55:07.808379 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786200577490656-27451-0/minicluster-data/master-0/wal/instance
I20260808 14:55:07.808826 27451 external_mini_cluster.cc:1428] Setting key 3b8dbdbc1eca09f1fd1915aacb28b77e
I20260808 14:55:07.813531 18294 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 198333ff23b84a34b7188087d318d5db: Bootstrap starting.
I20260808 14:55:07.816361 18297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:07.810544 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39807 (local address 127.0.0.1:34727)
0808 14:55:07.811400 (+ 856us) server_negotiation.cc:206] Beginning negotiation
0808 14:55:07.811410 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 14:55:07.811450 (+ 40us) server_negotiation.cc:407] Connection header received
0808 14:55:07.813128 (+ 1678us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:55:07.813149 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:55:07.813453 (+ 304us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:55:07.813832 (+ 379us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:55:07.814818 (+ 986us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:55:07.814823 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:55:07.814838 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:55:07.814851 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:55:07.814904 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:55:07.814922 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:55:07.815153 (+ 231us) server_negotiation.cc:1035] Waiting for connection context
0808 14:55:07.815307 (+ 154us) server_negotiation.cc:299] Negotiation successful
0808 14:55:07.815485 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":644,"thread_start_us":401,"threads_started":1}
I20260808 14:55:07.816847 18294 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 198333ff23b84a34b7188087d318d5db: Neither blocks nor log segments found. Creating new log.
I20260808 14:55:07.817893 18294 log.cc:824] T 00000000000000000000000000000000 P 198333ff23b84a34b7188087d318d5db: Log is configured to *not* fsync() on all Append() calls
I20260808 14:55:07.819972 27451 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:55:07.820700 18294 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 198333ff23b84a34b7188087d318d5db: No bootstrap required, opened a new log
I20260808 14:55:07.826750 18297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:07.824271 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44473 (local address 127.0.0.1:34727)
0808 14:55:07.824499 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0808 14:55:07.824528 (+ 29us) server_negotiation.cc:399] Waiting for connection header
0808 14:55:07.824960 (+ 432us) server_negotiation.cc:407] Connection header received
0808 14:55:07.825100 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:55:07.825103 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:55:07.825142 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:55:07.825217 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:55:07.826120 (+ 903us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:55:07.826124 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:55:07.826126 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:55:07.826140 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:55:07.826177 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:55:07.826191 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:55:07.826289 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0808 14:55:07.826413 (+ 124us) server_negotiation.cc:299] Negotiation successful
0808 14:55:07.826454 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260808 14:55:07.829392 18294 raft_consensus.cc:348] T 00000000000000000000000000000000 P 198333ff23b84a34b7188087d318d5db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "198333ff23b84a34b7188087d318d5db" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34727 } }
I20260808 14:55:07.829749 18294 raft_consensus.cc:374] T 00000000000000000000000000000000 P 198333ff23b84a34b7188087d318d5db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:55:07.829873 18294 raft_consensus.cc:729] T 00000000000000000000000000000000 P 198333ff23b84a34b7188087d318d5db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 198333ff23b84a34b7188087d318d5db, State: Initialized, Role: FOLLOWER
I20260808 14:55:07.830382 18294 consensus_queue.cc:260] T 00000000000000000000000000000000 P 198333ff23b84a34b7188087d318d5db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "198333ff23b84a34b7188087d318d5db" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34727 } }
I20260808 14:55:07.830616 18294 raft_consensus.cc:388] T 00000000000000000000000000000000 P 198333ff23b84a34b7188087d318d5db [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:55:07.830757 18294 raft_consensus.cc:482] T 00000000000000000000000000000000 P 198333ff23b84a34b7188087d318d5db [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:55:07.830946 18294 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 198333ff23b84a34b7188087d318d5db [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:55:07.833161 18294 raft_consensus.cc:504] T 00000000000000000000000000000000 P 198333ff23b84a34b7188087d318d5db [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "198333ff23b84a34b7188087d318d5db" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34727 } }
I20260808 14:55:07.833659 18294 leader_election.cc:302] T 00000000000000000000000000000000 P 198333ff23b84a34b7188087d318d5db [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 198333ff23b84a34b7188087d318d5db; no voters:
I20260808 14:55:07.834364 18294 leader_election.cc:288] T 00000000000000000000000000000000 P 198333ff23b84a34b7188087d318d5db [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:55:07.834499 18304 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 198333ff23b84a34b7188087d318d5db [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:55:07.835203 18304 raft_consensus.cc:686] T 00000000000000000000000000000000 P 198333ff23b84a34b7188087d318d5db [term 1 LEADER]: Becoming Leader. State: Replica: 198333ff23b84a34b7188087d318d5db, State: Running, Role: LEADER
I20260808 14:55:07.835780 18304 consensus_queue.cc:237] T 00000000000000000000000000000000 P 198333ff23b84a34b7188087d318d5db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "198333ff23b84a34b7188087d318d5db" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34727 } }
I20260808 14:55:07.836452 18294 sys_catalog.cc:564] T 00000000000000000000000000000000 P 198333ff23b84a34b7188087d318d5db [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:55:07.838487 18306 sys_catalog.cc:455] T 00000000000000000000000000000000 P 198333ff23b84a34b7188087d318d5db [sys.catalog]: SysCatalogTable state changed. Reason: New leader 198333ff23b84a34b7188087d318d5db. Latest consensus state: current_term: 1 leader_uuid: "198333ff23b84a34b7188087d318d5db" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "198333ff23b84a34b7188087d318d5db" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34727 } } }
I20260808 14:55:07.838883 18306 sys_catalog.cc:458] T 00000000000000000000000000000000 P 198333ff23b84a34b7188087d318d5db [sys.catalog]: This master's current role is: LEADER
I20260808 14:55:07.839490 18305 sys_catalog.cc:455] T 00000000000000000000000000000000 P 198333ff23b84a34b7188087d318d5db [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "198333ff23b84a34b7188087d318d5db" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "198333ff23b84a34b7188087d318d5db" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34727 } } }
I20260808 14:55:07.839800 18305 sys_catalog.cc:458] T 00000000000000000000000000000000 P 198333ff23b84a34b7188087d318d5db [sys.catalog]: This master's current role is: LEADER
I20260808 14:55:07.839931 18311 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:55:07.848320 18311 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:55:07.856889 18311 catalog_manager.cc:1347] Generated new cluster ID: e10449c926d84171827d06c63537e0ee
I20260808 14:55:07.857025 18311 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:55:07.873061 18311 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:55:07.873520 18311 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:55:07.881857 18311 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 198333ff23b84a34b7188087d318d5db: Generated new TSK 0
I20260808 14:55:07.882709 18311 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:55:07.893144 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 18224
W20260808 14:55:07.894708 18289 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:39807
W20260808 14:55:07.895378 27451 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 18224: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 14:55:07.895538 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 18224
2026-08-08T14:55:07Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (2004 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786200577490656-27451-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:55:08 dist-test-slave-6k22 krb5kdc[18327](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:55:08 dist-test-slave-6k22 krb5kdc[18327](info): set up 2 sockets
Aug 08 14:55:08 dist-test-slave-6k22 krb5kdc[18327](info): commencing operation
krb5kdc: starting...
W20260808 14:55:09.079819 27451 mini_kdc.cc:121] Time spent starting KDC: real 1.144s user 0.002s sys 0.040s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786200577490656-27451-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786200577490656-27451-0/krb5kdc/test-user.keytab.
Aug 08 14:55:09 dist-test-slave-6k22 krb5kdc[18327](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200909, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:55:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:55:09Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786200577490656-27451-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786200577490656-27451-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 14:55:09.392504 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786200577490656-27451-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786200577490656-27451-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786200577490656-27451-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33121
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786200577490656-27451-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37711
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:33121
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:55:09.729149 18340 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:55:09.729491 18340 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:55:09.729658 18340 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:55:09.736881 18340 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:55:09.737037 18340 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:55:09.737138 18340 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:55:09.737246 18340 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:55:09.737326 18340 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:55:09.746925 18340 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37711
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786200577490656-27451-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786200577490656-27451-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:33121
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786200577490656-27451-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33121
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786200577490656-27451-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:55:09.748201 18340 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:55:09.749521 18340 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:55:09.761632 18346 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:55:09.761565 18348 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:55:09.761739 18345 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:55:09.762701 18340 server_base.cc:1034] running on GCE node
I20260808 14:55:09.763482 18340 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:55:09.764801 18340 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:55:09.766009 18340 hybrid_clock.cc:648] HybridClock initialized: now 1786200909765966 us; error 38 us; skew 500 ppm
I20260808 14:55:09.766360 18340 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:55:09 dist-test-slave-6k22 krb5kdc[18327](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200909, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:55:09.769443 18340 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 14:55:09.770884 18340 webserver.cc:460] Webserver started at http://127.0.0.1:44289/ using document root <none> and password file <none>
I20260808 14:55:09.771538 18340 fs_manager.cc:359] Metadata directory not provided
I20260808 14:55:09.771751 18340 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:55:09.772063 18340 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:55:09.774982 18340 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786200577490656-27451-0/minicluster-data/master-0/data/instance:
uuid: "11c55bbbf5f94b0ea51697e31ee6aa23"
format_stamp: "Formatted at 2026-08-08 14:55:09 on dist-test-slave-6k22"
server_key: "52c3250659b98d7e8b181123ed7235c9"
server_key_iv: "cd5fba37fa420f63692624390970bb52"
server_key_version: "encryptionkey@0"
I20260808 14:55:09.775802 18340 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786200577490656-27451-0/minicluster-data/master-0/wal/instance:
uuid: "11c55bbbf5f94b0ea51697e31ee6aa23"
format_stamp: "Formatted at 2026-08-08 14:55:09 on dist-test-slave-6k22"
server_key: "52c3250659b98d7e8b181123ed7235c9"
server_key_iv: "cd5fba37fa420f63692624390970bb52"
server_key_version: "encryptionkey@0"
I20260808 14:55:09.780699 18340 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260808 14:55:09.784157 18355 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:55:09.785372 18340 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 14:55:09.785548 18340 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786200577490656-27451-0/minicluster-data/master-0/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786200577490656-27451-0/minicluster-data/master-0/wal
uuid: "11c55bbbf5f94b0ea51697e31ee6aa23"
format_stamp: "Formatted at 2026-08-08 14:55:09 on dist-test-slave-6k22"
server_key: "52c3250659b98d7e8b181123ed7235c9"
server_key_iv: "cd5fba37fa420f63692624390970bb52"
server_key_version: "encryptionkey@0"
I20260808 14:55:09.785735 18340 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786200577490656-27451-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786200577490656-27451-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786200577490656-27451-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:55:09.817158 18340 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:55:09.821134 18340 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:55:09.821440 18340 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:55:09.841809 18340 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:33121
I20260808 14:55:09.841832 18410 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:33121 every 8 connection(s)
I20260808 14:55:09.843259 18340 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
I20260808 14:55:09.844342 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 18340
I20260808 14:55:09.844532 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786200577490656-27451-0/minicluster-data/master-0/wal/instance
I20260808 14:55:09.845080 27451 external_mini_cluster.cc:1428] Setting key 78e90f2c7393a754a1323b09c7581fe3
I20260808 14:55:09.847936 18411 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 08 14:55:09 dist-test-slave-6k22 krb5kdc[18327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200909, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260808 14:55:09.861089 18411 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 11c55bbbf5f94b0ea51697e31ee6aa23: Bootstrap starting.
I20260808 14:55:09.864524 18411 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 11c55bbbf5f94b0ea51697e31ee6aa23: Neither blocks nor log segments found. Creating new log.
I20260808 14:55:09.865599 18411 log.cc:824] T 00000000000000000000000000000000 P 11c55bbbf5f94b0ea51697e31ee6aa23: Log is configured to *not* fsync() on all Append() calls
I20260808 14:55:09.868814 18411 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 11c55bbbf5f94b0ea51697e31ee6aa23: No bootstrap required, opened a new log
I20260808 14:55:09.869231 18414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:09.847027 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51533 (local address 127.0.0.1:33121)
0808 14:55:09.847931 (+ 904us) server_negotiation.cc:206] Beginning negotiation
0808 14:55:09.847944 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 14:55:09.848016 (+ 72us) server_negotiation.cc:407] Connection header received
0808 14:55:09.849750 (+ 1734us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:55:09.849770 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:55:09.850178 (+ 408us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:55:09.850517 (+ 339us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:55:09.852304 (+ 1787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:09.853638 (+ 1334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:09.855502 (+ 1864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:09.856228 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:09.856368 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:55:09.861391 (+ 5023us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:55:09.861400 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:55:09.861413 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:55:09.861453 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:55:09.864557 (+ 3104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:55:09.865313 (+ 756us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:55:09.865320 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:55:09.865325 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:55:09.865516 (+ 191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:55:09.865976 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:55:09.865982 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:55:09.865987 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:55:09.866796 (+ 809us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:55:09.867097 (+ 301us) server_negotiation.cc:1035] Waiting for connection context
0808 14:55:09.867696 (+ 599us) server_negotiation.cc:299] Negotiation successful
0808 14:55:09.868102 (+ 406us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":687,"thread_start_us":407,"threads_started":1}
I20260808 14:55:09.873317 27451 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:55:09.879159 18411 raft_consensus.cc:348] T 00000000000000000000000000000000 P 11c55bbbf5f94b0ea51697e31ee6aa23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11c55bbbf5f94b0ea51697e31ee6aa23" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33121 } }
I20260808 14:55:09.879717 18411 raft_consensus.cc:374] T 00000000000000000000000000000000 P 11c55bbbf5f94b0ea51697e31ee6aa23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:55:09.879855 18411 raft_consensus.cc:729] T 00000000000000000000000000000000 P 11c55bbbf5f94b0ea51697e31ee6aa23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11c55bbbf5f94b0ea51697e31ee6aa23, State: Initialized, Role: FOLLOWER
I20260808 14:55:09.880571 18411 consensus_queue.cc:260] T 00000000000000000000000000000000 P 11c55bbbf5f94b0ea51697e31ee6aa23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11c55bbbf5f94b0ea51697e31ee6aa23" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33121 } }
I20260808 14:55:09.880937 18411 raft_consensus.cc:388] T 00000000000000000000000000000000 P 11c55bbbf5f94b0ea51697e31ee6aa23 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:55:09.881106 18411 raft_consensus.cc:482] T 00000000000000000000000000000000 P 11c55bbbf5f94b0ea51697e31ee6aa23 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:55:09.881302 18411 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 11c55bbbf5f94b0ea51697e31ee6aa23 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:55:09.884562 18411 raft_consensus.cc:504] T 00000000000000000000000000000000 P 11c55bbbf5f94b0ea51697e31ee6aa23 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11c55bbbf5f94b0ea51697e31ee6aa23" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33121 } }
I20260808 14:55:09.885259 18411 leader_election.cc:302] T 00000000000000000000000000000000 P 11c55bbbf5f94b0ea51697e31ee6aa23 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 11c55bbbf5f94b0ea51697e31ee6aa23; no voters:
I20260808 14:55:09.886092 18411 leader_election.cc:288] T 00000000000000000000000000000000 P 11c55bbbf5f94b0ea51697e31ee6aa23 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:55:09.886154 18421 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 11c55bbbf5f94b0ea51697e31ee6aa23 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:55:09.886984 18421 raft_consensus.cc:686] T 00000000000000000000000000000000 P 11c55bbbf5f94b0ea51697e31ee6aa23 [term 1 LEADER]: Becoming Leader. State: Replica: 11c55bbbf5f94b0ea51697e31ee6aa23, State: Running, Role: LEADER
I20260808 14:55:09.887550 18421 consensus_queue.cc:237] T 00000000000000000000000000000000 P 11c55bbbf5f94b0ea51697e31ee6aa23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11c55bbbf5f94b0ea51697e31ee6aa23" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33121 } }
I20260808 14:55:09.889402 18421 sys_catalog.cc:455] T 00000000000000000000000000000000 P 11c55bbbf5f94b0ea51697e31ee6aa23 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 11c55bbbf5f94b0ea51697e31ee6aa23. Latest consensus state: current_term: 1 leader_uuid: "11c55bbbf5f94b0ea51697e31ee6aa23" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11c55bbbf5f94b0ea51697e31ee6aa23" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33121 } } }
I20260808 14:55:09.890326 18421 sys_catalog.cc:458] T 00000000000000000000000000000000 P 11c55bbbf5f94b0ea51697e31ee6aa23 [sys.catalog]: This master's current role is: LEADER
I20260808 14:55:09.890945 18423 sys_catalog.cc:455] T 00000000000000000000000000000000 P 11c55bbbf5f94b0ea51697e31ee6aa23 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "11c55bbbf5f94b0ea51697e31ee6aa23" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11c55bbbf5f94b0ea51697e31ee6aa23" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33121 } } }
I20260808 14:55:09.895172 18423 sys_catalog.cc:458] T 00000000000000000000000000000000 P 11c55bbbf5f94b0ea51697e31ee6aa23 [sys.catalog]: This master's current role is: LEADER
I20260808 14:55:09.896175 18411 sys_catalog.cc:564] T 00000000000000000000000000000000 P 11c55bbbf5f94b0ea51697e31ee6aa23 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:55:09.898607 18425 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:55:09.904994 18414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:09.879144 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37381 (local address 127.0.0.1:33121)
0808 14:55:09.879347 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0808 14:55:09.879353 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:55:09.879843 (+ 490us) server_negotiation.cc:407] Connection header received
0808 14:55:09.880037 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:55:09.880042 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:55:09.880111 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:55:09.880229 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:55:09.882528 (+ 2299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:09.883276 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:09.885113 (+ 1837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:09.885648 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:09.885743 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:55:09.890034 (+ 4291us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:55:09.890044 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:55:09.890053 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:55:09.890104 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:55:09.899521 (+ 9417us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:55:09.900513 (+ 992us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:55:09.900521 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:55:09.900528 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:55:09.900796 (+ 268us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:55:09.901460 (+ 664us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:55:09.901468 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:55:09.901473 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:55:09.901936 (+ 463us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:55:09.902301 (+ 365us) server_negotiation.cc:1035] Waiting for connection context
0808 14:55:09.904163 (+ 1862us) server_negotiation.cc:299] Negotiation successful
0808 14:55:09.904480 (+ 317us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260808 14:55:09.912323 18425 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:55:09.921572 18425 catalog_manager.cc:1347] Generated new cluster ID: f99b921520614a7b9eb7d409f6f4935e
I20260808 14:55:09.921725 18425 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:55:09.940665 18425 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:55:09.941942 18425 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:55:09.948642 18425 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 11c55bbbf5f94b0ea51697e31ee6aa23: Generated new TSK 0
I20260808 14:55:09.949697 18425 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:55:09.962059 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 18340
I20260808 14:55:09.963500 18405 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:55:10.054370 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 18340
2026-08-08T14:55:10Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (2159 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786200577490656-27451-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:55:10 dist-test-slave-6k22 krb5kdc[18444](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:55:10 dist-test-slave-6k22 krb5kdc[18444](info): set up 2 sockets
Aug 08 14:55:10 dist-test-slave-6k22 krb5kdc[18444](info): commencing operation
krb5kdc: starting...
W20260808 14:55:11.225464 27451 mini_kdc.cc:121] Time spent starting KDC: real 1.130s user 0.000s sys 0.043s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786200577490656-27451-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786200577490656-27451-0/krb5kdc/test-user.keytab.
Aug 08 14:55:11 dist-test-slave-6k22 krb5kdc[18444](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200911, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:55:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:55:11Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786200577490656-27451-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786200577490656-27451-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 14:55:11.546571 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786200577490656-27451-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786200577490656-27451-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786200577490656-27451-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34069
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786200577490656-27451-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42927
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34069
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:55:11.879590 18460 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:55:11.879856 18460 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:55:11.880069 18460 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:55:11.887149 18460 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:55:11.887282 18460 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:55:11.887368 18460 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:55:11.887485 18460 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:55:11.887586 18460 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:55:11.897001 18460 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42927
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786200577490656-27451-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786200577490656-27451-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34069
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786200577490656-27451-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34069
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786200577490656-27451-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:55:11.898192 18460 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:55:11.899538 18460 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:55:11.911388 18467 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:55:11.911439 18468 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:55:11.911484 18470 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:55:11.912313 18460 server_base.cc:1034] running on GCE node
I20260808 14:55:11.913033 18460 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:55:11.914306 18460 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:55:11.915539 18460 hybrid_clock.cc:648] HybridClock initialized: now 1786200911915495 us; error 59 us; skew 500 ppm
I20260808 14:55:11.915926 18460 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:55:11 dist-test-slave-6k22 krb5kdc[18444](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200911, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:55:11.918931 18460 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 14:55:11.920392 18460 webserver.cc:460] Webserver started at http://127.0.0.1:43347/ using document root <none> and password file <none>
I20260808 14:55:11.921066 18460 fs_manager.cc:359] Metadata directory not provided
I20260808 14:55:11.921219 18460 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:55:11.921523 18460 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:55:11.924402 18460 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786200577490656-27451-0/minicluster-data/master-0/data/instance:
uuid: "2a8fdc3965784bffbcd080114e74a193"
format_stamp: "Formatted at 2026-08-08 14:55:11 on dist-test-slave-6k22"
server_key: "f459b60abbc515b8bb3fb0fd137ee410"
server_key_iv: "653c9081a0b69506b0f172742c295030"
server_key_version: "encryptionkey@0"
I20260808 14:55:11.925168 18460 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786200577490656-27451-0/minicluster-data/master-0/wal/instance:
uuid: "2a8fdc3965784bffbcd080114e74a193"
format_stamp: "Formatted at 2026-08-08 14:55:11 on dist-test-slave-6k22"
server_key: "f459b60abbc515b8bb3fb0fd137ee410"
server_key_iv: "653c9081a0b69506b0f172742c295030"
server_key_version: "encryptionkey@0"
I20260808 14:55:11.930068 18460 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260808 14:55:11.933384 18477 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:55:11.934525 18460 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 14:55:11.934702 18460 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786200577490656-27451-0/minicluster-data/master-0/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786200577490656-27451-0/minicluster-data/master-0/wal
uuid: "2a8fdc3965784bffbcd080114e74a193"
format_stamp: "Formatted at 2026-08-08 14:55:11 on dist-test-slave-6k22"
server_key: "f459b60abbc515b8bb3fb0fd137ee410"
server_key_iv: "653c9081a0b69506b0f172742c295030"
server_key_version: "encryptionkey@0"
I20260808 14:55:11.934911 18460 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786200577490656-27451-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786200577490656-27451-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786200577490656-27451-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:55:11.952353 18460 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:55:11.956072 18460 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:55:11.956363 18460 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:55:11.975165 18460 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34069
I20260808 14:55:11.975207 18533 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34069 every 8 connection(s)
I20260808 14:55:11.976547 18460 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
I20260808 14:55:11.977615 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 18460
I20260808 14:55:11.977813 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786200577490656-27451-0/minicluster-data/master-0/wal/instance
I20260808 14:55:11.978428 27451 external_mini_cluster.cc:1428] Setting key de739c2091ef3f9291159ad73954ce3a
I20260808 14:55:11.981201 18534 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:55:11.990875 18538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:11.980305 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33771 (local address 127.0.0.1:34069)
0808 14:55:11.981018 (+ 713us) server_negotiation.cc:206] Beginning negotiation
0808 14:55:11.981029 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 14:55:11.981067 (+ 38us) server_negotiation.cc:407] Connection header received
0808 14:55:11.982631 (+ 1564us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:55:11.982651 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:55:11.983016 (+ 365us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:55:11.983431 (+ 415us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:55:11.983985 (+ 554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:11.985270 (+ 1285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:11.986589 (+ 1319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:11.987255 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:11.987454 (+ 199us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:55:11.988754 (+ 1300us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:55:11.988761 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:55:11.988776 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:55:11.989307 (+ 531us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:55:11.989377 (+ 70us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:55:11.989403 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:55:11.989553 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0808 14:55:11.989799 (+ 246us) server_negotiation.cc:299] Negotiation successful
0808 14:55:11.990029 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":524,"thread_start_us":320,"threads_started":1}
I20260808 14:55:11.991776 18534 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2a8fdc3965784bffbcd080114e74a193: Bootstrap starting.
I20260808 14:55:11.994371 27451 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:55:11.994907 18534 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2a8fdc3965784bffbcd080114e74a193: Neither blocks nor log segments found. Creating new log.
I20260808 14:55:11.995952 18534 log.cc:824] T 00000000000000000000000000000000 P 2a8fdc3965784bffbcd080114e74a193: Log is configured to *not* fsync() on all Append() calls
I20260808 14:55:11.998497 18534 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2a8fdc3965784bffbcd080114e74a193: No bootstrap required, opened a new log
I20260808 14:55:12.005520 18538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:11.998725 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53809 (local address 127.0.0.1:34069)
0808 14:55:11.998931 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0808 14:55:11.998940 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:55:11.999442 (+ 502us) server_negotiation.cc:407] Connection header received
0808 14:55:11.999689 (+ 247us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:55:11.999694 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:55:11.999771 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:55:11.999896 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:55:12.000500 (+ 604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:12.001224 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:12.003095 (+ 1871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:12.003521 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:12.003695 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:55:12.004773 (+ 1078us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:55:12.004783 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:55:12.004786 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:55:12.004803 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:55:12.004845 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:55:12.004859 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:55:12.004965 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0808 14:55:12.005112 (+ 147us) server_negotiation.cc:299] Negotiation successful
0808 14:55:12.005204 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260808 14:55:12.008001 18534 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2a8fdc3965784bffbcd080114e74a193 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a8fdc3965784bffbcd080114e74a193" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34069 } }
I20260808 14:55:12.008353 18534 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2a8fdc3965784bffbcd080114e74a193 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:55:12.008471 18534 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2a8fdc3965784bffbcd080114e74a193 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a8fdc3965784bffbcd080114e74a193, State: Initialized, Role: FOLLOWER
I20260808 14:55:12.009008 18534 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2a8fdc3965784bffbcd080114e74a193 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a8fdc3965784bffbcd080114e74a193" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34069 } }
I20260808 14:55:12.009230 18534 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2a8fdc3965784bffbcd080114e74a193 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:55:12.009380 18534 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2a8fdc3965784bffbcd080114e74a193 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:55:12.009549 18534 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2a8fdc3965784bffbcd080114e74a193 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:55:12.011863 18534 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2a8fdc3965784bffbcd080114e74a193 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a8fdc3965784bffbcd080114e74a193" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34069 } }
I20260808 14:55:12.012411 18534 leader_election.cc:302] T 00000000000000000000000000000000 P 2a8fdc3965784bffbcd080114e74a193 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2a8fdc3965784bffbcd080114e74a193; no voters:
I20260808 14:55:12.013105 18534 leader_election.cc:288] T 00000000000000000000000000000000 P 2a8fdc3965784bffbcd080114e74a193 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:55:12.013212 18546 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2a8fdc3965784bffbcd080114e74a193 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:55:12.013931 18546 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2a8fdc3965784bffbcd080114e74a193 [term 1 LEADER]: Becoming Leader. State: Replica: 2a8fdc3965784bffbcd080114e74a193, State: Running, Role: LEADER
I20260808 14:55:12.014506 18546 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2a8fdc3965784bffbcd080114e74a193 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a8fdc3965784bffbcd080114e74a193" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34069 } }
I20260808 14:55:12.015398 18534 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2a8fdc3965784bffbcd080114e74a193 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:55:12.017426 18547 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2a8fdc3965784bffbcd080114e74a193 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2a8fdc3965784bffbcd080114e74a193" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a8fdc3965784bffbcd080114e74a193" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34069 } } }
I20260808 14:55:12.017911 18547 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2a8fdc3965784bffbcd080114e74a193 [sys.catalog]: This master's current role is: LEADER
I20260808 14:55:12.017747 18548 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2a8fdc3965784bffbcd080114e74a193 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2a8fdc3965784bffbcd080114e74a193. Latest consensus state: current_term: 1 leader_uuid: "2a8fdc3965784bffbcd080114e74a193" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a8fdc3965784bffbcd080114e74a193" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34069 } } }
I20260808 14:55:12.018057 18548 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2a8fdc3965784bffbcd080114e74a193 [sys.catalog]: This master's current role is: LEADER
I20260808 14:55:12.020991 18553 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:55:12.026266 18553 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:55:12.035197 18553 catalog_manager.cc:1347] Generated new cluster ID: 179c358f6d7344b480d520498e46cdff
I20260808 14:55:12.035358 18553 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:55:12.044837 18553 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:55:12.046630 18553 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:55:12.053841 18553 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2a8fdc3965784bffbcd080114e74a193: Generated new TSK 0
I20260808 14:55:12.054914 18553 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:55:12.067682 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 18460
W20260808 14:55:12.068976 18529 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:33771
W20260808 14:55:12.069741 27451 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 18460: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 14:55:12.069903 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 18460
2026-08-08T14:55:12Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (2014 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786200577490656-27451-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:55:12 dist-test-slave-6k22 krb5kdc[18567](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:55:12 dist-test-slave-6k22 krb5kdc[18567](info): set up 2 sockets
Aug 08 14:55:12 dist-test-slave-6k22 krb5kdc[18567](info): commencing operation
krb5kdc: starting...
W20260808 14:55:13.253939 27451 mini_kdc.cc:121] Time spent starting KDC: real 1.144s user 0.000s sys 0.045s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786200577490656-27451-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786200577490656-27451-0/krb5kdc/test-user.keytab.
Aug 08 14:55:13 dist-test-slave-6k22 krb5kdc[18567](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200913, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:55:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:55:13Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786200577490656-27451-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786200577490656-27451-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 14:55:13.582309 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786200577490656-27451-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786200577490656-27451-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786200577490656-27451-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40565
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786200577490656-27451-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:38863
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40565
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:55:13.921495 18581 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:55:13.921782 18581 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:55:13.921947 18581 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:55:13.928885 18581 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:55:13.928989 18581 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:55:13.929121 18581 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:55:13.929211 18581 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:55:13.929251 18581 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:55:13.938651 18581 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:38863
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786200577490656-27451-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786200577490656-27451-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40565
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786200577490656-27451-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40565
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786200577490656-27451-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:55:13.939965 18581 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:55:13.941256 18581 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:55:13.953717 18586 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:55:13.953680 18587 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:55:13.953756 18589 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:55:13.954484 18581 server_base.cc:1034] running on GCE node
I20260808 14:55:13.955219 18581 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:55:13.956640 18581 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:55:13.957887 18581 hybrid_clock.cc:648] HybridClock initialized: now 1786200913957835 us; error 38 us; skew 500 ppm
I20260808 14:55:13.958269 18581 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:55:13 dist-test-slave-6k22 krb5kdc[18567](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200913, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:55:13.961762 18581 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 14:55:13.963243 18581 webserver.cc:460] Webserver started at http://127.0.0.1:33579/ using document root <none> and password file <none>
I20260808 14:55:13.963981 18581 fs_manager.cc:359] Metadata directory not provided
I20260808 14:55:13.964098 18581 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:55:13.964395 18581 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:55:13.967505 18581 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786200577490656-27451-0/minicluster-data/master-0/data/instance:
uuid: "22e4d55a523d4d8a94c8f7310c4ce3a1"
format_stamp: "Formatted at 2026-08-08 14:55:13 on dist-test-slave-6k22"
server_key: "1f78f6e7ad5831df2ade5c11b3fea1ae"
server_key_iv: "683bfb76dfb7014c49728b0d352da6f1"
server_key_version: "encryptionkey@0"
I20260808 14:55:13.968394 18581 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786200577490656-27451-0/minicluster-data/master-0/wal/instance:
uuid: "22e4d55a523d4d8a94c8f7310c4ce3a1"
format_stamp: "Formatted at 2026-08-08 14:55:13 on dist-test-slave-6k22"
server_key: "1f78f6e7ad5831df2ade5c11b3fea1ae"
server_key_iv: "683bfb76dfb7014c49728b0d352da6f1"
server_key_version: "encryptionkey@0"
I20260808 14:55:13.973865 18581 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.004s
I20260808 14:55:13.977252 18596 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:55:13.978538 18581 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 14:55:13.978672 18581 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786200577490656-27451-0/minicluster-data/master-0/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786200577490656-27451-0/minicluster-data/master-0/wal
uuid: "22e4d55a523d4d8a94c8f7310c4ce3a1"
format_stamp: "Formatted at 2026-08-08 14:55:13 on dist-test-slave-6k22"
server_key: "1f78f6e7ad5831df2ade5c11b3fea1ae"
server_key_iv: "683bfb76dfb7014c49728b0d352da6f1"
server_key_version: "encryptionkey@0"
I20260808 14:55:13.978837 18581 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786200577490656-27451-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786200577490656-27451-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786200577490656-27451-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:55:13.984347 18581 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:55:13.988193 18581 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:55:13.988431 18581 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:55:14.007061 18581 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40565
I20260808 14:55:14.007114 18654 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40565 every 8 connection(s)
I20260808 14:55:14.008488 18581 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
I20260808 14:55:14.012161 18655 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:55:14.013455 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 18581
I20260808 14:55:14.013638 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786200577490656-27451-0/minicluster-data/master-0/wal/instance
I20260808 14:55:14.014125 27451 external_mini_cluster.cc:1428] Setting key 3552dccd87721bf500f4763b99d48b84
I20260808 14:55:14.022550 18658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:14.016041 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42241 (local address 127.0.0.1:40565)
0808 14:55:14.016934 (+ 893us) server_negotiation.cc:206] Beginning negotiation
0808 14:55:14.016954 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0808 14:55:14.017005 (+ 51us) server_negotiation.cc:407] Connection header received
0808 14:55:14.018951 (+ 1946us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:55:14.018979 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:55:14.019407 (+ 428us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:55:14.019911 (+ 504us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:55:14.020788 (+ 877us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:55:14.020796 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:55:14.020811 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:55:14.020826 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:55:14.020884 (+ 58us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:55:14.020907 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:55:14.021134 (+ 227us) server_negotiation.cc:1035] Waiting for connection context
0808 14:55:14.021260 (+ 126us) server_negotiation.cc:299] Negotiation successful
0808 14:55:14.021430 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":611,"thread_start_us":373,"threads_started":1}
I20260808 14:55:14.026086 27451 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:55:14.026712 18655 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 22e4d55a523d4d8a94c8f7310c4ce3a1: Bootstrap starting.
I20260808 14:55:14.029764 18655 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 22e4d55a523d4d8a94c8f7310c4ce3a1: Neither blocks nor log segments found. Creating new log.
I20260808 14:55:14.030893 18655 log.cc:824] T 00000000000000000000000000000000 P 22e4d55a523d4d8a94c8f7310c4ce3a1: Log is configured to *not* fsync() on all Append() calls
I20260808 14:55:14.033032 18658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:14.030583 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38707 (local address 127.0.0.1:40565)
0808 14:55:14.030757 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0808 14:55:14.030762 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:55:14.031116 (+ 354us) server_negotiation.cc:407] Connection header received
0808 14:55:14.031242 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:55:14.031247 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:55:14.031304 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:55:14.031421 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:55:14.032395 (+ 974us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:55:14.032402 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:55:14.032410 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:55:14.032428 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:55:14.032468 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:55:14.032486 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:55:14.032601 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0808 14:55:14.032715 (+ 114us) server_negotiation.cc:299] Negotiation successful
0808 14:55:14.032790 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260808 14:55:14.033984 18655 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 22e4d55a523d4d8a94c8f7310c4ce3a1: No bootstrap required, opened a new log
I20260808 14:55:14.041250 18655 raft_consensus.cc:348] T 00000000000000000000000000000000 P 22e4d55a523d4d8a94c8f7310c4ce3a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22e4d55a523d4d8a94c8f7310c4ce3a1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40565 } }
I20260808 14:55:14.041616 18655 raft_consensus.cc:374] T 00000000000000000000000000000000 P 22e4d55a523d4d8a94c8f7310c4ce3a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:55:14.041739 18655 raft_consensus.cc:729] T 00000000000000000000000000000000 P 22e4d55a523d4d8a94c8f7310c4ce3a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22e4d55a523d4d8a94c8f7310c4ce3a1, State: Initialized, Role: FOLLOWER
I20260808 14:55:14.042430 18655 consensus_queue.cc:260] T 00000000000000000000000000000000 P 22e4d55a523d4d8a94c8f7310c4ce3a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22e4d55a523d4d8a94c8f7310c4ce3a1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40565 } }
I20260808 14:55:14.042698 18655 raft_consensus.cc:388] T 00000000000000000000000000000000 P 22e4d55a523d4d8a94c8f7310c4ce3a1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:55:14.042835 18655 raft_consensus.cc:482] T 00000000000000000000000000000000 P 22e4d55a523d4d8a94c8f7310c4ce3a1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:55:14.043044 18655 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 22e4d55a523d4d8a94c8f7310c4ce3a1 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:55:14.045289 18655 raft_consensus.cc:504] T 00000000000000000000000000000000 P 22e4d55a523d4d8a94c8f7310c4ce3a1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22e4d55a523d4d8a94c8f7310c4ce3a1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40565 } }
I20260808 14:55:14.045787 18655 leader_election.cc:302] T 00000000000000000000000000000000 P 22e4d55a523d4d8a94c8f7310c4ce3a1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 22e4d55a523d4d8a94c8f7310c4ce3a1; no voters:
I20260808 14:55:14.046389 18655 leader_election.cc:288] T 00000000000000000000000000000000 P 22e4d55a523d4d8a94c8f7310c4ce3a1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:55:14.046515 18665 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 22e4d55a523d4d8a94c8f7310c4ce3a1 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:55:14.047228 18665 raft_consensus.cc:686] T 00000000000000000000000000000000 P 22e4d55a523d4d8a94c8f7310c4ce3a1 [term 1 LEADER]: Becoming Leader. State: Replica: 22e4d55a523d4d8a94c8f7310c4ce3a1, State: Running, Role: LEADER
I20260808 14:55:14.047837 18665 consensus_queue.cc:237] T 00000000000000000000000000000000 P 22e4d55a523d4d8a94c8f7310c4ce3a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22e4d55a523d4d8a94c8f7310c4ce3a1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40565 } }
I20260808 14:55:14.048494 18655 sys_catalog.cc:564] T 00000000000000000000000000000000 P 22e4d55a523d4d8a94c8f7310c4ce3a1 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:55:14.051087 18667 sys_catalog.cc:455] T 00000000000000000000000000000000 P 22e4d55a523d4d8a94c8f7310c4ce3a1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 22e4d55a523d4d8a94c8f7310c4ce3a1. Latest consensus state: current_term: 1 leader_uuid: "22e4d55a523d4d8a94c8f7310c4ce3a1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22e4d55a523d4d8a94c8f7310c4ce3a1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40565 } } }
I20260808 14:55:14.051635 18667 sys_catalog.cc:458] T 00000000000000000000000000000000 P 22e4d55a523d4d8a94c8f7310c4ce3a1 [sys.catalog]: This master's current role is: LEADER
I20260808 14:55:14.051375 18666 sys_catalog.cc:455] T 00000000000000000000000000000000 P 22e4d55a523d4d8a94c8f7310c4ce3a1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "22e4d55a523d4d8a94c8f7310c4ce3a1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22e4d55a523d4d8a94c8f7310c4ce3a1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40565 } } }
I20260808 14:55:14.051784 18666 sys_catalog.cc:458] T 00000000000000000000000000000000 P 22e4d55a523d4d8a94c8f7310c4ce3a1 [sys.catalog]: This master's current role is: LEADER
I20260808 14:55:14.052641 18675 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:55:14.058636 18675 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:55:14.066969 18675 catalog_manager.cc:1347] Generated new cluster ID: 0e9f100000e84f3d858d4c55f9389e15
I20260808 14:55:14.067072 18675 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:55:14.093127 18675 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:55:14.093575 18675 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:55:14.103180 18675 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 22e4d55a523d4d8a94c8f7310c4ce3a1: Generated new TSK 0
I20260808 14:55:14.103981 18675 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:55:14.114557 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 18581
W20260808 14:55:14.115622 18649 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:42241
W20260808 14:55:14.116320 27451 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 18581: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 14:55:14.116482 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 18581
2026-08-08T14:55:14Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (2046 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786200577490656-27451-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:55:14 dist-test-slave-6k22 krb5kdc[18687](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:55:14 dist-test-slave-6k22 krb5kdc[18687](info): set up 2 sockets
Aug 08 14:55:14 dist-test-slave-6k22 krb5kdc[18687](info): commencing operation
krb5kdc: starting...
W20260808 14:55:15.317646 27451 mini_kdc.cc:121] Time spent starting KDC: real 1.161s user 0.000s sys 0.043s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786200577490656-27451-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786200577490656-27451-0/krb5kdc/test-user.keytab.
Aug 08 14:55:15 dist-test-slave-6k22 krb5kdc[18687](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200915, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:55:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:55:15Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786200577490656-27451-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786200577490656-27451-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 14:55:15.626529 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786200577490656-27451-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786200577490656-27451-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786200577490656-27451-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44581
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786200577490656-27451-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42845
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:44581
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:55:15.961325 18700 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:55:15.961689 18700 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:55:15.961889 18700 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:55:15.969736 18700 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:55:15.969872 18700 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:55:15.969995 18700 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:55:15.970108 18700 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:55:15.970165 18700 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:55:15.979816 18700 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42845
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786200577490656-27451-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786200577490656-27451-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:44581
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786200577490656-27451-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44581
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786200577490656-27451-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:55:15.981109 18700 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:55:15.982437 18700 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:55:15.994331 18708 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:55:15.994410 18706 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:55:15.994393 18705 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:55:15.996865 18700 server_base.cc:1034] running on GCE node
I20260808 14:55:15.997588 18700 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:55:15.998886 18700 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:55:16.000141 18700 hybrid_clock.cc:648] HybridClock initialized: now 1786200916000086 us; error 47 us; skew 500 ppm
I20260808 14:55:16.000519 18700 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:55:15 dist-test-slave-6k22 krb5kdc[18687](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200915, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:55:16.003683 18700 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 14:55:16.005060 18700 webserver.cc:460] Webserver started at http://127.0.0.1:44029/ using document root <none> and password file <none>
I20260808 14:55:16.005746 18700 fs_manager.cc:359] Metadata directory not provided
I20260808 14:55:16.005888 18700 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:55:16.006181 18700 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:55:16.009265 18700 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786200577490656-27451-0/minicluster-data/master-0/data/instance:
uuid: "3f5c9e8bb67a425d9cc6f89a4d6b29cb"
format_stamp: "Formatted at 2026-08-08 14:55:16 on dist-test-slave-6k22"
server_key: "cfc1c6fa53d4a6df2add058a399509e6"
server_key_iv: "e012660af8518a10ec5ce965196f1420"
server_key_version: "encryptionkey@0"
I20260808 14:55:16.010010 18700 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786200577490656-27451-0/minicluster-data/master-0/wal/instance:
uuid: "3f5c9e8bb67a425d9cc6f89a4d6b29cb"
format_stamp: "Formatted at 2026-08-08 14:55:16 on dist-test-slave-6k22"
server_key: "cfc1c6fa53d4a6df2add058a399509e6"
server_key_iv: "e012660af8518a10ec5ce965196f1420"
server_key_version: "encryptionkey@0"
I20260808 14:55:16.014822 18700 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260808 14:55:16.018128 18716 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:55:16.019544 18700 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 14:55:16.019850 18700 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786200577490656-27451-0/minicluster-data/master-0/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786200577490656-27451-0/minicluster-data/master-0/wal
uuid: "3f5c9e8bb67a425d9cc6f89a4d6b29cb"
format_stamp: "Formatted at 2026-08-08 14:55:16 on dist-test-slave-6k22"
server_key: "cfc1c6fa53d4a6df2add058a399509e6"
server_key_iv: "e012660af8518a10ec5ce965196f1420"
server_key_version: "encryptionkey@0"
I20260808 14:55:16.020043 18700 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786200577490656-27451-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786200577490656-27451-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786200577490656-27451-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:55:16.036856 18700 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:55:16.041109 18700 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:55:16.041404 18700 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:55:16.060060 18700 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:44581
I20260808 14:55:16.060097 18770 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:44581 every 8 connection(s)
I20260808 14:55:16.061447 18700 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
I20260808 14:55:16.063469 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 18700
I20260808 14:55:16.063719 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786200577490656-27451-0/minicluster-data/master-0/wal/instance
I20260808 14:55:16.064169 27451 external_mini_cluster.cc:1428] Setting key e5ebecd079fe8cf500f72fa013bf23cc
I20260808 14:55:16.065420 18771 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 08 14:55:16 dist-test-slave-6k22 krb5kdc[18687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200915, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260808 14:55:16.079008 18771 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3f5c9e8bb67a425d9cc6f89a4d6b29cb: Bootstrap starting.
I20260808 14:55:16.083007 18771 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3f5c9e8bb67a425d9cc6f89a4d6b29cb: Neither blocks nor log segments found. Creating new log.
I20260808 14:55:16.084362 18771 log.cc:824] T 00000000000000000000000000000000 P 3f5c9e8bb67a425d9cc6f89a4d6b29cb: Log is configured to *not* fsync() on all Append() calls
I20260808 14:55:16.087771 18771 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3f5c9e8bb67a425d9cc6f89a4d6b29cb: No bootstrap required, opened a new log
I20260808 14:55:16.088856 18775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:16.065890 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.223:38801 (local address 127.0.0.1:44581)
0808 14:55:16.066682 (+ 792us) server_negotiation.cc:206] Beginning negotiation
0808 14:55:16.066697 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 14:55:16.066746 (+ 49us) server_negotiation.cc:407] Connection header received
0808 14:55:16.068727 (+ 1981us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:55:16.068752 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:55:16.069244 (+ 492us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:55:16.069687 (+ 443us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:55:16.071080 (+ 1393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:16.073221 (+ 2141us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:16.074481 (+ 1260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:16.075516 (+ 1035us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:16.075737 (+ 221us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:55:16.080148 (+ 4411us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:55:16.080157 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:55:16.080175 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:55:16.080219 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:55:16.084227 (+ 4008us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:55:16.085096 (+ 869us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:55:16.085105 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:55:16.085111 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:55:16.085260 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:55:16.085879 (+ 619us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:55:16.085887 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:55:16.085893 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:55:16.086529 (+ 636us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:55:16.086843 (+ 314us) server_negotiation.cc:1035] Waiting for connection context
0808 14:55:16.087228 (+ 385us) server_negotiation.cc:299] Negotiation successful
0808 14:55:16.087545 (+ 317us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":548,"thread_start_us":326,"threads_started":1}
I20260808 14:55:16.092610 27451 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:55:16.095891 18771 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3f5c9e8bb67a425d9cc6f89a4d6b29cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f5c9e8bb67a425d9cc6f89a4d6b29cb" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44581 } }
I20260808 14:55:16.096264 18771 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3f5c9e8bb67a425d9cc6f89a4d6b29cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:55:16.096356 18771 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3f5c9e8bb67a425d9cc6f89a4d6b29cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f5c9e8bb67a425d9cc6f89a4d6b29cb, State: Initialized, Role: FOLLOWER
I20260808 14:55:16.097029 18771 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3f5c9e8bb67a425d9cc6f89a4d6b29cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f5c9e8bb67a425d9cc6f89a4d6b29cb" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44581 } }
I20260808 14:55:16.097405 18771 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3f5c9e8bb67a425d9cc6f89a4d6b29cb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:55:16.097568 18771 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3f5c9e8bb67a425d9cc6f89a4d6b29cb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:55:16.097749 18771 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3f5c9e8bb67a425d9cc6f89a4d6b29cb [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:55:16.100265 18771 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3f5c9e8bb67a425d9cc6f89a4d6b29cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f5c9e8bb67a425d9cc6f89a4d6b29cb" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44581 } }
I20260808 14:55:16.100812 18771 leader_election.cc:302] T 00000000000000000000000000000000 P 3f5c9e8bb67a425d9cc6f89a4d6b29cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3f5c9e8bb67a425d9cc6f89a4d6b29cb; no voters:
I20260808 14:55:16.101547 18771 leader_election.cc:288] T 00000000000000000000000000000000 P 3f5c9e8bb67a425d9cc6f89a4d6b29cb [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:55:16.101639 18782 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3f5c9e8bb67a425d9cc6f89a4d6b29cb [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:55:16.102957 18782 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3f5c9e8bb67a425d9cc6f89a4d6b29cb [term 1 LEADER]: Becoming Leader. State: Replica: 3f5c9e8bb67a425d9cc6f89a4d6b29cb, State: Running, Role: LEADER
I20260808 14:55:16.103617 18782 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3f5c9e8bb67a425d9cc6f89a4d6b29cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f5c9e8bb67a425d9cc6f89a4d6b29cb" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44581 } }
I20260808 14:55:16.103937 18771 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3f5c9e8bb67a425d9cc6f89a4d6b29cb [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:55:16.106768 18784 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3f5c9e8bb67a425d9cc6f89a4d6b29cb [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3f5c9e8bb67a425d9cc6f89a4d6b29cb. Latest consensus state: current_term: 1 leader_uuid: "3f5c9e8bb67a425d9cc6f89a4d6b29cb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f5c9e8bb67a425d9cc6f89a4d6b29cb" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44581 } } }
I20260808 14:55:16.107062 18783 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3f5c9e8bb67a425d9cc6f89a4d6b29cb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3f5c9e8bb67a425d9cc6f89a4d6b29cb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f5c9e8bb67a425d9cc6f89a4d6b29cb" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44581 } } }
I20260808 14:55:16.107299 18784 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3f5c9e8bb67a425d9cc6f89a4d6b29cb [sys.catalog]: This master's current role is: LEADER
I20260808 14:55:16.107399 18783 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3f5c9e8bb67a425d9cc6f89a4d6b29cb [sys.catalog]: This master's current role is: LEADER
I20260808 14:55:16.115025 18775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:16.097201 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.223:35893 (local address 127.0.0.1:44581)
0808 14:55:16.097373 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0808 14:55:16.097379 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:55:16.097798 (+ 419us) server_negotiation.cc:407] Connection header received
0808 14:55:16.097963 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:55:16.097967 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:55:16.098051 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:55:16.098152 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:55:16.099646 (+ 1494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:16.100751 (+ 1105us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:16.102275 (+ 1524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:16.102967 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:16.103084 (+ 117us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:55:16.105992 (+ 2908us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:55:16.105998 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:55:16.106002 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:55:16.106038 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:55:16.110295 (+ 4257us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:55:16.111593 (+ 1298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:55:16.111601 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:55:16.111608 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:55:16.111791 (+ 183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:55:16.112545 (+ 754us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:55:16.112554 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:55:16.112559 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:55:16.113040 (+ 481us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:55:16.113400 (+ 360us) server_negotiation.cc:1035] Waiting for connection context
0808 14:55:16.114284 (+ 884us) server_negotiation.cc:299] Negotiation successful
0808 14:55:16.114524 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260808 14:55:16.120240 18787 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:55:16.125432 18787 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:55:16.134264 18787 catalog_manager.cc:1347] Generated new cluster ID: 364686ff0864458e85a3ab1b3c31ed5c
I20260808 14:55:16.134399 18787 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:55:16.144290 18787 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:55:16.145474 18787 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:55:16.152750 18787 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3f5c9e8bb67a425d9cc6f89a4d6b29cb: Generated new TSK 0
I20260808 14:55:16.153535 18787 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:55:16.167598 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 18700
I20260808 14:55:16.168666 18765 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:55:16.261013 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 18700
W20260808 14:55:16.282112 18685 connection.cc:535] client connection to 127.0.0.1:44581 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:44581): Connection reset by peer (error 104)
2026-08-08T14:55:16Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (2144 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786200577490656-27451-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:55:16 dist-test-slave-6k22 krb5kdc[18806](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:55:16 dist-test-slave-6k22 krb5kdc[18806](info): set up 2 sockets
Aug 08 14:55:16 dist-test-slave-6k22 krb5kdc[18806](info): commencing operation
krb5kdc: starting...
W20260808 14:55:17.446770 27451 mini_kdc.cc:121] Time spent starting KDC: real 1.145s user 0.006s sys 0.036s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786200577490656-27451-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786200577490656-27451-0/krb5kdc/test-user.keytab.
Aug 08 14:55:17 dist-test-slave-6k22 krb5kdc[18806](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200917, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:55:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:55:17Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786200577490656-27451-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786200577490656-27451-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 14:55:17.766973 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786200577490656-27451-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786200577490656-27451-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786200577490656-27451-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44727
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786200577490656-27451-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:43311
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:44727
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:55:18.102000 18820 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:55:18.102326 18820 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:55:18.102519 18820 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:55:18.109699 18820 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:55:18.109861 18820 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:55:18.109973 18820 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:55:18.110082 18820 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:55:18.110159 18820 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:55:18.120036 18820 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:43311
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786200577490656-27451-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786200577490656-27451-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:44727
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786200577490656-27451-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44727
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786200577490656-27451-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:55:18.121259 18820 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:55:18.122552 18820 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:55:18.134377 18825 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:55:18.134470 18826 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:55:18.134449 18828 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:55:18.135231 18820 server_base.cc:1034] running on GCE node
I20260808 14:55:18.136045 18820 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:55:18.137317 18820 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:55:18.138517 18820 hybrid_clock.cc:648] HybridClock initialized: now 1786200918138464 us; error 51 us; skew 500 ppm
I20260808 14:55:18.138865 18820 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:55:18 dist-test-slave-6k22 krb5kdc[18806](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200918, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:55:18.141979 18820 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 14:55:18.143388 18820 webserver.cc:460] Webserver started at http://127.0.0.1:46267/ using document root <none> and password file <none>
I20260808 14:55:18.144107 18820 fs_manager.cc:359] Metadata directory not provided
I20260808 14:55:18.144250 18820 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:55:18.144550 18820 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:55:18.147385 18820 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786200577490656-27451-0/minicluster-data/master-0/data/instance:
uuid: "07681c8ea0394c07ba17728e25b1fdee"
format_stamp: "Formatted at 2026-08-08 14:55:18 on dist-test-slave-6k22"
server_key: "96530782770d811cf3254901322e6747"
server_key_iv: "5b2b4af03c11e042f39f00054d362daa"
server_key_version: "encryptionkey@0"
I20260808 14:55:18.148187 18820 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786200577490656-27451-0/minicluster-data/master-0/wal/instance:
uuid: "07681c8ea0394c07ba17728e25b1fdee"
format_stamp: "Formatted at 2026-08-08 14:55:18 on dist-test-slave-6k22"
server_key: "96530782770d811cf3254901322e6747"
server_key_iv: "5b2b4af03c11e042f39f00054d362daa"
server_key_version: "encryptionkey@0"
I20260808 14:55:18.153043 18820 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 14:55:18.156329 18836 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:55:18.157662 18820 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 14:55:18.157852 18820 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786200577490656-27451-0/minicluster-data/master-0/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786200577490656-27451-0/minicluster-data/master-0/wal
uuid: "07681c8ea0394c07ba17728e25b1fdee"
format_stamp: "Formatted at 2026-08-08 14:55:18 on dist-test-slave-6k22"
server_key: "96530782770d811cf3254901322e6747"
server_key_iv: "5b2b4af03c11e042f39f00054d362daa"
server_key_version: "encryptionkey@0"
I20260808 14:55:18.158053 18820 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786200577490656-27451-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786200577490656-27451-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786200577490656-27451-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:55:18.185755 18820 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:55:18.189672 18820 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:55:18.189962 18820 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:55:18.208583 18820 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:44727
I20260808 14:55:18.208614 18894 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:44727 every 8 connection(s)
I20260808 14:55:18.209931 18820 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
I20260808 14:55:18.213500 18895 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:55:18.218037 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 18820
I20260808 14:55:18.218231 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786200577490656-27451-0/minicluster-data/master-0/wal/instance
I20260808 14:55:18.218683 27451 external_mini_cluster.cc:1428] Setting key bc792da85d27ab36d90f632b18044d6d
I20260808 14:55:18.225607 18895 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 07681c8ea0394c07ba17728e25b1fdee: Bootstrap starting.
I20260808 14:55:18.229211 18895 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 07681c8ea0394c07ba17728e25b1fdee: Neither blocks nor log segments found. Creating new log.
I20260808 14:55:18.230571 18895 log.cc:824] T 00000000000000000000000000000000 P 07681c8ea0394c07ba17728e25b1fdee: Log is configured to *not* fsync() on all Append() calls
I20260808 14:55:18.233912 18895 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 07681c8ea0394c07ba17728e25b1fdee: No bootstrap required, opened a new log
I20260808 14:55:18.234077 18898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:18.220542 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.223:57643 (local address 127.0.0.1:44727)
0808 14:55:18.221406 (+ 864us) server_negotiation.cc:206] Beginning negotiation
0808 14:55:18.221422 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 14:55:18.221477 (+ 55us) server_negotiation.cc:407] Connection header received
0808 14:55:18.224039 (+ 2562us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:55:18.224067 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:55:18.224575 (+ 508us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:55:18.225032 (+ 457us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:55:18.225535 (+ 503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:18.227537 (+ 2002us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:18.228846 (+ 1309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:18.229986 (+ 1140us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:18.230171 (+ 185us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:55:18.231368 (+ 1197us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:55:18.231375 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:55:18.231387 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:55:18.232072 (+ 685us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:55:18.232175 (+ 103us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:55:18.232204 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:55:18.232367 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0808 14:55:18.232613 (+ 246us) server_negotiation.cc:299] Negotiation successful
0808 14:55:18.232774 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":589,"thread_start_us":360,"threads_started":1}
I20260808 14:55:18.237865 27451 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:55:18.241926 18895 raft_consensus.cc:348] T 00000000000000000000000000000000 P 07681c8ea0394c07ba17728e25b1fdee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07681c8ea0394c07ba17728e25b1fdee" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44727 } }
I20260808 14:55:18.242413 18895 raft_consensus.cc:374] T 00000000000000000000000000000000 P 07681c8ea0394c07ba17728e25b1fdee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:55:18.242540 18895 raft_consensus.cc:729] T 00000000000000000000000000000000 P 07681c8ea0394c07ba17728e25b1fdee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07681c8ea0394c07ba17728e25b1fdee, State: Initialized, Role: FOLLOWER
I20260808 14:55:18.243167 18895 consensus_queue.cc:260] T 00000000000000000000000000000000 P 07681c8ea0394c07ba17728e25b1fdee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07681c8ea0394c07ba17728e25b1fdee" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44727 } }
I20260808 14:55:18.243466 18895 raft_consensus.cc:388] T 00000000000000000000000000000000 P 07681c8ea0394c07ba17728e25b1fdee [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:55:18.243638 18895 raft_consensus.cc:482] T 00000000000000000000000000000000 P 07681c8ea0394c07ba17728e25b1fdee [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:55:18.243881 18895 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 07681c8ea0394c07ba17728e25b1fdee [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:55:18.246846 18895 raft_consensus.cc:504] T 00000000000000000000000000000000 P 07681c8ea0394c07ba17728e25b1fdee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07681c8ea0394c07ba17728e25b1fdee" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44727 } }
I20260808 14:55:18.247354 18895 leader_election.cc:302] T 00000000000000000000000000000000 P 07681c8ea0394c07ba17728e25b1fdee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 07681c8ea0394c07ba17728e25b1fdee; no voters:
I20260808 14:55:18.248040 18895 leader_election.cc:288] T 00000000000000000000000000000000 P 07681c8ea0394c07ba17728e25b1fdee [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:55:18.248150 18906 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 07681c8ea0394c07ba17728e25b1fdee [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:55:18.249611 18898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:18.242165 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.223:57967 (local address 127.0.0.1:44727)
0808 14:55:18.242357 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0808 14:55:18.242366 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:55:18.242854 (+ 488us) server_negotiation.cc:407] Connection header received
0808 14:55:18.243033 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:55:18.243036 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:55:18.243089 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:55:18.243171 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:55:18.243855 (+ 684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:18.244647 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:18.246537 (+ 1890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:18.247026 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:18.247165 (+ 139us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:55:18.248538 (+ 1373us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:55:18.248551 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:55:18.248558 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:55:18.248586 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:55:18.248638 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:55:18.248660 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:55:18.248788 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0808 14:55:18.249228 (+ 440us) server_negotiation.cc:299] Negotiation successful
0808 14:55:18.249276 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260808 14:55:18.250304 18895 sys_catalog.cc:564] T 00000000000000000000000000000000 P 07681c8ea0394c07ba17728e25b1fdee [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:55:18.251981 18906 raft_consensus.cc:686] T 00000000000000000000000000000000 P 07681c8ea0394c07ba17728e25b1fdee [term 1 LEADER]: Becoming Leader. State: Replica: 07681c8ea0394c07ba17728e25b1fdee, State: Running, Role: LEADER
I20260808 14:55:18.252488 18906 consensus_queue.cc:237] T 00000000000000000000000000000000 P 07681c8ea0394c07ba17728e25b1fdee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07681c8ea0394c07ba17728e25b1fdee" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44727 } }
I20260808 14:55:18.255656 18907 sys_catalog.cc:455] T 00000000000000000000000000000000 P 07681c8ea0394c07ba17728e25b1fdee [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "07681c8ea0394c07ba17728e25b1fdee" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07681c8ea0394c07ba17728e25b1fdee" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44727 } } }
I20260808 14:55:18.255734 18908 sys_catalog.cc:455] T 00000000000000000000000000000000 P 07681c8ea0394c07ba17728e25b1fdee [sys.catalog]: SysCatalogTable state changed. Reason: New leader 07681c8ea0394c07ba17728e25b1fdee. Latest consensus state: current_term: 1 leader_uuid: "07681c8ea0394c07ba17728e25b1fdee" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07681c8ea0394c07ba17728e25b1fdee" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44727 } } }
I20260808 14:55:18.256042 18907 sys_catalog.cc:458] T 00000000000000000000000000000000 P 07681c8ea0394c07ba17728e25b1fdee [sys.catalog]: This master's current role is: LEADER
I20260808 14:55:18.256146 18908 sys_catalog.cc:458] T 00000000000000000000000000000000 P 07681c8ea0394c07ba17728e25b1fdee [sys.catalog]: This master's current role is: LEADER
I20260808 14:55:18.257468 18912 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:55:18.262609 18912 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:55:18.272250 18912 catalog_manager.cc:1347] Generated new cluster ID: 05fe7aaf526f4a76b1e38d882950e3af
I20260808 14:55:18.272372 18912 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:55:18.280694 18912 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:55:18.282069 18912 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:55:18.290993 18912 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 07681c8ea0394c07ba17728e25b1fdee: Generated new TSK 0
I20260808 14:55:18.291810 18912 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:55:18.304649 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 18820
W20260808 14:55:18.305759 18890 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.223:57643
W20260808 14:55:18.306532 27451 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 18820: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 14:55:18.306677 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 18820
W20260808 14:55:18.327385 18804 connection.cc:535] client connection to 127.0.0.1:44727 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:44727): Connection reset by peer (error 104)
2026-08-08T14:55:18Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (2045 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786200577490656-27451-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:55:18 dist-test-slave-6k22 krb5kdc[18928](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:55:18 dist-test-slave-6k22 krb5kdc[18928](info): set up 2 sockets
Aug 08 14:55:18 dist-test-slave-6k22 krb5kdc[18928](info): commencing operation
krb5kdc: starting...
W20260808 14:55:19.513100 27451 mini_kdc.cc:121] Time spent starting KDC: real 1.166s user 0.002s sys 0.044s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786200577490656-27451-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786200577490656-27451-0/krb5kdc/test-user.keytab.
Aug 08 14:55:19 dist-test-slave-6k22 krb5kdc[18928](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200919, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:55:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:55:19Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786200577490656-27451-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786200577490656-27451-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 14:55:19.824640 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786200577490656-27451-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786200577490656-27451-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786200577490656-27451-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43861
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786200577490656-27451-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46623
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43861
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:55:20.158098 18941 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:55:20.158424 18941 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:55:20.158583 18941 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:55:20.165481 18941 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:55:20.165606 18941 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:55:20.165721 18941 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:55:20.165827 18941 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:55:20.165894 18941 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:55:20.176451 18941 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46623
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786200577490656-27451-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786200577490656-27451-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43861
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786200577490656-27451-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43861
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786200577490656-27451-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:55:20.178033 18941 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:55:20.179760 18941 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:55:20.192709 18946 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:55:20.192869 18947 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:55:20.193418 18951 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:55:20.193789 18941 server_base.cc:1034] running on GCE node
I20260808 14:55:20.194547 18941 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:55:20.195926 18941 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:55:20.197146 18941 hybrid_clock.cc:648] HybridClock initialized: now 1786200920197108 us; error 54 us; skew 500 ppm
I20260808 14:55:20.197505 18941 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:55:20 dist-test-slave-6k22 krb5kdc[18928](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200920, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:55:20.205592 18941 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 14:55:20.207090 18941 webserver.cc:460] Webserver started at http://127.0.0.1:33249/ using document root <none> and password file <none>
I20260808 14:55:20.207823 18941 fs_manager.cc:359] Metadata directory not provided
I20260808 14:55:20.207964 18941 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:55:20.208282 18941 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:55:20.211153 18941 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786200577490656-27451-0/minicluster-data/master-0/data/instance:
uuid: "6562bdb1f7ab4216a56bfbedf63d02e5"
format_stamp: "Formatted at 2026-08-08 14:55:20 on dist-test-slave-6k22"
server_key: "7aec0ed110827b1e61a4f645e11f0fbe"
server_key_iv: "054ae0114ff779b650d41ff99b001963"
server_key_version: "encryptionkey@0"
I20260808 14:55:20.212009 18941 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786200577490656-27451-0/minicluster-data/master-0/wal/instance:
uuid: "6562bdb1f7ab4216a56bfbedf63d02e5"
format_stamp: "Formatted at 2026-08-08 14:55:20 on dist-test-slave-6k22"
server_key: "7aec0ed110827b1e61a4f645e11f0fbe"
server_key_iv: "054ae0114ff779b650d41ff99b001963"
server_key_version: "encryptionkey@0"
I20260808 14:55:20.216972 18941 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260808 14:55:20.220413 18960 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:55:20.221644 18941 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260808 14:55:20.221825 18941 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786200577490656-27451-0/minicluster-data/master-0/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786200577490656-27451-0/minicluster-data/master-0/wal
uuid: "6562bdb1f7ab4216a56bfbedf63d02e5"
format_stamp: "Formatted at 2026-08-08 14:55:20 on dist-test-slave-6k22"
server_key: "7aec0ed110827b1e61a4f645e11f0fbe"
server_key_iv: "054ae0114ff779b650d41ff99b001963"
server_key_version: "encryptionkey@0"
I20260808 14:55:20.222020 18941 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786200577490656-27451-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786200577490656-27451-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786200577490656-27451-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:55:20.227656 18941 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:55:20.231248 18941 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:55:20.231595 18941 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:55:20.249670 18941 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43861
I20260808 14:55:20.249740 19013 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43861 every 8 connection(s)
I20260808 14:55:20.250978 18941 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
I20260808 14:55:20.252089 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 18941
I20260808 14:55:20.252293 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786200577490656-27451-0/minicluster-data/master-0/wal/instance
I20260808 14:55:20.252877 27451 external_mini_cluster.cc:1428] Setting key 50c624fb3aa851344b8edc6fcb352594
I20260808 14:55:20.255362 19014 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:55:20.260502 19018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:20.254704 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.223:46637 (local address 127.0.0.1:43861)
0808 14:55:20.255467 (+ 763us) server_negotiation.cc:206] Beginning negotiation
0808 14:55:20.255482 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 14:55:20.255538 (+ 56us) server_negotiation.cc:407] Connection header received
0808 14:55:20.257130 (+ 1592us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:55:20.257149 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:55:20.257481 (+ 332us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:55:20.257870 (+ 389us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:55:20.258916 (+ 1046us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:55:20.258922 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:55:20.258934 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:55:20.258952 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:55:20.259017 (+ 65us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:55:20.259037 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:55:20.259299 (+ 262us) server_negotiation.cc:1035] Waiting for connection context
0808 14:55:20.259440 (+ 141us) server_negotiation.cc:299] Negotiation successful
0808 14:55:20.259671 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":525,"thread_start_us":318,"threads_started":1}
I20260808 14:55:20.263842 27451 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:55:20.266093 19014 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6562bdb1f7ab4216a56bfbedf63d02e5: Bootstrap starting.
I20260808 14:55:20.269872 19014 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6562bdb1f7ab4216a56bfbedf63d02e5: Neither blocks nor log segments found. Creating new log.
I20260808 14:55:20.271030 19014 log.cc:824] T 00000000000000000000000000000000 P 6562bdb1f7ab4216a56bfbedf63d02e5: Log is configured to *not* fsync() on all Append() calls
I20260808 14:55:20.272491 19018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:20.268083 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.223:40171 (local address 127.0.0.1:43861)
0808 14:55:20.268216 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0808 14:55:20.268220 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:55:20.270486 (+ 2266us) server_negotiation.cc:407] Connection header received
0808 14:55:20.270673 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:55:20.270677 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:55:20.270720 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:55:20.270822 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:55:20.271766 (+ 944us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:55:20.271771 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:55:20.271776 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:55:20.271800 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:55:20.271846 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:55:20.271864 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:55:20.271957 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0808 14:55:20.272106 (+ 149us) server_negotiation.cc:299] Negotiation successful
0808 14:55:20.272150 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260808 14:55:20.274153 19014 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6562bdb1f7ab4216a56bfbedf63d02e5: No bootstrap required, opened a new log
I20260808 14:55:20.281504 19014 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6562bdb1f7ab4216a56bfbedf63d02e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6562bdb1f7ab4216a56bfbedf63d02e5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43861 } }
I20260808 14:55:20.281824 19014 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6562bdb1f7ab4216a56bfbedf63d02e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:55:20.281919 19014 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6562bdb1f7ab4216a56bfbedf63d02e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6562bdb1f7ab4216a56bfbedf63d02e5, State: Initialized, Role: FOLLOWER
I20260808 14:55:20.282477 19014 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6562bdb1f7ab4216a56bfbedf63d02e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6562bdb1f7ab4216a56bfbedf63d02e5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43861 } }
I20260808 14:55:20.282696 19014 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6562bdb1f7ab4216a56bfbedf63d02e5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:55:20.282850 19014 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6562bdb1f7ab4216a56bfbedf63d02e5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:55:20.283008 19014 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6562bdb1f7ab4216a56bfbedf63d02e5 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:55:20.285374 19014 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6562bdb1f7ab4216a56bfbedf63d02e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6562bdb1f7ab4216a56bfbedf63d02e5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43861 } }
I20260808 14:55:20.285766 19014 leader_election.cc:302] T 00000000000000000000000000000000 P 6562bdb1f7ab4216a56bfbedf63d02e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6562bdb1f7ab4216a56bfbedf63d02e5; no voters:
I20260808 14:55:20.286299 19014 leader_election.cc:288] T 00000000000000000000000000000000 P 6562bdb1f7ab4216a56bfbedf63d02e5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:55:20.286420 19026 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6562bdb1f7ab4216a56bfbedf63d02e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:55:20.287271 19026 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6562bdb1f7ab4216a56bfbedf63d02e5 [term 1 LEADER]: Becoming Leader. State: Replica: 6562bdb1f7ab4216a56bfbedf63d02e5, State: Running, Role: LEADER
I20260808 14:55:20.287809 19026 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6562bdb1f7ab4216a56bfbedf63d02e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6562bdb1f7ab4216a56bfbedf63d02e5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43861 } }
I20260808 14:55:20.288386 19014 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6562bdb1f7ab4216a56bfbedf63d02e5 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:55:20.290586 19028 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6562bdb1f7ab4216a56bfbedf63d02e5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6562bdb1f7ab4216a56bfbedf63d02e5. Latest consensus state: current_term: 1 leader_uuid: "6562bdb1f7ab4216a56bfbedf63d02e5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6562bdb1f7ab4216a56bfbedf63d02e5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43861 } } }
I20260808 14:55:20.291074 19028 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6562bdb1f7ab4216a56bfbedf63d02e5 [sys.catalog]: This master's current role is: LEADER
I20260808 14:55:20.291633 19027 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6562bdb1f7ab4216a56bfbedf63d02e5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6562bdb1f7ab4216a56bfbedf63d02e5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6562bdb1f7ab4216a56bfbedf63d02e5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43861 } } }
I20260808 14:55:20.292003 19027 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6562bdb1f7ab4216a56bfbedf63d02e5 [sys.catalog]: This master's current role is: LEADER
I20260808 14:55:20.293828 19031 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:55:20.299031 19031 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:55:20.307638 19031 catalog_manager.cc:1347] Generated new cluster ID: fa096b4adcbb466ba22993f9a4afa9ae
I20260808 14:55:20.307741 19031 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:55:20.345870 19031 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:55:20.346336 19031 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:55:20.357544 19031 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6562bdb1f7ab4216a56bfbedf63d02e5: Generated new TSK 0
I20260808 14:55:20.358260 19031 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:55:20.370330 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 18941
W20260808 14:55:20.371613 19009 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.223:46637
W20260808 14:55:20.372350 27451 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 18941: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 14:55:20.372489 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 18941
2026-08-08T14:55:20Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (2067 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786200577490656-27451-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:55:20 dist-test-slave-6k22 krb5kdc[19050](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:55:20 dist-test-slave-6k22 krb5kdc[19050](info): set up 2 sockets
Aug 08 14:55:20 dist-test-slave-6k22 krb5kdc[19050](info): commencing operation
krb5kdc: starting...
W20260808 14:55:21.614936 27451 mini_kdc.cc:121] Time spent starting KDC: real 1.201s user 0.001s sys 0.043s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786200577490656-27451-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786200577490656-27451-0/krb5kdc/test-user.keytab.
Aug 08 14:55:21 dist-test-slave-6k22 krb5kdc[19050](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200921, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:55:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:55:21Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786200577490656-27451-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786200577490656-27451-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 14:55:21.914448 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786200577490656-27451-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786200577490656-27451-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786200577490656-27451-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37085
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786200577490656-27451-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44827
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37085
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:55:22.249903 19065 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:55:22.250170 19065 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:55:22.250370 19065 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:55:22.257475 19065 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:55:22.257603 19065 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:55:22.257694 19065 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:55:22.257807 19065 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:55:22.257889 19065 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:55:22.267171 19065 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44827
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786200577490656-27451-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786200577490656-27451-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37085
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786200577490656-27451-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37085
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786200577490656-27451-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:55:22.268432 19065 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:55:22.269711 19065 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:55:22.281594 19070 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:55:22.281615 19073 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:55:22.281562 19071 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:55:22.282414 19065 server_base.cc:1034] running on GCE node
I20260808 14:55:22.283167 19065 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:55:22.284590 19065 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:55:22.285823 19065 hybrid_clock.cc:648] HybridClock initialized: now 1786200922285763 us; error 58 us; skew 500 ppm
I20260808 14:55:22.286162 19065 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:55:22 dist-test-slave-6k22 krb5kdc[19050](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200922, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:55:22.289218 19065 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 14:55:22.290560 19065 webserver.cc:460] Webserver started at http://127.0.0.1:38653/ using document root <none> and password file <none>
I20260808 14:55:22.291193 19065 fs_manager.cc:359] Metadata directory not provided
I20260808 14:55:22.291330 19065 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:55:22.291666 19065 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:55:22.294423 19065 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786200577490656-27451-0/minicluster-data/master-0/data/instance:
uuid: "260fc7f85fc04f4bab1f7458345e9c6d"
format_stamp: "Formatted at 2026-08-08 14:55:22 on dist-test-slave-6k22"
server_key: "007b2ecfbeb14a28c737adf0bedca986"
server_key_iv: "fbe1c813f5c308fbb6c48ce52c745d71"
server_key_version: "encryptionkey@0"
I20260808 14:55:22.295150 19065 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786200577490656-27451-0/minicluster-data/master-0/wal/instance:
uuid: "260fc7f85fc04f4bab1f7458345e9c6d"
format_stamp: "Formatted at 2026-08-08 14:55:22 on dist-test-slave-6k22"
server_key: "007b2ecfbeb14a28c737adf0bedca986"
server_key_iv: "fbe1c813f5c308fbb6c48ce52c745d71"
server_key_version: "encryptionkey@0"
I20260808 14:55:22.300030 19065 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.008s sys 0.000s
I20260808 14:55:22.303239 19081 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:55:22.304508 19065 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 14:55:22.304721 19065 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786200577490656-27451-0/minicluster-data/master-0/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786200577490656-27451-0/minicluster-data/master-0/wal
uuid: "260fc7f85fc04f4bab1f7458345e9c6d"
format_stamp: "Formatted at 2026-08-08 14:55:22 on dist-test-slave-6k22"
server_key: "007b2ecfbeb14a28c737adf0bedca986"
server_key_iv: "fbe1c813f5c308fbb6c48ce52c745d71"
server_key_version: "encryptionkey@0"
I20260808 14:55:22.304905 19065 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786200577490656-27451-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786200577490656-27451-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786200577490656-27451-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:55:22.324420 19065 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:55:22.328045 19065 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:55:22.328326 19065 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:55:22.353843 19065 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37085
I20260808 14:55:22.353868 19135 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37085 every 8 connection(s)
I20260808 14:55:22.355186 19065 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
I20260808 14:55:22.358875 19136 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:55:22.361949 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 19065
I20260808 14:55:22.362139 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786200577490656-27451-0/minicluster-data/master-0/wal/instance
I20260808 14:55:22.362749 27451 external_mini_cluster.cc:1428] Setting key 2a5104e5949b6002ed1d87da94f683ac
I20260808 14:55:22.371075 19136 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 260fc7f85fc04f4bab1f7458345e9c6d: Bootstrap starting.
I20260808 14:55:22.374939 19136 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 260fc7f85fc04f4bab1f7458345e9c6d: Neither blocks nor log segments found. Creating new log.
I20260808 14:55:22.376312 19136 log.cc:824] T 00000000000000000000000000000000 P 260fc7f85fc04f4bab1f7458345e9c6d: Log is configured to *not* fsync() on all Append() calls
Aug 08 14:55:22 dist-test-slave-6k22 krb5kdc[19050](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200921, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260808 14:55:22.379091 19136 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 260fc7f85fc04f4bab1f7458345e9c6d: No bootstrap required, opened a new log
I20260808 14:55:22.386042 19139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:22.364563 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.223:46465 (local address 127.0.0.1:37085)
0808 14:55:22.365319 (+ 756us) server_negotiation.cc:206] Beginning negotiation
0808 14:55:22.365329 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 14:55:22.365381 (+ 52us) server_negotiation.cc:407] Connection header received
0808 14:55:22.366999 (+ 1618us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:55:22.367026 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:55:22.367411 (+ 385us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:55:22.367776 (+ 365us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:55:22.369533 (+ 1757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:22.370804 (+ 1271us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:22.372606 (+ 1802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:22.373313 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:22.373450 (+ 137us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:55:22.378557 (+ 5107us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:55:22.378564 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:55:22.378578 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:55:22.378610 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:55:22.381810 (+ 3200us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:55:22.382607 (+ 797us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:55:22.382612 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:55:22.382617 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:55:22.382792 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:55:22.383274 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:55:22.383277 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:55:22.383279 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:55:22.383868 (+ 589us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:55:22.384228 (+ 360us) server_negotiation.cc:1035] Waiting for connection context
0808 14:55:22.384721 (+ 493us) server_negotiation.cc:299] Negotiation successful
0808 14:55:22.385030 (+ 309us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":554,"thread_start_us":347,"threads_started":1}
I20260808 14:55:22.386919 19136 raft_consensus.cc:348] T 00000000000000000000000000000000 P 260fc7f85fc04f4bab1f7458345e9c6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "260fc7f85fc04f4bab1f7458345e9c6d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37085 } }
I20260808 14:55:22.387359 19136 raft_consensus.cc:374] T 00000000000000000000000000000000 P 260fc7f85fc04f4bab1f7458345e9c6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:55:22.387480 19136 raft_consensus.cc:729] T 00000000000000000000000000000000 P 260fc7f85fc04f4bab1f7458345e9c6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 260fc7f85fc04f4bab1f7458345e9c6d, State: Initialized, Role: FOLLOWER
I20260808 14:55:22.388132 19136 consensus_queue.cc:260] T 00000000000000000000000000000000 P 260fc7f85fc04f4bab1f7458345e9c6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "260fc7f85fc04f4bab1f7458345e9c6d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37085 } }
I20260808 14:55:22.388443 19136 raft_consensus.cc:388] T 00000000000000000000000000000000 P 260fc7f85fc04f4bab1f7458345e9c6d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:55:22.388607 19136 raft_consensus.cc:482] T 00000000000000000000000000000000 P 260fc7f85fc04f4bab1f7458345e9c6d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:55:22.388787 19136 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 260fc7f85fc04f4bab1f7458345e9c6d [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:55:22.389988 27451 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:55:22.391233 19136 raft_consensus.cc:504] T 00000000000000000000000000000000 P 260fc7f85fc04f4bab1f7458345e9c6d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "260fc7f85fc04f4bab1f7458345e9c6d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37085 } }
I20260808 14:55:22.391741 19136 leader_election.cc:302] T 00000000000000000000000000000000 P 260fc7f85fc04f4bab1f7458345e9c6d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 260fc7f85fc04f4bab1f7458345e9c6d; no voters:
I20260808 14:55:22.392382 19136 leader_election.cc:288] T 00000000000000000000000000000000 P 260fc7f85fc04f4bab1f7458345e9c6d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:55:22.392463 19141 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 260fc7f85fc04f4bab1f7458345e9c6d [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:55:22.394857 19136 sys_catalog.cc:564] T 00000000000000000000000000000000 P 260fc7f85fc04f4bab1f7458345e9c6d [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:55:22.399412 19141 raft_consensus.cc:686] T 00000000000000000000000000000000 P 260fc7f85fc04f4bab1f7458345e9c6d [term 1 LEADER]: Becoming Leader. State: Replica: 260fc7f85fc04f4bab1f7458345e9c6d, State: Running, Role: LEADER
I20260808 14:55:22.400112 19141 consensus_queue.cc:237] T 00000000000000000000000000000000 P 260fc7f85fc04f4bab1f7458345e9c6d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "260fc7f85fc04f4bab1f7458345e9c6d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37085 } }
I20260808 14:55:22.403528 19145 sys_catalog.cc:455] T 00000000000000000000000000000000 P 260fc7f85fc04f4bab1f7458345e9c6d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 260fc7f85fc04f4bab1f7458345e9c6d. Latest consensus state: current_term: 1 leader_uuid: "260fc7f85fc04f4bab1f7458345e9c6d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "260fc7f85fc04f4bab1f7458345e9c6d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37085 } } }
I20260808 14:55:22.404039 19145 sys_catalog.cc:458] T 00000000000000000000000000000000 P 260fc7f85fc04f4bab1f7458345e9c6d [sys.catalog]: This master's current role is: LEADER
I20260808 14:55:22.404640 19146 sys_catalog.cc:455] T 00000000000000000000000000000000 P 260fc7f85fc04f4bab1f7458345e9c6d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "260fc7f85fc04f4bab1f7458345e9c6d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "260fc7f85fc04f4bab1f7458345e9c6d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37085 } } }
I20260808 14:55:22.404951 19146 sys_catalog.cc:458] T 00000000000000000000000000000000 P 260fc7f85fc04f4bab1f7458345e9c6d [sys.catalog]: This master's current role is: LEADER
I20260808 14:55:22.422603 19139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:22.397643 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.223:42371 (local address 127.0.0.1:37085)
0808 14:55:22.397855 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0808 14:55:22.397863 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:55:22.400200 (+ 2337us) server_negotiation.cc:407] Connection header received
0808 14:55:22.400389 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:55:22.400394 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:55:22.400475 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:55:22.400582 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:55:22.402725 (+ 2143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:22.403959 (+ 1234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:22.406304 (+ 2345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:22.407217 (+ 913us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:22.407348 (+ 131us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:55:22.411921 (+ 4573us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:55:22.411930 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:55:22.411938 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:55:22.411983 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:55:22.417703 (+ 5720us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:55:22.419092 (+ 1389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:55:22.419101 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:55:22.419107 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:55:22.419308 (+ 201us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:55:22.420133 (+ 825us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:55:22.420141 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:55:22.420146 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:55:22.420635 (+ 489us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:55:22.420953 (+ 318us) server_negotiation.cc:1035] Waiting for connection context
0808 14:55:22.421858 (+ 905us) server_negotiation.cc:299] Negotiation successful
0808 14:55:22.422097 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260808 14:55:22.426031 19157 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:55:22.430534 19157 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:55:22.439837 19157 catalog_manager.cc:1347] Generated new cluster ID: 0da1deaf8b43464a93df38f7f911da3a
I20260808 14:55:22.439947 19157 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:55:22.457492 19157 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:55:22.458683 19157 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:55:22.466728 19157 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 260fc7f85fc04f4bab1f7458345e9c6d: Generated new TSK 0
I20260808 14:55:22.467482 19157 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:55:22.476027 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 19065
I20260808 14:55:22.477500 19131 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:55:22.568293 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 19065
W20260808 14:55:22.586570 19047 connection.cc:535] client connection to 127.0.0.1:37085 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:37085): Connection reset by peer (error 104)
2026-08-08T14:55:22Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (2192 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786200577490656-27451-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:55:22 dist-test-slave-6k22 krb5kdc[19173](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:55:22 dist-test-slave-6k22 krb5kdc[19173](info): set up 2 sockets
Aug 08 14:55:22 dist-test-slave-6k22 krb5kdc[19173](info): commencing operation
krb5kdc: starting...
W20260808 14:55:23.786322 27451 mini_kdc.cc:121] Time spent starting KDC: real 1.180s user 0.000s sys 0.042s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786200577490656-27451-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786200577490656-27451-0/krb5kdc/test-user.keytab.
Aug 08 14:55:23 dist-test-slave-6k22 krb5kdc[19173](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200923, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:55:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:55:24Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786200577490656-27451-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786200577490656-27451-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 14:55:24.107182 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786200577490656-27451-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786200577490656-27451-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786200577490656-27451-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37117
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786200577490656-27451-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35921
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37117
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:55:24.452322 19186 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:55:24.452643 19186 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:55:24.452806 19186 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:55:24.460623 19186 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:55:24.460780 19186 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:55:24.460881 19186 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:55:24.461001 19186 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:55:24.461084 19186 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:55:24.471832 19186 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35921
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786200577490656-27451-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786200577490656-27451-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37117
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786200577490656-27451-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37117
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786200577490656-27451-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:55:24.473196 19186 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:55:24.474539 19186 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:55:24.486739 19193 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:55:24.486799 19195 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:55:24.487010 19191 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:55:24.487880 19186 server_base.cc:1034] running on GCE node
I20260808 14:55:24.488644 19186 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:55:24.490073 19186 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:55:24.491328 19186 hybrid_clock.cc:648] HybridClock initialized: now 1786200924491282 us; error 47 us; skew 500 ppm
I20260808 14:55:24.491781 19186 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:55:24 dist-test-slave-6k22 krb5kdc[19173](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200924, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:55:24.495208 19186 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 14:55:24.496883 19186 webserver.cc:460] Webserver started at http://127.0.0.1:43827/ using document root <none> and password file <none>
I20260808 14:55:24.497597 19186 fs_manager.cc:359] Metadata directory not provided
I20260808 14:55:24.497761 19186 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:55:24.498081 19186 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:55:24.501281 19186 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786200577490656-27451-0/minicluster-data/master-0/data/instance:
uuid: "1f6336a512a94c08932318e230fdb86a"
format_stamp: "Formatted at 2026-08-08 14:55:24 on dist-test-slave-6k22"
server_key: "b49fec9277ce69ffce9ebce6830bc25c"
server_key_iv: "a594eebf209431c31c3df9931533d974"
server_key_version: "encryptionkey@0"
I20260808 14:55:24.502092 19186 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786200577490656-27451-0/minicluster-data/master-0/wal/instance:
uuid: "1f6336a512a94c08932318e230fdb86a"
format_stamp: "Formatted at 2026-08-08 14:55:24 on dist-test-slave-6k22"
server_key: "b49fec9277ce69ffce9ebce6830bc25c"
server_key_iv: "a594eebf209431c31c3df9931533d974"
server_key_version: "encryptionkey@0"
I20260808 14:55:24.507234 19186 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260808 14:55:24.510757 19203 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:55:24.512128 19186 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 14:55:24.512297 19186 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786200577490656-27451-0/minicluster-data/master-0/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786200577490656-27451-0/minicluster-data/master-0/wal
uuid: "1f6336a512a94c08932318e230fdb86a"
format_stamp: "Formatted at 2026-08-08 14:55:24 on dist-test-slave-6k22"
server_key: "b49fec9277ce69ffce9ebce6830bc25c"
server_key_iv: "a594eebf209431c31c3df9931533d974"
server_key_version: "encryptionkey@0"
I20260808 14:55:24.512488 19186 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786200577490656-27451-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786200577490656-27451-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786200577490656-27451-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:55:24.532833 19186 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:55:24.537247 19186 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:55:24.537530 19186 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:55:24.556723 19186 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37117
I20260808 14:55:24.556761 19257 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37117 every 8 connection(s)
I20260808 14:55:24.558135 19186 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
I20260808 14:55:24.559962 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 19186
I20260808 14:55:24.560161 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786200577490656-27451-0/minicluster-data/master-0/wal/instance
I20260808 14:55:24.560750 27451 external_mini_cluster.cc:1428] Setting key 9eb5c6b85de443d5e4b496cca921e876
I20260808 14:55:24.562666 19258 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:55:24.573619 19262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:24.562467 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.223:42047 (local address 127.0.0.1:37117)
0808 14:55:24.563197 (+ 730us) server_negotiation.cc:206] Beginning negotiation
0808 14:55:24.563208 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 14:55:24.563247 (+ 39us) server_negotiation.cc:407] Connection header received
0808 14:55:24.564901 (+ 1654us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:55:24.564921 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:55:24.565283 (+ 362us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:55:24.565613 (+ 330us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:55:24.566164 (+ 551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:24.567465 (+ 1301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:24.569338 (+ 1873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:24.569936 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:24.570070 (+ 134us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:55:24.571327 (+ 1257us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:55:24.571334 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:55:24.571345 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:55:24.571933 (+ 588us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:55:24.572005 (+ 72us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:55:24.572034 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:55:24.572176 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0808 14:55:24.572545 (+ 369us) server_negotiation.cc:299] Negotiation successful
0808 14:55:24.572736 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":546,"thread_start_us":338,"threads_started":1}
I20260808 14:55:24.575084 19258 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1f6336a512a94c08932318e230fdb86a: Bootstrap starting.
I20260808 14:55:24.577502 27451 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:55:24.578433 19258 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1f6336a512a94c08932318e230fdb86a: Neither blocks nor log segments found. Creating new log.
I20260808 14:55:24.579402 19258 log.cc:824] T 00000000000000000000000000000000 P 1f6336a512a94c08932318e230fdb86a: Log is configured to *not* fsync() on all Append() calls
I20260808 14:55:24.582208 19258 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1f6336a512a94c08932318e230fdb86a: No bootstrap required, opened a new log
I20260808 14:55:24.588528 19262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:24.581979 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.223:44887 (local address 127.0.0.1:37117)
0808 14:55:24.582154 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0808 14:55:24.582161 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:55:24.582594 (+ 433us) server_negotiation.cc:407] Connection header received
0808 14:55:24.582762 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:55:24.582767 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:55:24.582841 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:55:24.582948 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:55:24.583420 (+ 472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:24.584617 (+ 1197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:24.585872 (+ 1255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:24.586555 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:24.586675 (+ 120us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:55:24.587701 (+ 1026us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:55:24.587708 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:55:24.587713 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:55:24.587733 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:55:24.587806 (+ 73us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:55:24.587828 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:55:24.587949 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0808 14:55:24.588111 (+ 162us) server_negotiation.cc:299] Negotiation successful
0808 14:55:24.588167 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260808 14:55:24.591019 19258 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1f6336a512a94c08932318e230fdb86a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f6336a512a94c08932318e230fdb86a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37117 } }
I20260808 14:55:24.591357 19258 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1f6336a512a94c08932318e230fdb86a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:55:24.591463 19258 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1f6336a512a94c08932318e230fdb86a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f6336a512a94c08932318e230fdb86a, State: Initialized, Role: FOLLOWER
I20260808 14:55:24.592068 19258 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1f6336a512a94c08932318e230fdb86a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f6336a512a94c08932318e230fdb86a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37117 } }
I20260808 14:55:24.592310 19258 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1f6336a512a94c08932318e230fdb86a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:55:24.592454 19258 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1f6336a512a94c08932318e230fdb86a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:55:24.592674 19258 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1f6336a512a94c08932318e230fdb86a [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:55:24.594877 19258 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1f6336a512a94c08932318e230fdb86a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f6336a512a94c08932318e230fdb86a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37117 } }
I20260808 14:55:24.595355 19258 leader_election.cc:302] T 00000000000000000000000000000000 P 1f6336a512a94c08932318e230fdb86a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1f6336a512a94c08932318e230fdb86a; no voters:
I20260808 14:55:24.595942 19258 leader_election.cc:288] T 00000000000000000000000000000000 P 1f6336a512a94c08932318e230fdb86a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:55:24.596066 19271 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1f6336a512a94c08932318e230fdb86a [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:55:24.596804 19271 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1f6336a512a94c08932318e230fdb86a [term 1 LEADER]: Becoming Leader. State: Replica: 1f6336a512a94c08932318e230fdb86a, State: Running, Role: LEADER
I20260808 14:55:24.597389 19271 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1f6336a512a94c08932318e230fdb86a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f6336a512a94c08932318e230fdb86a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37117 } }
I20260808 14:55:24.598122 19258 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1f6336a512a94c08932318e230fdb86a [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:55:24.600009 19272 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1f6336a512a94c08932318e230fdb86a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1f6336a512a94c08932318e230fdb86a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f6336a512a94c08932318e230fdb86a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37117 } } }
I20260808 14:55:24.600312 19272 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1f6336a512a94c08932318e230fdb86a [sys.catalog]: This master's current role is: LEADER
I20260808 14:55:24.601135 19277 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:55:24.601001 19273 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1f6336a512a94c08932318e230fdb86a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1f6336a512a94c08932318e230fdb86a. Latest consensus state: current_term: 1 leader_uuid: "1f6336a512a94c08932318e230fdb86a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f6336a512a94c08932318e230fdb86a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37117 } } }
I20260808 14:55:24.603113 19273 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1f6336a512a94c08932318e230fdb86a [sys.catalog]: This master's current role is: LEADER
I20260808 14:55:24.608647 19277 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:55:24.616328 19277 catalog_manager.cc:1347] Generated new cluster ID: 59b88dd2670249e6a74ec74e3eee19d0
I20260808 14:55:24.616432 19277 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:55:24.629590 19277 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:55:24.630753 19277 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:55:24.645232 19277 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1f6336a512a94c08932318e230fdb86a: Generated new TSK 0
I20260808 14:55:24.646066 19277 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:55:24.654795 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 19186
W20260808 14:55:24.656402 19252 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.223:42047
W20260808 14:55:24.657308 27451 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 19186: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 14:55:24.657514 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 19186
W20260808 14:55:24.676209 19171 connection.cc:535] client connection to 127.0.0.1:37117 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:37117): Connection reset by peer (error 104)
2026-08-08T14:55:24Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (2089 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786200577490656-27451-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:55:24 dist-test-slave-6k22 krb5kdc[19293](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:55:24 dist-test-slave-6k22 krb5kdc[19293](info): set up 2 sockets
Aug 08 14:55:24 dist-test-slave-6k22 krb5kdc[19293](info): commencing operation
krb5kdc: starting...
W20260808 14:55:25.845847 27451 mini_kdc.cc:121] Time spent starting KDC: real 1.151s user 0.004s sys 0.039s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786200577490656-27451-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786200577490656-27451-0/krb5kdc/test-user.keytab.
Aug 08 14:55:26 dist-test-slave-6k22 krb5kdc[19293](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200926, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:55:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:55:26Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786200577490656-27451-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786200577490656-27451-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 14:55:26.142738 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786200577490656-27451-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786200577490656-27451-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786200577490656-27451-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44825
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786200577490656-27451-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44967
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:44825
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:55:26.476604 19309 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:55:26.476924 19309 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:55:26.477073 19309 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:55:26.484380 19309 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:55:26.484510 19309 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:55:26.484602 19309 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:55:26.484699 19309 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:55:26.484807 19309 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:55:26.494414 19309 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44967
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786200577490656-27451-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786200577490656-27451-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:44825
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786200577490656-27451-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44825
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786200577490656-27451-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:55:26.495711 19309 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:55:26.497066 19309 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:55:26.508477 19314 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:55:26.508445 19317 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:55:26.508527 19315 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:55:26.509274 19309 server_base.cc:1034] running on GCE node
I20260808 14:55:26.509977 19309 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:55:26.511263 19309 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:55:26.512478 19309 hybrid_clock.cc:648] HybridClock initialized: now 1786200926512421 us; error 31 us; skew 500 ppm
I20260808 14:55:26.512821 19309 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:55:26 dist-test-slave-6k22 krb5kdc[19293](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200926, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:55:26.520835 19309 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 14:55:26.522305 19309 webserver.cc:460] Webserver started at http://127.0.0.1:38145/ using document root <none> and password file <none>
I20260808 14:55:26.522933 19309 fs_manager.cc:359] Metadata directory not provided
I20260808 14:55:26.523084 19309 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:55:26.523378 19309 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:55:26.526257 19309 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786200577490656-27451-0/minicluster-data/master-0/data/instance:
uuid: "3daa6576072441fb82ba7bf3a4bd6ef1"
format_stamp: "Formatted at 2026-08-08 14:55:26 on dist-test-slave-6k22"
server_key: "37926a12a2307292644decdb28a81064"
server_key_iv: "fa2b5d31f8da9bc697cde76cde1d6ac5"
server_key_version: "encryptionkey@0"
I20260808 14:55:26.526993 19309 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786200577490656-27451-0/minicluster-data/master-0/wal/instance:
uuid: "3daa6576072441fb82ba7bf3a4bd6ef1"
format_stamp: "Formatted at 2026-08-08 14:55:26 on dist-test-slave-6k22"
server_key: "37926a12a2307292644decdb28a81064"
server_key_iv: "fa2b5d31f8da9bc697cde76cde1d6ac5"
server_key_version: "encryptionkey@0"
I20260808 14:55:26.531936 19309 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260808 14:55:26.535270 19324 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:55:26.536855 19309 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260808 14:55:26.537004 19309 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786200577490656-27451-0/minicluster-data/master-0/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786200577490656-27451-0/minicluster-data/master-0/wal
uuid: "3daa6576072441fb82ba7bf3a4bd6ef1"
format_stamp: "Formatted at 2026-08-08 14:55:26 on dist-test-slave-6k22"
server_key: "37926a12a2307292644decdb28a81064"
server_key_iv: "fa2b5d31f8da9bc697cde76cde1d6ac5"
server_key_version: "encryptionkey@0"
I20260808 14:55:26.537199 19309 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786200577490656-27451-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786200577490656-27451-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786200577490656-27451-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:55:26.542586 19309 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:55:26.546257 19309 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:55:26.546552 19309 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:55:26.564002 19309 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:44825
I20260808 14:55:26.564065 19378 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:44825 every 8 connection(s)
I20260808 14:55:26.565325 19309 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
I20260808 14:55:26.568727 19379 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:55:26.570369 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 19309
I20260808 14:55:26.570570 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786200577490656-27451-0/minicluster-data/master-0/wal/instance
I20260808 14:55:26.571084 27451 external_mini_cluster.cc:1428] Setting key 1db84038881a58b84e67c6f102823a4e
I20260808 14:55:26.578408 19383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:26.572826 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.223:45171 (local address 127.0.0.1:44825)
0808 14:55:26.573585 (+ 759us) server_negotiation.cc:206] Beginning negotiation
0808 14:55:26.573599 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 14:55:26.573638 (+ 39us) server_negotiation.cc:407] Connection header received
0808 14:55:26.575116 (+ 1478us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:55:26.575141 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:55:26.575489 (+ 348us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:55:26.575861 (+ 372us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:55:26.576908 (+ 1047us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:55:26.576914 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:55:26.576926 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:55:26.576939 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:55:26.576993 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:55:26.577014 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:55:26.577172 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0808 14:55:26.577301 (+ 129us) server_negotiation.cc:299] Negotiation successful
0808 14:55:26.577484 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":560,"thread_start_us":357,"threads_started":1}
I20260808 14:55:26.581943 27451 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:55:26.581964 19379 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3daa6576072441fb82ba7bf3a4bd6ef1: Bootstrap starting.
I20260808 14:55:26.585831 19379 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3daa6576072441fb82ba7bf3a4bd6ef1: Neither blocks nor log segments found. Creating new log.
I20260808 14:55:26.587158 19379 log.cc:824] T 00000000000000000000000000000000 P 3daa6576072441fb82ba7bf3a4bd6ef1: Log is configured to *not* fsync() on all Append() calls
I20260808 14:55:26.590139 19383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:26.587538 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.223:50025 (local address 127.0.0.1:44825)
0808 14:55:26.587761 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0808 14:55:26.587769 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:55:26.588202 (+ 433us) server_negotiation.cc:407] Connection header received
0808 14:55:26.588334 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:55:26.588342 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:55:26.588405 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:55:26.588535 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:55:26.589505 (+ 970us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:55:26.589510 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:55:26.589513 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:55:26.589527 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:55:26.589561 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:55:26.589575 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:55:26.589660 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0808 14:55:26.589815 (+ 155us) server_negotiation.cc:299] Negotiation successful
0808 14:55:26.589861 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260808 14:55:26.590971 19379 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3daa6576072441fb82ba7bf3a4bd6ef1: No bootstrap required, opened a new log
I20260808 14:55:26.599412 19379 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3daa6576072441fb82ba7bf3a4bd6ef1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3daa6576072441fb82ba7bf3a4bd6ef1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44825 } }
I20260808 14:55:26.599888 19379 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3daa6576072441fb82ba7bf3a4bd6ef1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:55:26.599980 19379 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3daa6576072441fb82ba7bf3a4bd6ef1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3daa6576072441fb82ba7bf3a4bd6ef1, State: Initialized, Role: FOLLOWER
I20260808 14:55:26.600492 19379 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3daa6576072441fb82ba7bf3a4bd6ef1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3daa6576072441fb82ba7bf3a4bd6ef1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44825 } }
I20260808 14:55:26.600716 19379 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3daa6576072441fb82ba7bf3a4bd6ef1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:55:26.600831 19379 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3daa6576072441fb82ba7bf3a4bd6ef1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:55:26.601001 19379 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3daa6576072441fb82ba7bf3a4bd6ef1 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:55:26.603453 19379 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3daa6576072441fb82ba7bf3a4bd6ef1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3daa6576072441fb82ba7bf3a4bd6ef1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44825 } }
I20260808 14:55:26.603991 19379 leader_election.cc:302] T 00000000000000000000000000000000 P 3daa6576072441fb82ba7bf3a4bd6ef1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3daa6576072441fb82ba7bf3a4bd6ef1; no voters:
I20260808 14:55:26.604568 19379 leader_election.cc:288] T 00000000000000000000000000000000 P 3daa6576072441fb82ba7bf3a4bd6ef1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:55:26.604672 19391 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3daa6576072441fb82ba7bf3a4bd6ef1 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:55:26.605479 19391 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3daa6576072441fb82ba7bf3a4bd6ef1 [term 1 LEADER]: Becoming Leader. State: Replica: 3daa6576072441fb82ba7bf3a4bd6ef1, State: Running, Role: LEADER
I20260808 14:55:26.606069 19391 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3daa6576072441fb82ba7bf3a4bd6ef1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3daa6576072441fb82ba7bf3a4bd6ef1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44825 } }
I20260808 14:55:26.606865 19379 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3daa6576072441fb82ba7bf3a4bd6ef1 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:55:26.608788 19393 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3daa6576072441fb82ba7bf3a4bd6ef1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3daa6576072441fb82ba7bf3a4bd6ef1. Latest consensus state: current_term: 1 leader_uuid: "3daa6576072441fb82ba7bf3a4bd6ef1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3daa6576072441fb82ba7bf3a4bd6ef1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44825 } } }
I20260808 14:55:26.608974 19392 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3daa6576072441fb82ba7bf3a4bd6ef1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3daa6576072441fb82ba7bf3a4bd6ef1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3daa6576072441fb82ba7bf3a4bd6ef1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44825 } } }
I20260808 14:55:26.609377 19393 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3daa6576072441fb82ba7bf3a4bd6ef1 [sys.catalog]: This master's current role is: LEADER
I20260808 14:55:26.609397 19392 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3daa6576072441fb82ba7bf3a4bd6ef1 [sys.catalog]: This master's current role is: LEADER
I20260808 14:55:26.610536 19398 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:55:26.616370 19398 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:55:26.625598 19398 catalog_manager.cc:1347] Generated new cluster ID: e93599b011a34779a805b708e686cf4a
I20260808 14:55:26.625713 19398 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:55:26.650521 19398 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:55:26.650950 19398 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:55:26.656320 19398 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3daa6576072441fb82ba7bf3a4bd6ef1: Generated new TSK 0
I20260808 14:55:26.657042 19398 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:55:26.664238 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 19309
W20260808 14:55:26.665518 19374 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.223:45171
W20260808 14:55:26.666241 27451 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 19309: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 14:55:26.666380 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 19309
2026-08-08T14:55:26Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (2009 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786200577490656-27451-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:55:26 dist-test-slave-6k22 krb5kdc[19414](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:55:26 dist-test-slave-6k22 krb5kdc[19414](info): set up 2 sockets
Aug 08 14:55:26 dist-test-slave-6k22 krb5kdc[19414](info): commencing operation
krb5kdc: starting...
W20260808 14:55:27.853984 27451 mini_kdc.cc:121] Time spent starting KDC: real 1.150s user 0.000s sys 0.042s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786200577490656-27451-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786200577490656-27451-0/krb5kdc/test-user.keytab.
Aug 08 14:55:28 dist-test-slave-6k22 krb5kdc[19414](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200928, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:55:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:55:28Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.206.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.206.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.206.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.254.keytab.
Entry for principal kudu/127.26.206.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.254.keytab.
I20260808 14:55:28.155423 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786200577490656-27451-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786200577490656-27451-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786200577490656-27451-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.206.254:33937
--webserver_interface=127.26.206.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.254.keytab
--principal=kudu/127.26.206.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.206.212:46655
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.206.254:33937
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:55:28.489094 19428 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:55:28.489374 19428 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:55:28.489473 19428 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:55:28.496723 19428 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:55:28.496835 19428 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:55:28.496881 19428 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:55:28.496943 19428 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:55:28.496986 19428 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:55:28.506422 19428 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:46655
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786200577490656-27451-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786200577490656-27451-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.206.254:33937
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.254.keytab
--principal=kudu/127.26.206.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.206.254:33937
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.206.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786200577490656-27451-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:55:28.507594 19428 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:55:28.508828 19428 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:55:28.520346 19433 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:55:28.520318 19434 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:55:28.520224 19436 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:55:28.521497 19428 server_base.cc:1034] running on GCE node
I20260808 14:55:28.522193 19428 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:55:28.523525 19428 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:55:28.524770 19428 hybrid_clock.cc:648] HybridClock initialized: now 1786200928524727 us; error 35 us; skew 500 ppm
I20260808 14:55:28.525099 19428 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:55:28 dist-test-slave-6k22 krb5kdc[19414](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200928, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:55:28.528127 19428 init.cc:377] Logged in from keytab as kudu/127.26.206.254@KRBTEST.COM (short username kudu)
I20260808 14:55:28.529486 19428 webserver.cc:460] Webserver started at http://127.26.206.254:33465/ using document root <none> and password file <none>
I20260808 14:55:28.530149 19428 fs_manager.cc:359] Metadata directory not provided
I20260808 14:55:28.530284 19428 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:55:28.530581 19428 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:55:28.533543 19428 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786200577490656-27451-0/minicluster-data/master-0/data/instance:
uuid: "1b88709b0b0b47ada31595ebac12a6ca"
format_stamp: "Formatted at 2026-08-08 14:55:28 on dist-test-slave-6k22"
server_key: "e850b9e93bf2d31c240b510ecb9d1592"
server_key_iv: "035b5a061acb51f612985366ca119f2b"
server_key_version: "encryptionkey@0"
I20260808 14:55:28.534279 19428 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786200577490656-27451-0/minicluster-data/master-0/wal/instance:
uuid: "1b88709b0b0b47ada31595ebac12a6ca"
format_stamp: "Formatted at 2026-08-08 14:55:28 on dist-test-slave-6k22"
server_key: "e850b9e93bf2d31c240b510ecb9d1592"
server_key_iv: "035b5a061acb51f612985366ca119f2b"
server_key_version: "encryptionkey@0"
I20260808 14:55:28.539300 19428 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260808 14:55:28.542655 19443 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:55:28.543985 19428 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 14:55:28.544171 19428 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786200577490656-27451-0/minicluster-data/master-0/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786200577490656-27451-0/minicluster-data/master-0/wal
uuid: "1b88709b0b0b47ada31595ebac12a6ca"
format_stamp: "Formatted at 2026-08-08 14:55:28 on dist-test-slave-6k22"
server_key: "e850b9e93bf2d31c240b510ecb9d1592"
server_key_iv: "035b5a061acb51f612985366ca119f2b"
server_key_version: "encryptionkey@0"
I20260808 14:55:28.544360 19428 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786200577490656-27451-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786200577490656-27451-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786200577490656-27451-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:55:28.568679 19428 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:55:28.572932 19428 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:55:28.573233 19428 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:55:28.591635 19428 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.254:33937
I20260808 14:55:28.591719 19496 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.254:33937 every 8 connection(s)
I20260808 14:55:28.593003 19428 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
I20260808 14:55:28.594691 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 19428
I20260808 14:55:28.594882 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786200577490656-27451-0/minicluster-data/master-0/wal/instance
I20260808 14:55:28.595530 27451 external_mini_cluster.cc:1428] Setting key c27a93c311d8f9360e217b24e1b73fb8
I20260808 14:55:28.597651 19497 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 08 14:55:28 dist-test-slave-6k22 krb5kdc[19414](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200928, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.206.254@KRBTEST.COM
I20260808 14:55:28.612778 19497 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1b88709b0b0b47ada31595ebac12a6ca: Bootstrap starting.
I20260808 14:55:28.617506 19497 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1b88709b0b0b47ada31595ebac12a6ca: Neither blocks nor log segments found. Creating new log.
I20260808 14:55:28.619061 19497 log.cc:824] T 00000000000000000000000000000000 P 1b88709b0b0b47ada31595ebac12a6ca: Log is configured to *not* fsync() on all Append() calls
I20260808 14:55:28.621763 19501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:28.597469 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33295 (local address 127.26.206.254:33937)
0808 14:55:28.598510 (+ 1041us) server_negotiation.cc:206] Beginning negotiation
0808 14:55:28.598521 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 14:55:28.598562 (+ 41us) server_negotiation.cc:407] Connection header received
0808 14:55:28.600578 (+ 2016us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:55:28.600599 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:55:28.600994 (+ 395us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:55:28.601341 (+ 347us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:55:28.603248 (+ 1907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:28.604723 (+ 1475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:28.606558 (+ 1835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:28.607207 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:28.607345 (+ 138us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:55:28.612548 (+ 5203us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:55:28.612558 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:55:28.612576 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:55:28.612629 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:55:28.617035 (+ 4406us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:55:28.617835 (+ 800us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:55:28.617845 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:55:28.617855 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:55:28.618091 (+ 236us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:55:28.618616 (+ 525us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:55:28.618621 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:55:28.618624 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:55:28.619462 (+ 838us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:55:28.619882 (+ 420us) server_negotiation.cc:1035] Waiting for connection context
0808 14:55:28.620361 (+ 479us) server_negotiation.cc:299] Negotiation successful
0808 14:55:28.620705 (+ 344us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":819,"thread_start_us":558,"threads_started":1}
I20260808 14:55:28.622448 19497 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1b88709b0b0b47ada31595ebac12a6ca: No bootstrap required, opened a new log
I20260808 14:55:28.625967 27451 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:55:28.631181 19497 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1b88709b0b0b47ada31595ebac12a6ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b88709b0b0b47ada31595ebac12a6ca" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 33937 } }
I20260808 14:55:28.631539 19497 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1b88709b0b0b47ada31595ebac12a6ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:55:28.631711 19497 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1b88709b0b0b47ada31595ebac12a6ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b88709b0b0b47ada31595ebac12a6ca, State: Initialized, Role: FOLLOWER
I20260808 14:55:28.632383 19497 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1b88709b0b0b47ada31595ebac12a6ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b88709b0b0b47ada31595ebac12a6ca" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 33937 } }
I20260808 14:55:28.632670 19497 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1b88709b0b0b47ada31595ebac12a6ca [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:55:28.632828 19497 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1b88709b0b0b47ada31595ebac12a6ca [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:55:28.633025 19497 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1b88709b0b0b47ada31595ebac12a6ca [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:55:28.636487 19497 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1b88709b0b0b47ada31595ebac12a6ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b88709b0b0b47ada31595ebac12a6ca" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 33937 } }
I20260808 14:55:28.637076 19497 leader_election.cc:302] T 00000000000000000000000000000000 P 1b88709b0b0b47ada31595ebac12a6ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1b88709b0b0b47ada31595ebac12a6ca; no voters:
I20260808 14:55:28.637745 19497 leader_election.cc:288] T 00000000000000000000000000000000 P 1b88709b0b0b47ada31595ebac12a6ca [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:55:28.637967 19508 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1b88709b0b0b47ada31595ebac12a6ca [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:55:28.639979 19497 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1b88709b0b0b47ada31595ebac12a6ca [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:55:28.646034 19508 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1b88709b0b0b47ada31595ebac12a6ca [term 1 LEADER]: Becoming Leader. State: Replica: 1b88709b0b0b47ada31595ebac12a6ca, State: Running, Role: LEADER
I20260808 14:55:28.646863 19508 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1b88709b0b0b47ada31595ebac12a6ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b88709b0b0b47ada31595ebac12a6ca" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 33937 } }
I20260808 14:55:28.650619 19510 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1b88709b0b0b47ada31595ebac12a6ca [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1b88709b0b0b47ada31595ebac12a6ca. Latest consensus state: current_term: 1 leader_uuid: "1b88709b0b0b47ada31595ebac12a6ca" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b88709b0b0b47ada31595ebac12a6ca" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 33937 } } }
I20260808 14:55:28.651074 19510 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1b88709b0b0b47ada31595ebac12a6ca [sys.catalog]: This master's current role is: LEADER
I20260808 14:55:28.650873 19509 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1b88709b0b0b47ada31595ebac12a6ca [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1b88709b0b0b47ada31595ebac12a6ca" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b88709b0b0b47ada31595ebac12a6ca" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 33937 } } }
I20260808 14:55:28.651255 19509 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1b88709b0b0b47ada31595ebac12a6ca [sys.catalog]: This master's current role is: LEADER
I20260808 14:55:28.654193 19518 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:55:28.656327 19501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:28.633666 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59849 (local address 127.26.206.254:33937)
0808 14:55:28.633920 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0808 14:55:28.633935 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 14:55:28.634318 (+ 383us) server_negotiation.cc:407] Connection header received
0808 14:55:28.634530 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:55:28.634534 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:55:28.634600 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:55:28.634688 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:55:28.636708 (+ 2020us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:28.638226 (+ 1518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:28.639719 (+ 1493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:28.640463 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:28.640611 (+ 148us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:55:28.644940 (+ 4329us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:55:28.644950 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:55:28.644958 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:55:28.645014 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:55:28.650237 (+ 5223us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:55:28.653093 (+ 2856us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:55:28.653102 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:55:28.653106 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:55:28.653377 (+ 271us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:55:28.654114 (+ 737us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:55:28.654120 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:55:28.654123 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:55:28.654628 (+ 505us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:55:28.655014 (+ 386us) server_negotiation.cc:1035] Waiting for connection context
0808 14:55:28.655784 (+ 770us) server_negotiation.cc:299] Negotiation successful
0808 14:55:28.655970 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260808 14:55:28.659972 19518 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:55:28.669862 19518 catalog_manager.cc:1347] Generated new cluster ID: a073c1c0fc094e789a76a303fa3e872e
I20260808 14:55:28.669983 19518 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:55:28.685140 19518 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:55:28.686331 19518 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:55:28.693854 19518 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1b88709b0b0b47ada31595ebac12a6ca: Generated new TSK 0
I20260808 14:55:28.694694 19518 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:55:28.705340 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 19428
I20260808 14:55:28.706805 19492 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:55:28.796586 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 19428
W20260808 14:55:28.817207 19411 connection.cc:535] client connection to 127.26.206.254:33937 recv error: Network error: failed to read from TLS socket (remote: 127.26.206.254:33937): Connection reset by peer (error 104)
2026-08-08T14:55:28Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (2131 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786200577490656-27451-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:55:28 dist-test-slave-6k22 krb5kdc[19532](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:55:28 dist-test-slave-6k22 krb5kdc[19532](info): set up 2 sockets
Aug 08 14:55:28 dist-test-slave-6k22 krb5kdc[19532](info): commencing operation
krb5kdc: starting...
W20260808 14:55:29.969914 27451 mini_kdc.cc:121] Time spent starting KDC: real 1.134s user 0.000s sys 0.043s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786200577490656-27451-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786200577490656-27451-0/krb5kdc/test-user.keytab.
Aug 08 14:55:30 dist-test-slave-6k22 krb5kdc[19532](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200930, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:55:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:55:30Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.206.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.206.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.206.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.254.keytab.
Entry for principal kudu/127.26.206.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.254.keytab.
I20260808 14:55:30.279202 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786200577490656-27451-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786200577490656-27451-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786200577490656-27451-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.206.254:37755
--webserver_interface=127.26.206.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.254.keytab
--principal=kudu/127.26.206.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.206.212:44201
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.206.254:37755
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:55:30.620131 19545 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:55:30.620402 19545 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:55:30.620502 19545 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:55:30.627353 19545 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:55:30.627461 19545 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:55:30.627506 19545 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:55:30.627632 19545 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:55:30.627700 19545 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:55:30.637117 19545 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:44201
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786200577490656-27451-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786200577490656-27451-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.206.254:37755
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.254.keytab
--principal=kudu/127.26.206.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.206.254:37755
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.206.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786200577490656-27451-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:55:30.638319 19545 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:55:30.639693 19545 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:55:30.652027 19551 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:55:30.652094 19553 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:55:30.652204 19550 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:55:30.653103 19545 server_base.cc:1034] running on GCE node
I20260808 14:55:30.653952 19545 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:55:30.655331 19545 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:55:30.656594 19545 hybrid_clock.cc:648] HybridClock initialized: now 1786200930656515 us; error 53 us; skew 500 ppm
I20260808 14:55:30.657006 19545 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:55:30 dist-test-slave-6k22 krb5kdc[19532](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200930, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:55:30.660341 19545 init.cc:377] Logged in from keytab as kudu/127.26.206.254@KRBTEST.COM (short username kudu)
I20260808 14:55:30.661938 19545 webserver.cc:460] Webserver started at http://127.26.206.254:40539/ using document root <none> and password file <none>
I20260808 14:55:30.662660 19545 fs_manager.cc:359] Metadata directory not provided
I20260808 14:55:30.662832 19545 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:55:30.663160 19545 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:55:30.666373 19545 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786200577490656-27451-0/minicluster-data/master-0/data/instance:
uuid: "1e6f6596fbd04260ae420743e09d744b"
format_stamp: "Formatted at 2026-08-08 14:55:30 on dist-test-slave-6k22"
server_key: "1aef928cad098fa54726c4b1e2938cad"
server_key_iv: "8fe413597bb7be1a739b318c2faae210"
server_key_version: "encryptionkey@0"
I20260808 14:55:30.667187 19545 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786200577490656-27451-0/minicluster-data/master-0/wal/instance:
uuid: "1e6f6596fbd04260ae420743e09d744b"
format_stamp: "Formatted at 2026-08-08 14:55:30 on dist-test-slave-6k22"
server_key: "1aef928cad098fa54726c4b1e2938cad"
server_key_iv: "8fe413597bb7be1a739b318c2faae210"
server_key_version: "encryptionkey@0"
I20260808 14:55:30.672828 19545 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.002s
I20260808 14:55:30.676477 19561 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:55:30.677764 19545 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 14:55:30.677980 19545 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786200577490656-27451-0/minicluster-data/master-0/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786200577490656-27451-0/minicluster-data/master-0/wal
uuid: "1e6f6596fbd04260ae420743e09d744b"
format_stamp: "Formatted at 2026-08-08 14:55:30 on dist-test-slave-6k22"
server_key: "1aef928cad098fa54726c4b1e2938cad"
server_key_iv: "8fe413597bb7be1a739b318c2faae210"
server_key_version: "encryptionkey@0"
I20260808 14:55:30.678200 19545 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786200577490656-27451-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786200577490656-27451-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786200577490656-27451-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:55:30.700978 19545 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:55:30.705086 19545 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:55:30.705394 19545 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:55:30.724838 19545 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.254:37755
I20260808 14:55:30.724859 19615 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.254:37755 every 8 connection(s)
I20260808 14:55:30.726223 19545 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
I20260808 14:55:30.729918 19616 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:55:30.732256 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 19545
I20260808 14:55:30.732457 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786200577490656-27451-0/minicluster-data/master-0/wal/instance
I20260808 14:55:30.733013 27451 external_mini_cluster.cc:1428] Setting key 30c5b8a68723a58f6d0cee9bc8b9a687
I20260808 14:55:30.743284 19616 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1e6f6596fbd04260ae420743e09d744b: Bootstrap starting.
I20260808 14:55:30.747130 19616 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1e6f6596fbd04260ae420743e09d744b: Neither blocks nor log segments found. Creating new log.
I20260808 14:55:30.747466 19619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:30.734927 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34181 (local address 127.26.206.254:37755)
0808 14:55:30.735806 (+ 879us) server_negotiation.cc:206] Beginning negotiation
0808 14:55:30.735821 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 14:55:30.735863 (+ 42us) server_negotiation.cc:407] Connection header received
0808 14:55:30.737500 (+ 1637us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:55:30.737520 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:55:30.737915 (+ 395us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:55:30.738219 (+ 304us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:55:30.738904 (+ 685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:30.740400 (+ 1496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:30.742441 (+ 2041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:30.743122 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:30.743246 (+ 124us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:55:30.744742 (+ 1496us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:55:30.744750 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:55:30.744764 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:55:30.745448 (+ 684us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:55:30.745531 (+ 83us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:55:30.745559 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:55:30.745683 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0808 14:55:30.746118 (+ 435us) server_negotiation.cc:299] Negotiation successful
0808 14:55:30.746309 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":676,"thread_start_us":358,"threads_started":1}
I20260808 14:55:30.748456 19616 log.cc:824] T 00000000000000000000000000000000 P 1e6f6596fbd04260ae420743e09d744b: Log is configured to *not* fsync() on all Append() calls
I20260808 14:55:30.751579 27451 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:55:30.751722 19616 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1e6f6596fbd04260ae420743e09d744b: No bootstrap required, opened a new log
I20260808 14:55:30.762763 19616 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1e6f6596fbd04260ae420743e09d744b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e6f6596fbd04260ae420743e09d744b" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 37755 } }
I20260808 14:55:30.763296 19616 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1e6f6596fbd04260ae420743e09d744b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:55:30.763450 19616 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1e6f6596fbd04260ae420743e09d744b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e6f6596fbd04260ae420743e09d744b, State: Initialized, Role: FOLLOWER
I20260808 14:55:30.764017 19619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:30.756874 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54713 (local address 127.26.206.254:37755)
0808 14:55:30.757047 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0808 14:55:30.757051 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:55:30.757498 (+ 447us) server_negotiation.cc:407] Connection header received
0808 14:55:30.757685 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:55:30.757689 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:55:30.757753 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:55:30.757829 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:55:30.758520 (+ 691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:30.759283 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:30.761380 (+ 2097us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:30.761808 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:30.761916 (+ 108us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:55:30.763150 (+ 1234us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:55:30.763155 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:55:30.763158 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:55:30.763173 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:55:30.763235 (+ 62us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:55:30.763257 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:55:30.763387 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0808 14:55:30.763641 (+ 254us) server_negotiation.cc:299] Negotiation successful
0808 14:55:30.763691 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260808 14:55:30.764204 19616 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1e6f6596fbd04260ae420743e09d744b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e6f6596fbd04260ae420743e09d744b" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 37755 } }
I20260808 14:55:30.764519 19616 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1e6f6596fbd04260ae420743e09d744b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:55:30.764722 19616 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1e6f6596fbd04260ae420743e09d744b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:55:30.764928 19616 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1e6f6596fbd04260ae420743e09d744b [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:55:30.767292 19616 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1e6f6596fbd04260ae420743e09d744b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e6f6596fbd04260ae420743e09d744b" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 37755 } }
I20260808 14:55:30.767956 19616 leader_election.cc:302] T 00000000000000000000000000000000 P 1e6f6596fbd04260ae420743e09d744b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1e6f6596fbd04260ae420743e09d744b; no voters:
I20260808 14:55:30.768734 19616 leader_election.cc:288] T 00000000000000000000000000000000 P 1e6f6596fbd04260ae420743e09d744b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:55:30.768834 19626 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1e6f6596fbd04260ae420743e09d744b [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:55:30.769627 19626 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1e6f6596fbd04260ae420743e09d744b [term 1 LEADER]: Becoming Leader. State: Replica: 1e6f6596fbd04260ae420743e09d744b, State: Running, Role: LEADER
I20260808 14:55:30.770184 19626 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1e6f6596fbd04260ae420743e09d744b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e6f6596fbd04260ae420743e09d744b" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 37755 } }
I20260808 14:55:30.771081 19616 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1e6f6596fbd04260ae420743e09d744b [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:55:30.773279 19627 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1e6f6596fbd04260ae420743e09d744b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1e6f6596fbd04260ae420743e09d744b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e6f6596fbd04260ae420743e09d744b" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 37755 } } }
I20260808 14:55:30.773259 19628 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1e6f6596fbd04260ae420743e09d744b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1e6f6596fbd04260ae420743e09d744b. Latest consensus state: current_term: 1 leader_uuid: "1e6f6596fbd04260ae420743e09d744b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e6f6596fbd04260ae420743e09d744b" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 37755 } } }
I20260808 14:55:30.773769 19627 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1e6f6596fbd04260ae420743e09d744b [sys.catalog]: This master's current role is: LEADER
I20260808 14:55:30.773769 19628 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1e6f6596fbd04260ae420743e09d744b [sys.catalog]: This master's current role is: LEADER
I20260808 14:55:30.775826 19633 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:55:30.781189 19633 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:55:30.789517 19633 catalog_manager.cc:1347] Generated new cluster ID: a7fc976872c14baf82854917147521b7
I20260808 14:55:30.789618 19633 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:55:30.802248 19633 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:55:30.803504 19633 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:55:30.809441 19633 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1e6f6596fbd04260ae420743e09d744b: Generated new TSK 0
I20260808 14:55:30.810144 19633 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:55:30.815968 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 19545
W20260808 14:55:30.817066 19611 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:34181
W20260808 14:55:30.817791 27451 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 19545: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 14:55:30.817948 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 19545
W20260808 14:55:30.838037 19530 connection.cc:535] client connection to 127.26.206.254:37755 recv error: Network error: failed to read from TLS socket (remote: 127.26.206.254:37755): Connection reset by peer (error 104)
2026-08-08T14:55:30Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (2020 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786200577490656-27451-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:55:30 dist-test-slave-6k22 krb5kdc[19648](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:55:30 dist-test-slave-6k22 krb5kdc[19648](info): set up 2 sockets
Aug 08 14:55:30 dist-test-slave-6k22 krb5kdc[19648](info): commencing operation
krb5kdc: starting...
W20260808 14:55:31.987766 27451 mini_kdc.cc:121] Time spent starting KDC: real 1.131s user 0.000s sys 0.043s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786200577490656-27451-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786200577490656-27451-0/krb5kdc/test-user.keytab.
Aug 08 14:55:32 dist-test-slave-6k22 krb5kdc[19648](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200932, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:55:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:55:32Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.206.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.206.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.206.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.254.keytab.
Entry for principal kudu/127.26.206.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.254.keytab.
I20260808 14:55:32.290395 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786200577490656-27451-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786200577490656-27451-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786200577490656-27451-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.206.254:39131
--webserver_interface=127.26.206.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.254.keytab
--principal=kudu/127.26.206.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.206.212:40089
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.206.254:39131
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:55:32.627588 19661 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:55:32.627890 19661 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:55:32.628065 19661 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:55:32.635021 19661 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:55:32.635123 19661 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:55:32.635169 19661 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:55:32.635285 19661 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:55:32.635366 19661 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:55:32.645772 19661 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:40089
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786200577490656-27451-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786200577490656-27451-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.206.254:39131
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.254.keytab
--principal=kudu/127.26.206.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.206.254:39131
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.206.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786200577490656-27451-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:55:32.647063 19661 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:55:32.648468 19661 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:55:32.660414 19667 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:55:32.660414 19668 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:55:32.660458 19670 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:55:32.661276 19661 server_base.cc:1034] running on GCE node
I20260808 14:55:32.662038 19661 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:55:32.663336 19661 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:55:32.664561 19661 hybrid_clock.cc:648] HybridClock initialized: now 1786200932664506 us; error 63 us; skew 500 ppm
I20260808 14:55:32.664987 19661 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:55:32 dist-test-slave-6k22 krb5kdc[19648](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200932, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:55:32.672869 19661 init.cc:377] Logged in from keytab as kudu/127.26.206.254@KRBTEST.COM (short username kudu)
I20260808 14:55:32.674364 19661 webserver.cc:460] Webserver started at http://127.26.206.254:38695/ using document root <none> and password file <none>
I20260808 14:55:32.675010 19661 fs_manager.cc:359] Metadata directory not provided
I20260808 14:55:32.675176 19661 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:55:32.675489 19661 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:55:32.678390 19661 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786200577490656-27451-0/minicluster-data/master-0/data/instance:
uuid: "6e00521edeca4203b00b3c0aa8034727"
format_stamp: "Formatted at 2026-08-08 14:55:32 on dist-test-slave-6k22"
server_key: "115aa44bfae1bb17de5e0b77163d4ffe"
server_key_iv: "d2068e6382c3626938467c4e2671c210"
server_key_version: "encryptionkey@0"
I20260808 14:55:32.679167 19661 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786200577490656-27451-0/minicluster-data/master-0/wal/instance:
uuid: "6e00521edeca4203b00b3c0aa8034727"
format_stamp: "Formatted at 2026-08-08 14:55:32 on dist-test-slave-6k22"
server_key: "115aa44bfae1bb17de5e0b77163d4ffe"
server_key_iv: "d2068e6382c3626938467c4e2671c210"
server_key_version: "encryptionkey@0"
I20260808 14:55:32.684144 19661 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260808 14:55:32.687657 19677 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:55:32.688887 19661 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 14:55:32.689076 19661 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786200577490656-27451-0/minicluster-data/master-0/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786200577490656-27451-0/minicluster-data/master-0/wal
uuid: "6e00521edeca4203b00b3c0aa8034727"
format_stamp: "Formatted at 2026-08-08 14:55:32 on dist-test-slave-6k22"
server_key: "115aa44bfae1bb17de5e0b77163d4ffe"
server_key_iv: "d2068e6382c3626938467c4e2671c210"
server_key_version: "encryptionkey@0"
I20260808 14:55:32.689296 19661 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786200577490656-27451-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786200577490656-27451-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786200577490656-27451-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:55:32.694962 19661 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:55:32.698815 19661 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:55:32.699117 19661 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:55:32.717645 19661 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.254:39131
I20260808 14:55:32.717734 19730 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.254:39131 every 8 connection(s)
I20260808 14:55:32.719015 19661 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
I20260808 14:55:32.722548 19731 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:55:32.728188 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 19661
I20260808 14:55:32.728391 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786200577490656-27451-0/minicluster-data/master-0/wal/instance
I20260808 14:55:32.728972 27451 external_mini_cluster.cc:1428] Setting key 3b708e61d0cb913df474215d3c1765d4
I20260808 14:55:32.734661 19731 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6e00521edeca4203b00b3c0aa8034727: Bootstrap starting.
I20260808 14:55:32.736932 19734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:32.730876 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60219 (local address 127.26.206.254:39131)
0808 14:55:32.731721 (+ 845us) server_negotiation.cc:206] Beginning negotiation
0808 14:55:32.731733 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 14:55:32.731790 (+ 57us) server_negotiation.cc:407] Connection header received
0808 14:55:32.733497 (+ 1707us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:55:32.733519 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:55:32.733837 (+ 318us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:55:32.734148 (+ 311us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:55:32.735350 (+ 1202us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:55:32.735356 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:55:32.735368 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:55:32.735382 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:55:32.735442 (+ 60us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:55:32.735462 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:55:32.735694 (+ 232us) server_negotiation.cc:1035] Waiting for connection context
0808 14:55:32.735806 (+ 112us) server_negotiation.cc:299] Negotiation successful
0808 14:55:32.735997 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":612,"thread_start_us":400,"threads_started":1}
I20260808 14:55:32.738610 19731 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6e00521edeca4203b00b3c0aa8034727: Neither blocks nor log segments found. Creating new log.
I20260808 14:55:32.739998 19731 log.cc:824] T 00000000000000000000000000000000 P 6e00521edeca4203b00b3c0aa8034727: Log is configured to *not* fsync() on all Append() calls
I20260808 14:55:32.740837 27451 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:55:32.743273 19731 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6e00521edeca4203b00b3c0aa8034727: No bootstrap required, opened a new log
I20260808 14:55:32.749050 19734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:32.746521 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52265 (local address 127.26.206.254:39131)
0808 14:55:32.746678 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0808 14:55:32.746685 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:55:32.747028 (+ 343us) server_negotiation.cc:407] Connection header received
0808 14:55:32.747229 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:55:32.747232 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:55:32.747280 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:55:32.747362 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:55:32.748379 (+ 1017us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:55:32.748384 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:55:32.748386 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:55:32.748400 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:55:32.748436 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:55:32.748450 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:55:32.748536 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0808 14:55:32.748690 (+ 154us) server_negotiation.cc:299] Negotiation successful
0808 14:55:32.748734 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260808 14:55:32.753039 19731 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6e00521edeca4203b00b3c0aa8034727 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e00521edeca4203b00b3c0aa8034727" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 39131 } }
I20260808 14:55:32.753428 19731 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6e00521edeca4203b00b3c0aa8034727 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:55:32.753556 19731 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6e00521edeca4203b00b3c0aa8034727 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e00521edeca4203b00b3c0aa8034727, State: Initialized, Role: FOLLOWER
I20260808 14:55:32.754194 19731 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6e00521edeca4203b00b3c0aa8034727 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e00521edeca4203b00b3c0aa8034727" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 39131 } }
I20260808 14:55:32.754465 19731 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6e00521edeca4203b00b3c0aa8034727 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:55:32.754637 19731 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6e00521edeca4203b00b3c0aa8034727 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:55:32.754841 19731 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6e00521edeca4203b00b3c0aa8034727 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:55:32.757246 19731 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6e00521edeca4203b00b3c0aa8034727 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e00521edeca4203b00b3c0aa8034727" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 39131 } }
I20260808 14:55:32.757766 19731 leader_election.cc:302] T 00000000000000000000000000000000 P 6e00521edeca4203b00b3c0aa8034727 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6e00521edeca4203b00b3c0aa8034727; no voters:
I20260808 14:55:32.758417 19731 leader_election.cc:288] T 00000000000000000000000000000000 P 6e00521edeca4203b00b3c0aa8034727 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:55:32.758512 19741 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6e00521edeca4203b00b3c0aa8034727 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:55:32.759301 19741 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6e00521edeca4203b00b3c0aa8034727 [term 1 LEADER]: Becoming Leader. State: Replica: 6e00521edeca4203b00b3c0aa8034727, State: Running, Role: LEADER
I20260808 14:55:32.759899 19741 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6e00521edeca4203b00b3c0aa8034727 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e00521edeca4203b00b3c0aa8034727" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 39131 } }
I20260808 14:55:32.760717 19731 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6e00521edeca4203b00b3c0aa8034727 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:55:32.762465 19743 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6e00521edeca4203b00b3c0aa8034727 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6e00521edeca4203b00b3c0aa8034727. Latest consensus state: current_term: 1 leader_uuid: "6e00521edeca4203b00b3c0aa8034727" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e00521edeca4203b00b3c0aa8034727" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 39131 } } }
I20260808 14:55:32.763080 19742 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6e00521edeca4203b00b3c0aa8034727 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6e00521edeca4203b00b3c0aa8034727" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e00521edeca4203b00b3c0aa8034727" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 39131 } } }
I20260808 14:55:32.763479 19742 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6e00521edeca4203b00b3c0aa8034727 [sys.catalog]: This master's current role is: LEADER
I20260808 14:55:32.763788 19743 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6e00521edeca4203b00b3c0aa8034727 [sys.catalog]: This master's current role is: LEADER
I20260808 14:55:32.770430 19746 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:55:32.776124 19746 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:55:32.784961 19746 catalog_manager.cc:1347] Generated new cluster ID: 2ee2f233761347559d30b2a0f611e18e
I20260808 14:55:32.785063 19746 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:55:32.802163 19746 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:55:32.802568 19746 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:55:32.809595 19746 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6e00521edeca4203b00b3c0aa8034727: Generated new TSK 0
I20260808 14:55:32.810288 19746 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:55:32.821833 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 19661
W20260808 14:55:32.823004 19726 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:60219
W20260808 14:55:32.823750 27451 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 19661: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 14:55:32.823913 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 19661
2026-08-08T14:55:32Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (2008 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786200577490656-27451-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:55:32 dist-test-slave-6k22 krb5kdc[19762](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:55:32 dist-test-slave-6k22 krb5kdc[19762](info): set up 2 sockets
Aug 08 14:55:32 dist-test-slave-6k22 krb5kdc[19762](info): commencing operation
krb5kdc: starting...
W20260808 14:55:34.022405 27451 mini_kdc.cc:121] Time spent starting KDC: real 1.157s user 0.010s sys 0.033s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786200577490656-27451-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786200577490656-27451-0/krb5kdc/test-user.keytab.
Aug 08 14:55:34 dist-test-slave-6k22 krb5kdc[19762](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200934, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:55:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:55:34Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.206.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.206.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.206.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.254.keytab.
Entry for principal kudu/127.26.206.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.254.keytab.
I20260808 14:55:34.327174 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786200577490656-27451-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786200577490656-27451-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786200577490656-27451-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.206.254:39029
--webserver_interface=127.26.206.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.254.keytab
--principal=kudu/127.26.206.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.206.212:36879
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.206.254:39029
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:55:34.661590 19776 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:55:34.661859 19776 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:55:34.661950 19776 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:55:34.668937 19776 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:55:34.669040 19776 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:55:34.669093 19776 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:55:34.669153 19776 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:55:34.669198 19776 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:55:34.678828 19776 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:36879
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786200577490656-27451-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786200577490656-27451-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.206.254:39029
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.254.keytab
--principal=kudu/127.26.206.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.206.254:39029
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.206.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786200577490656-27451-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:55:34.680030 19776 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:55:34.681265 19776 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:55:34.692890 19786 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:55:34.692963 19784 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:55:34.692939 19783 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:55:34.694000 19776 server_base.cc:1034] running on GCE node
I20260808 14:55:34.694720 19776 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:55:34.696148 19776 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:55:34.697368 19776 hybrid_clock.cc:648] HybridClock initialized: now 1786200934697326 us; error 50 us; skew 500 ppm
I20260808 14:55:34.697700 19776 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:55:34 dist-test-slave-6k22 krb5kdc[19762](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200934, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:55:34.700745 19776 init.cc:377] Logged in from keytab as kudu/127.26.206.254@KRBTEST.COM (short username kudu)
I20260808 14:55:34.702152 19776 webserver.cc:460] Webserver started at http://127.26.206.254:33675/ using document root <none> and password file <none>
I20260808 14:55:34.702805 19776 fs_manager.cc:359] Metadata directory not provided
I20260808 14:55:34.702947 19776 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:55:34.703243 19776 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:55:34.706274 19776 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786200577490656-27451-0/minicluster-data/master-0/data/instance:
uuid: "952ab8988be643f7ade7c85f9947dd17"
format_stamp: "Formatted at 2026-08-08 14:55:34 on dist-test-slave-6k22"
server_key: "0e9b0e4b4a83e36a899d75f9e4d47078"
server_key_iv: "6f09fc14f2e2958e57a5ebf9e817e22a"
server_key_version: "encryptionkey@0"
I20260808 14:55:34.707098 19776 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786200577490656-27451-0/minicluster-data/master-0/wal/instance:
uuid: "952ab8988be643f7ade7c85f9947dd17"
format_stamp: "Formatted at 2026-08-08 14:55:34 on dist-test-slave-6k22"
server_key: "0e9b0e4b4a83e36a899d75f9e4d47078"
server_key_iv: "6f09fc14f2e2958e57a5ebf9e817e22a"
server_key_version: "encryptionkey@0"
I20260808 14:55:34.712139 19776 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260808 14:55:34.715425 19793 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:55:34.716693 19776 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 14:55:34.716881 19776 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786200577490656-27451-0/minicluster-data/master-0/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786200577490656-27451-0/minicluster-data/master-0/wal
uuid: "952ab8988be643f7ade7c85f9947dd17"
format_stamp: "Formatted at 2026-08-08 14:55:34 on dist-test-slave-6k22"
server_key: "0e9b0e4b4a83e36a899d75f9e4d47078"
server_key_iv: "6f09fc14f2e2958e57a5ebf9e817e22a"
server_key_version: "encryptionkey@0"
I20260808 14:55:34.717073 19776 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786200577490656-27451-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786200577490656-27451-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786200577490656-27451-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:55:34.742305 19776 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:55:34.746389 19776 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:55:34.746673 19776 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:55:34.764951 19776 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.254:39029
I20260808 14:55:34.764963 19847 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.254:39029 every 8 connection(s)
I20260808 14:55:34.766371 19776 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
I20260808 14:55:34.770032 19848 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:55:34.775759 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 19776
I20260808 14:55:34.775990 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786200577490656-27451-0/minicluster-data/master-0/wal/instance
I20260808 14:55:34.776595 27451 external_mini_cluster.cc:1428] Setting key 24b1246160a9c940a3b75fd3cefe5a52
I20260808 14:55:34.781014 19848 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 952ab8988be643f7ade7c85f9947dd17: Bootstrap starting.
I20260808 14:55:34.784724 19848 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 952ab8988be643f7ade7c85f9947dd17: Neither blocks nor log segments found. Creating new log.
I20260808 14:55:34.785988 19848 log.cc:824] T 00000000000000000000000000000000 P 952ab8988be643f7ade7c85f9947dd17: Log is configured to *not* fsync() on all Append() calls
I20260808 14:55:34.789337 19848 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 952ab8988be643f7ade7c85f9947dd17: No bootstrap required, opened a new log
Aug 08 14:55:34 dist-test-slave-6k22 krb5kdc[19762](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200934, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.206.254@KRBTEST.COM
I20260808 14:55:34.797389 19848 raft_consensus.cc:348] T 00000000000000000000000000000000 P 952ab8988be643f7ade7c85f9947dd17 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "952ab8988be643f7ade7c85f9947dd17" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 39029 } }
I20260808 14:55:34.797741 19848 raft_consensus.cc:374] T 00000000000000000000000000000000 P 952ab8988be643f7ade7c85f9947dd17 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:55:34.797869 19848 raft_consensus.cc:729] T 00000000000000000000000000000000 P 952ab8988be643f7ade7c85f9947dd17 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 952ab8988be643f7ade7c85f9947dd17, State: Initialized, Role: FOLLOWER
I20260808 14:55:34.798573 19848 consensus_queue.cc:260] T 00000000000000000000000000000000 P 952ab8988be643f7ade7c85f9947dd17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "952ab8988be643f7ade7c85f9947dd17" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 39029 } }
I20260808 14:55:34.798897 19848 raft_consensus.cc:388] T 00000000000000000000000000000000 P 952ab8988be643f7ade7c85f9947dd17 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:55:34.799052 19848 raft_consensus.cc:482] T 00000000000000000000000000000000 P 952ab8988be643f7ade7c85f9947dd17 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:55:34.799229 19848 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 952ab8988be643f7ade7c85f9947dd17 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:55:34.800594 19851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:34.778509 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54531 (local address 127.26.206.254:39029)
0808 14:55:34.779344 (+ 835us) server_negotiation.cc:206] Beginning negotiation
0808 14:55:34.779354 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 14:55:34.779393 (+ 39us) server_negotiation.cc:407] Connection header received
0808 14:55:34.781133 (+ 1740us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:55:34.781167 (+ 34us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:55:34.781536 (+ 369us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:55:34.781839 (+ 303us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:55:34.783743 (+ 1904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:34.785057 (+ 1314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:34.786873 (+ 1816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:34.787801 (+ 928us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:34.787929 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:55:34.792826 (+ 4897us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:55:34.792833 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:55:34.792846 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:55:34.792885 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:55:34.796147 (+ 3262us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:55:34.796876 (+ 729us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:55:34.796884 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:55:34.796899 (+ 15us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:55:34.797062 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:55:34.797448 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:55:34.797454 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:55:34.797457 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:55:34.798108 (+ 651us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:55:34.798416 (+ 308us) server_negotiation.cc:1035] Waiting for connection context
0808 14:55:34.798907 (+ 491us) server_negotiation.cc:299] Negotiation successful
0808 14:55:34.799540 (+ 633us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":629,"thread_start_us":404,"threads_started":1}
I20260808 14:55:34.801724 19848 raft_consensus.cc:504] T 00000000000000000000000000000000 P 952ab8988be643f7ade7c85f9947dd17 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "952ab8988be643f7ade7c85f9947dd17" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 39029 } }
I20260808 14:55:34.802304 19848 leader_election.cc:302] T 00000000000000000000000000000000 P 952ab8988be643f7ade7c85f9947dd17 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 952ab8988be643f7ade7c85f9947dd17; no voters:
I20260808 14:55:34.802955 19848 leader_election.cc:288] T 00000000000000000000000000000000 P 952ab8988be643f7ade7c85f9947dd17 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:55:34.803134 19853 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 952ab8988be643f7ade7c85f9947dd17 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:55:34.804536 27451 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:55:34.805657 19848 sys_catalog.cc:564] T 00000000000000000000000000000000 P 952ab8988be643f7ade7c85f9947dd17 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:55:34.810305 19853 raft_consensus.cc:686] T 00000000000000000000000000000000 P 952ab8988be643f7ade7c85f9947dd17 [term 1 LEADER]: Becoming Leader. State: Replica: 952ab8988be643f7ade7c85f9947dd17, State: Running, Role: LEADER
I20260808 14:55:34.810978 19853 consensus_queue.cc:237] T 00000000000000000000000000000000 P 952ab8988be643f7ade7c85f9947dd17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "952ab8988be643f7ade7c85f9947dd17" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 39029 } }
I20260808 14:55:34.814493 19854 sys_catalog.cc:455] T 00000000000000000000000000000000 P 952ab8988be643f7ade7c85f9947dd17 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "952ab8988be643f7ade7c85f9947dd17" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "952ab8988be643f7ade7c85f9947dd17" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 39029 } } }
I20260808 14:55:34.814994 19854 sys_catalog.cc:458] T 00000000000000000000000000000000 P 952ab8988be643f7ade7c85f9947dd17 [sys.catalog]: This master's current role is: LEADER
I20260808 14:55:34.824755 19869 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:55:34.825846 19855 sys_catalog.cc:455] T 00000000000000000000000000000000 P 952ab8988be643f7ade7c85f9947dd17 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 952ab8988be643f7ade7c85f9947dd17. Latest consensus state: current_term: 1 leader_uuid: "952ab8988be643f7ade7c85f9947dd17" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "952ab8988be643f7ade7c85f9947dd17" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 39029 } } }
I20260808 14:55:34.826316 19855 sys_catalog.cc:458] T 00000000000000000000000000000000 P 952ab8988be643f7ade7c85f9947dd17 [sys.catalog]: This master's current role is: LEADER
I20260808 14:55:34.827193 19851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:34.809080 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60603 (local address 127.26.206.254:39029)
0808 14:55:34.809294 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0808 14:55:34.809302 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:55:34.809833 (+ 531us) server_negotiation.cc:407] Connection header received
0808 14:55:34.810021 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:55:34.810026 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:55:34.810098 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:55:34.810197 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:55:34.811908 (+ 1711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:34.813219 (+ 1311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:34.815129 (+ 1910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:34.816029 (+ 900us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:34.816185 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:55:34.819969 (+ 3784us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:55:34.819976 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:55:34.819981 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:55:34.820014 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:55:34.823126 (+ 3112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:55:34.823967 (+ 841us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:55:34.823975 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:55:34.823980 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:55:34.824170 (+ 190us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:55:34.824660 (+ 490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:55:34.824668 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:55:34.824675 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:55:34.825301 (+ 626us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:55:34.825661 (+ 360us) server_negotiation.cc:1035] Waiting for connection context
0808 14:55:34.826488 (+ 827us) server_negotiation.cc:299] Negotiation successful
0808 14:55:34.826780 (+ 292us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260808 14:55:34.830207 19869 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:55:34.838738 19869 catalog_manager.cc:1347] Generated new cluster ID: 0e5b49d06c5e4918a4f225a8df7ed98a
I20260808 14:55:34.838848 19869 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:55:34.847909 19869 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:55:34.849115 19869 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:55:34.859447 19869 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 952ab8988be643f7ade7c85f9947dd17: Generated new TSK 0
I20260808 14:55:34.860417 19869 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:55:34.875209 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 19776
I20260808 14:55:34.876277 19842 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:55:34.964864 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 19776
2026-08-08T14:55:34Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (2139 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786200577490656-27451-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:55:35 dist-test-slave-6k22 krb5kdc[19884](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:55:35 dist-test-slave-6k22 krb5kdc[19884](info): set up 2 sockets
Aug 08 14:55:35 dist-test-slave-6k22 krb5kdc[19884](info): commencing operation
krb5kdc: starting...
W20260808 14:55:36.154202 27451 mini_kdc.cc:121] Time spent starting KDC: real 1.149s user 0.000s sys 0.044s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786200577490656-27451-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786200577490656-27451-0/krb5kdc/test-user.keytab.
Aug 08 14:55:36 dist-test-slave-6k22 krb5kdc[19884](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200936, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:55:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:55:36Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.206.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.206.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.206.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.254.keytab.
Entry for principal kudu/127.26.206.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.254.keytab.
I20260808 14:55:36.456851 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786200577490656-27451-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786200577490656-27451-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786200577490656-27451-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.206.254:40109
--webserver_interface=127.26.206.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.254.keytab
--principal=kudu/127.26.206.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.206.212:38729
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.206.254:40109
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:55:36.788390 19898 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:55:36.788666 19898 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:55:36.788821 19898 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:55:36.795866 19898 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:55:36.795959 19898 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:55:36.796082 19898 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:55:36.796182 19898 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:55:36.796248 19898 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:55:36.805728 19898 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:38729
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786200577490656-27451-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786200577490656-27451-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.206.254:40109
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.254.keytab
--principal=kudu/127.26.206.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.206.254:40109
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.206.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786200577490656-27451-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:55:36.806947 19898 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:55:36.808208 19898 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:55:36.819736 19903 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:55:36.819796 19904 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:55:36.819839 19906 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:55:36.820746 19898 server_base.cc:1034] running on GCE node
I20260808 14:55:36.821471 19898 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:55:36.822765 19898 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:55:36.823985 19898 hybrid_clock.cc:648] HybridClock initialized: now 1786200936823945 us; error 34 us; skew 500 ppm
I20260808 14:55:36.824316 19898 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:55:36 dist-test-slave-6k22 krb5kdc[19884](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200936, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:55:36.827347 19898 init.cc:377] Logged in from keytab as kudu/127.26.206.254@KRBTEST.COM (short username kudu)
I20260808 14:55:36.828845 19898 webserver.cc:460] Webserver started at http://127.26.206.254:41715/ using document root <none> and password file <none>
I20260808 14:55:36.829497 19898 fs_manager.cc:359] Metadata directory not provided
I20260808 14:55:36.829646 19898 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:55:36.829954 19898 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:55:36.832926 19898 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786200577490656-27451-0/minicluster-data/master-0/data/instance:
uuid: "3ebe3532830842f7a4cb9661e0c8bbe6"
format_stamp: "Formatted at 2026-08-08 14:55:36 on dist-test-slave-6k22"
server_key: "e4d00d8fdb36a8f0807e20fb83e60070"
server_key_iv: "5055c918b38f34b70045450aaed82999"
server_key_version: "encryptionkey@0"
I20260808 14:55:36.833695 19898 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786200577490656-27451-0/minicluster-data/master-0/wal/instance:
uuid: "3ebe3532830842f7a4cb9661e0c8bbe6"
format_stamp: "Formatted at 2026-08-08 14:55:36 on dist-test-slave-6k22"
server_key: "e4d00d8fdb36a8f0807e20fb83e60070"
server_key_iv: "5055c918b38f34b70045450aaed82999"
server_key_version: "encryptionkey@0"
I20260808 14:55:36.838689 19898 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260808 14:55:36.841972 19913 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:55:36.843246 19898 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 14:55:36.843430 19898 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786200577490656-27451-0/minicluster-data/master-0/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786200577490656-27451-0/minicluster-data/master-0/wal
uuid: "3ebe3532830842f7a4cb9661e0c8bbe6"
format_stamp: "Formatted at 2026-08-08 14:55:36 on dist-test-slave-6k22"
server_key: "e4d00d8fdb36a8f0807e20fb83e60070"
server_key_iv: "5055c918b38f34b70045450aaed82999"
server_key_version: "encryptionkey@0"
I20260808 14:55:36.843667 19898 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786200577490656-27451-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786200577490656-27451-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786200577490656-27451-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:55:36.862884 19898 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:55:36.866650 19898 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:55:36.866940 19898 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:55:36.885589 19898 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.254:40109
I20260808 14:55:36.885684 19967 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.254:40109 every 8 connection(s)
I20260808 14:55:36.887207 19898 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
I20260808 14:55:36.890854 19968 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:55:36.896000 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 19898
I20260808 14:55:36.896178 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786200577490656-27451-0/minicluster-data/master-0/wal/instance
I20260808 14:55:36.896679 27451 external_mini_cluster.cc:1428] Setting key cefa27a5f11c82daaa540ad1a9cc2a5a
I20260808 14:55:36.902012 19968 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3ebe3532830842f7a4cb9661e0c8bbe6: Bootstrap starting.
I20260808 14:55:36.905618 19968 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3ebe3532830842f7a4cb9661e0c8bbe6: Neither blocks nor log segments found. Creating new log.
I20260808 14:55:36.906821 19968 log.cc:824] T 00000000000000000000000000000000 P 3ebe3532830842f7a4cb9661e0c8bbe6: Log is configured to *not* fsync() on all Append() calls
I20260808 14:55:36.909953 19968 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3ebe3532830842f7a4cb9661e0c8bbe6: No bootstrap required, opened a new log
I20260808 14:55:36.911273 19971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:36.898676 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44493 (local address 127.26.206.254:40109)
0808 14:55:36.899743 (+ 1067us) server_negotiation.cc:206] Beginning negotiation
0808 14:55:36.899755 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 14:55:36.899807 (+ 52us) server_negotiation.cc:407] Connection header received
0808 14:55:36.901720 (+ 1913us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:55:36.901744 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:55:36.902182 (+ 438us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:55:36.902534 (+ 352us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:55:36.903104 (+ 570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:36.904520 (+ 1416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:36.906485 (+ 1965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:36.907176 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:36.907396 (+ 220us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:55:36.908589 (+ 1193us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:55:36.908601 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:55:36.908620 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:55:36.909318 (+ 698us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:55:36.909412 (+ 94us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:55:36.909444 (+ 32us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:55:36.909565 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0808 14:55:36.909742 (+ 177us) server_negotiation.cc:299] Negotiation successful
0808 14:55:36.910006 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":720,"thread_start_us":448,"threads_started":1}
I20260808 14:55:36.914841 27451 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:55:36.918257 19968 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3ebe3532830842f7a4cb9661e0c8bbe6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ebe3532830842f7a4cb9661e0c8bbe6" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 40109 } }
I20260808 14:55:36.918645 19968 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3ebe3532830842f7a4cb9661e0c8bbe6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:55:36.918761 19968 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3ebe3532830842f7a4cb9661e0c8bbe6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ebe3532830842f7a4cb9661e0c8bbe6, State: Initialized, Role: FOLLOWER
I20260808 14:55:36.919430 19968 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3ebe3532830842f7a4cb9661e0c8bbe6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ebe3532830842f7a4cb9661e0c8bbe6" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 40109 } }
I20260808 14:55:36.919752 19968 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3ebe3532830842f7a4cb9661e0c8bbe6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:55:36.919917 19968 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3ebe3532830842f7a4cb9661e0c8bbe6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:55:36.920115 19968 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3ebe3532830842f7a4cb9661e0c8bbe6 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:55:36.922367 19968 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3ebe3532830842f7a4cb9661e0c8bbe6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ebe3532830842f7a4cb9661e0c8bbe6" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 40109 } }
I20260808 14:55:36.922844 19968 leader_election.cc:302] T 00000000000000000000000000000000 P 3ebe3532830842f7a4cb9661e0c8bbe6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3ebe3532830842f7a4cb9661e0c8bbe6; no voters:
I20260808 14:55:36.923523 19968 leader_election.cc:288] T 00000000000000000000000000000000 P 3ebe3532830842f7a4cb9661e0c8bbe6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:55:36.923673 19979 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3ebe3532830842f7a4cb9661e0c8bbe6 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:55:36.925653 19971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:36.919155 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44669 (local address 127.26.206.254:40109)
0808 14:55:36.919349 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0808 14:55:36.919357 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:55:36.919915 (+ 558us) server_negotiation.cc:407] Connection header received
0808 14:55:36.920133 (+ 218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:55:36.920136 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:55:36.920193 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:55:36.920311 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:55:36.920800 (+ 489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:36.921499 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:36.922864 (+ 1365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:36.923399 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:36.923569 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:55:36.924846 (+ 1277us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:55:36.924851 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:55:36.924855 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:55:36.924873 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:55:36.924916 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:55:36.924935 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:55:36.924993 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 14:55:36.925232 (+ 239us) server_negotiation.cc:299] Negotiation successful
0808 14:55:36.925317 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260808 14:55:36.926512 19968 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3ebe3532830842f7a4cb9661e0c8bbe6 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:55:36.927824 19979 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3ebe3532830842f7a4cb9661e0c8bbe6 [term 1 LEADER]: Becoming Leader. State: Replica: 3ebe3532830842f7a4cb9661e0c8bbe6, State: Running, Role: LEADER
I20260808 14:55:36.928576 19979 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3ebe3532830842f7a4cb9661e0c8bbe6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ebe3532830842f7a4cb9661e0c8bbe6" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 40109 } }
I20260808 14:55:36.931991 19980 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3ebe3532830842f7a4cb9661e0c8bbe6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3ebe3532830842f7a4cb9661e0c8bbe6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ebe3532830842f7a4cb9661e0c8bbe6" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 40109 } } }
I20260808 14:55:36.932358 19981 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3ebe3532830842f7a4cb9661e0c8bbe6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3ebe3532830842f7a4cb9661e0c8bbe6. Latest consensus state: current_term: 1 leader_uuid: "3ebe3532830842f7a4cb9661e0c8bbe6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ebe3532830842f7a4cb9661e0c8bbe6" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 40109 } } }
I20260808 14:55:36.932610 19980 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3ebe3532830842f7a4cb9661e0c8bbe6 [sys.catalog]: This master's current role is: LEADER
I20260808 14:55:36.932636 19981 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3ebe3532830842f7a4cb9661e0c8bbe6 [sys.catalog]: This master's current role is: LEADER
I20260808 14:55:36.934720 19988 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:55:36.939302 19988 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:55:36.948191 19988 catalog_manager.cc:1347] Generated new cluster ID: 90bcc306d5934deab147566de5b12ac7
I20260808 14:55:36.948310 19988 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:55:36.960609 19988 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:55:36.962719 19988 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:55:36.973207 19988 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3ebe3532830842f7a4cb9661e0c8bbe6: Generated new TSK 0
I20260808 14:55:36.973986 19988 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:55:36.980020 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 19898
W20260808 14:55:36.981024 19962 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:44493
W20260808 14:55:36.981694 27451 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 19898: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 14:55:36.981837 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 19898
2026-08-08T14:55:36Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (2016 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786200577490656-27451-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:55:37 dist-test-slave-6k22 krb5kdc[20001](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:55:37 dist-test-slave-6k22 krb5kdc[20001](info): set up 2 sockets
Aug 08 14:55:37 dist-test-slave-6k22 krb5kdc[20001](info): commencing operation
krb5kdc: starting...
W20260808 14:55:38.170600 27451 mini_kdc.cc:121] Time spent starting KDC: real 1.149s user 0.001s sys 0.043s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786200577490656-27451-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786200577490656-27451-0/krb5kdc/test-user.keytab.
Aug 08 14:55:38 dist-test-slave-6k22 krb5kdc[20001](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200938, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:55:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:55:38Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.206.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.206.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.206.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.254.keytab.
Entry for principal kudu/127.26.206.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.254.keytab.
I20260808 14:55:38.486388 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786200577490656-27451-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786200577490656-27451-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786200577490656-27451-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.206.254:45557
--webserver_interface=127.26.206.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.254.keytab
--principal=kudu/127.26.206.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.206.212:46633
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.206.254:45557
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:55:38.828267 20014 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:55:38.828579 20014 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:55:38.828794 20014 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:55:38.835877 20014 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:55:38.836024 20014 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:55:38.836134 20014 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:55:38.836251 20014 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:55:38.836337 20014 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:55:38.846091 20014 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:46633
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786200577490656-27451-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786200577490656-27451-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.206.254:45557
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.254.keytab
--principal=kudu/127.26.206.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.206.254:45557
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.206.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786200577490656-27451-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:55:38.847433 20014 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:55:38.848788 20014 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:55:38.861016 20020 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:55:38.860975 20024 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:55:38.861039 20021 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:55:38.861699 20014 server_base.cc:1034] running on GCE node
I20260808 14:55:38.862490 20014 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:55:38.863942 20014 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:55:38.865175 20014 hybrid_clock.cc:648] HybridClock initialized: now 1786200938865123 us; error 64 us; skew 500 ppm
I20260808 14:55:38.865538 20014 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:55:38 dist-test-slave-6k22 krb5kdc[20001](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200938, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:55:38.874297 20014 init.cc:377] Logged in from keytab as kudu/127.26.206.254@KRBTEST.COM (short username kudu)
I20260808 14:55:38.875844 20014 webserver.cc:460] Webserver started at http://127.26.206.254:45807/ using document root <none> and password file <none>
I20260808 14:55:38.876569 20014 fs_manager.cc:359] Metadata directory not provided
I20260808 14:55:38.876720 20014 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:55:38.877036 20014 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:55:38.880093 20014 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786200577490656-27451-0/minicluster-data/master-0/data/instance:
uuid: "7f069de9a78b47b3b55f34acab82f420"
format_stamp: "Formatted at 2026-08-08 14:55:38 on dist-test-slave-6k22"
server_key: "da9726a803efc9231dd8975f9f46a6b0"
server_key_iv: "6619a0818736eb4554eb511e67349bea"
server_key_version: "encryptionkey@0"
I20260808 14:55:38.880870 20014 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786200577490656-27451-0/minicluster-data/master-0/wal/instance:
uuid: "7f069de9a78b47b3b55f34acab82f420"
format_stamp: "Formatted at 2026-08-08 14:55:38 on dist-test-slave-6k22"
server_key: "da9726a803efc9231dd8975f9f46a6b0"
server_key_iv: "6619a0818736eb4554eb511e67349bea"
server_key_version: "encryptionkey@0"
I20260808 14:55:38.885973 20014 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260808 14:55:38.889367 20032 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:55:38.890568 20014 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 14:55:38.890759 20014 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786200577490656-27451-0/minicluster-data/master-0/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786200577490656-27451-0/minicluster-data/master-0/wal
uuid: "7f069de9a78b47b3b55f34acab82f420"
format_stamp: "Formatted at 2026-08-08 14:55:38 on dist-test-slave-6k22"
server_key: "da9726a803efc9231dd8975f9f46a6b0"
server_key_iv: "6619a0818736eb4554eb511e67349bea"
server_key_version: "encryptionkey@0"
I20260808 14:55:38.890955 20014 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786200577490656-27451-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786200577490656-27451-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786200577490656-27451-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:55:38.896683 20014 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:55:38.900530 20014 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:55:38.900825 20014 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:55:38.919101 20014 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.254:45557
I20260808 14:55:38.919176 20089 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.254:45557 every 8 connection(s)
I20260808 14:55:38.920469 20014 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
I20260808 14:55:38.924012 20090 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:55:38.927444 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 20014
I20260808 14:55:38.927659 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786200577490656-27451-0/minicluster-data/master-0/wal/instance
I20260808 14:55:38.928200 27451 external_mini_cluster.cc:1428] Setting key f0bd0c8229c5e30937f2bd75b56c8c9a
I20260808 14:55:38.935894 20093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:38.929908 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34569 (local address 127.26.206.254:45557)
0808 14:55:38.930647 (+ 739us) server_negotiation.cc:206] Beginning negotiation
0808 14:55:38.930658 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 14:55:38.930696 (+ 38us) server_negotiation.cc:407] Connection header received
0808 14:55:38.932575 (+ 1879us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:55:38.932595 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:55:38.932955 (+ 360us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:55:38.933268 (+ 313us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:55:38.934375 (+ 1107us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:55:38.934381 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:55:38.934392 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:55:38.934405 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:55:38.934465 (+ 60us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:55:38.934484 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:55:38.934649 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0808 14:55:38.934767 (+ 118us) server_negotiation.cc:299] Negotiation successful
0808 14:55:38.934961 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":550,"thread_start_us":344,"threads_started":1}
I20260808 14:55:38.936569 20090 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7f069de9a78b47b3b55f34acab82f420: Bootstrap starting.
I20260808 14:55:38.939736 27451 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:55:38.940294 20090 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7f069de9a78b47b3b55f34acab82f420: Neither blocks nor log segments found. Creating new log.
I20260808 14:55:38.941277 20090 log.cc:824] T 00000000000000000000000000000000 P 7f069de9a78b47b3b55f34acab82f420: Log is configured to *not* fsync() on all Append() calls
I20260808 14:55:38.944401 20090 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7f069de9a78b47b3b55f34acab82f420: No bootstrap required, opened a new log
I20260808 14:55:38.950018 20093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:38.944104 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52337 (local address 127.26.206.254:45557)
0808 14:55:38.944283 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0808 14:55:38.944288 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:55:38.948134 (+ 3846us) server_negotiation.cc:407] Connection header received
0808 14:55:38.948254 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:55:38.948260 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:55:38.948316 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:55:38.948435 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:55:38.949316 (+ 881us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:55:38.949324 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:55:38.949330 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:55:38.949355 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:55:38.949399 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:55:38.949418 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:55:38.949543 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0808 14:55:38.949639 (+ 96us) server_negotiation.cc:299] Negotiation successful
0808 14:55:38.949711 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260808 14:55:38.952472 20090 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7f069de9a78b47b3b55f34acab82f420 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f069de9a78b47b3b55f34acab82f420" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 45557 } }
I20260808 14:55:38.952807 20090 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7f069de9a78b47b3b55f34acab82f420 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:55:38.952945 20090 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7f069de9a78b47b3b55f34acab82f420 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f069de9a78b47b3b55f34acab82f420, State: Initialized, Role: FOLLOWER
I20260808 14:55:38.953476 20090 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7f069de9a78b47b3b55f34acab82f420 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f069de9a78b47b3b55f34acab82f420" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 45557 } }
I20260808 14:55:38.953735 20090 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7f069de9a78b47b3b55f34acab82f420 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:55:38.953882 20090 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7f069de9a78b47b3b55f34acab82f420 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:55:38.954064 20090 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7f069de9a78b47b3b55f34acab82f420 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:55:38.956233 20090 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7f069de9a78b47b3b55f34acab82f420 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f069de9a78b47b3b55f34acab82f420" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 45557 } }
I20260808 14:55:38.956703 20090 leader_election.cc:302] T 00000000000000000000000000000000 P 7f069de9a78b47b3b55f34acab82f420 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7f069de9a78b47b3b55f34acab82f420; no voters:
I20260808 14:55:38.957320 20090 leader_election.cc:288] T 00000000000000000000000000000000 P 7f069de9a78b47b3b55f34acab82f420 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:55:38.957427 20100 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7f069de9a78b47b3b55f34acab82f420 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:55:38.958254 20100 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7f069de9a78b47b3b55f34acab82f420 [term 1 LEADER]: Becoming Leader. State: Replica: 7f069de9a78b47b3b55f34acab82f420, State: Running, Role: LEADER
I20260808 14:55:38.958814 20100 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7f069de9a78b47b3b55f34acab82f420 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f069de9a78b47b3b55f34acab82f420" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 45557 } }
I20260808 14:55:38.959630 20090 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7f069de9a78b47b3b55f34acab82f420 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:55:38.962101 20101 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7f069de9a78b47b3b55f34acab82f420 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7f069de9a78b47b3b55f34acab82f420" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f069de9a78b47b3b55f34acab82f420" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 45557 } } }
I20260808 14:55:38.962157 20102 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7f069de9a78b47b3b55f34acab82f420 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7f069de9a78b47b3b55f34acab82f420. Latest consensus state: current_term: 1 leader_uuid: "7f069de9a78b47b3b55f34acab82f420" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f069de9a78b47b3b55f34acab82f420" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 45557 } } }
I20260808 14:55:38.962509 20101 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7f069de9a78b47b3b55f34acab82f420 [sys.catalog]: This master's current role is: LEADER
I20260808 14:55:38.962549 20102 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7f069de9a78b47b3b55f34acab82f420 [sys.catalog]: This master's current role is: LEADER
I20260808 14:55:38.964140 20108 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:55:38.969496 20108 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:55:38.978508 20108 catalog_manager.cc:1347] Generated new cluster ID: c1aa5bde94774b969fe7e3a631346fc9
I20260808 14:55:38.978608 20108 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:55:39.002821 20108 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:55:39.003302 20108 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:55:39.011152 20108 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7f069de9a78b47b3b55f34acab82f420: Generated new TSK 0
I20260808 14:55:39.012228 20108 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:55:39.018592 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 20014
W20260808 14:55:39.019712 20085 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:34569
W20260808 14:55:39.020479 27451 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 20014: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 14:55:39.020632 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 20014
2026-08-08T14:55:39Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (2041 ms)
[----------] 18 tests from AuthTokenIssuingTest (37305 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200577490656-27451-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:55:39 dist-test-slave-6k22 krb5kdc[20124](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:55:39 dist-test-slave-6k22 krb5kdc[20124](info): set up 2 sockets
Aug 08 14:55:39 dist-test-slave-6k22 krb5kdc[20124](info): commencing operation
krb5kdc: starting...
W20260808 14:55:40.212277 27451 mini_kdc.cc:121] Time spent starting KDC: real 1.149s user 0.003s sys 0.041s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200577490656-27451-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200577490656-27451-0/krb5kdc/test-user.keytab.
Aug 08 14:55:40 dist-test-slave-6k22 krb5kdc[20124](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200940, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:55:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:55:40Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.206.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.206.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.206.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.254.keytab.
Entry for principal kudu/127.26.206.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.254.keytab.
I20260808 14:55:40.524292 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200577490656-27451-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200577490656-27451-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200577490656-27451-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.206.254:43319
--webserver_interface=127.26.206.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.254.keytab
--principal=kudu/127.26.206.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.206.212:43687
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.206.254:43319,127.26.206.253:40325,127.26.206.252:39275
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:55:40.855393 20137 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 14:55:40.855756 20137 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:55:40.855881 20137 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:55:40.856027 20137 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:55:40.862962 20137 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:55:40.863071 20137 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:55:40.863171 20137 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:55:40.863234 20137 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:55:40.863334 20137 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:55:40.872520 20137 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:43687
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200577490656-27451-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200577490656-27451-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.206.254:43319,127.26.206.253:40325,127.26.206.252:39275
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.254.keytab
--principal=kudu/127.26.206.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.206.254:43319
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.206.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200577490656-27451-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:55:40.873623 20137 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:55:40.874838 20137 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:55:40.886588 20143 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:55:40.886632 20145 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:55:40.886535 20147 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:55:40.887660 20137 server_base.cc:1034] running on GCE node
I20260808 14:55:40.888322 20137 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:55:40.889504 20137 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:55:40.890730 20137 hybrid_clock.cc:648] HybridClock initialized: now 1786200940890657 us; error 35 us; skew 500 ppm
I20260808 14:55:40.891000 20137 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:55:40 dist-test-slave-6k22 krb5kdc[20124](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200940, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:55:40.894191 20137 init.cc:377] Logged in from keytab as kudu/127.26.206.254@KRBTEST.COM (short username kudu)
I20260808 14:55:40.895515 20137 webserver.cc:460] Webserver started at http://127.26.206.254:35157/ using document root <none> and password file <none>
I20260808 14:55:40.896203 20137 fs_manager.cc:359] Metadata directory not provided
I20260808 14:55:40.896334 20137 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:55:40.896643 20137 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:55:40.899439 20137 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200577490656-27451-0/minicluster-data/master-0/data/instance:
uuid: "b6c06c3978484e78a08a649f1b417044"
format_stamp: "Formatted at 2026-08-08 14:55:40 on dist-test-slave-6k22"
server_key: "7dd230623c9f003ad79c70804afe9f94"
server_key_iv: "4f3fb25e827918128ecdb7f38db91c84"
server_key_version: "encryptionkey@0"
I20260808 14:55:40.900285 20137 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200577490656-27451-0/minicluster-data/master-0/wal/instance:
uuid: "b6c06c3978484e78a08a649f1b417044"
format_stamp: "Formatted at 2026-08-08 14:55:40 on dist-test-slave-6k22"
server_key: "7dd230623c9f003ad79c70804afe9f94"
server_key_iv: "4f3fb25e827918128ecdb7f38db91c84"
server_key_version: "encryptionkey@0"
I20260808 14:55:40.905210 20137 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.002s
I20260808 14:55:40.908560 20154 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:55:40.909740 20137 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260808 14:55:40.909941 20137 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200577490656-27451-0/minicluster-data/master-0/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200577490656-27451-0/minicluster-data/master-0/wal
uuid: "b6c06c3978484e78a08a649f1b417044"
format_stamp: "Formatted at 2026-08-08 14:55:40 on dist-test-slave-6k22"
server_key: "7dd230623c9f003ad79c70804afe9f94"
server_key_iv: "4f3fb25e827918128ecdb7f38db91c84"
server_key_version: "encryptionkey@0"
I20260808 14:55:40.910154 20137 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200577490656-27451-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200577490656-27451-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200577490656-27451-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:55:40.926116 20137 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:55:40.930310 20137 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:55:40.930572 20137 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:55:40.949259 20137 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.254:43319
I20260808 14:55:40.949287 20210 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.254:43319 every 8 connection(s)
I20260808 14:55:40.950649 20137 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
I20260808 14:55:40.954429 20211 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:55:40.954871 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 20137
I20260808 14:55:40.955108 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200577490656-27451-0/minicluster-data/master-0/wal/instance
I20260808 14:55:40.955839 27451 external_mini_cluster.cc:1428] Setting key 57f81a4816b52a10fdb65aaa60d4b5be
I20260808 14:55:40.961531 20211 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.206.254" port: 43319 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 14:55:40 dist-test-slave-6k22 krb5kdc[20124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200940, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.254@KRBTEST.COM for kudu/127.26.206.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.26.206.253@KRBTEST.COM; defaulting to no policy
I20260808 14:55:40.992679 20214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:40.964857 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:43319 (local address 127.0.0.1:48674)
0808 14:55:40.971024 (+ 6167us) negotiation.cc:107] Waiting for socket to connect
0808 14:55:40.971100 (+ 76us) client_negotiation.cc:174] Beginning negotiation
0808 14:55:40.973887 (+ 2787us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:55:40.974861 (+ 974us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:55:40.974870 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:55:40.975717 (+ 847us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:55:40.976255 (+ 538us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:55:40.976282 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:55:40.977817 (+ 1535us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:55:40.977825 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:55:40.979849 (+ 2024us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:55:40.979867 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:55:40.980791 (+ 924us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:55:40.980801 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:55:40.981018 (+ 217us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:55:40.981755 (+ 737us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:55:40.981802 (+ 47us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:55:40.984943 (+ 3141us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:55:40.988306 (+ 3363us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:55:40.988322 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:55:40.988338 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:55:40.989012 (+ 674us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:55:40.989425 (+ 413us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:55:40.989431 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:55:40.989437 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:55:40.989661 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:55:40.990444 (+ 783us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:55:40.990455 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:55:40.990744 (+ 289us) client_negotiation.cc:769] Sending connection context
0808 14:55:40.991044 (+ 300us) client_negotiation.cc:240] Negotiation successful
0808 14:55:40.991699 (+ 655us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5890,"mutex_wait_us":129,"spinlock_wait_cycles":22784,"thread_start_us":5676,"threads_started":1}
I20260808 14:55:40.992697 20213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:40.964857 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48674 (local address 127.26.206.254:43319)
0808 14:55:40.970564 (+ 5707us) server_negotiation.cc:206] Beginning negotiation
0808 14:55:40.970584 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0808 14:55:40.971249 (+ 665us) server_negotiation.cc:407] Connection header received
0808 14:55:40.974370 (+ 3121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:55:40.974375 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:55:40.974602 (+ 227us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:55:40.974758 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:55:40.976479 (+ 1721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:40.977645 (+ 1166us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:40.979999 (+ 2354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:40.980534 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:40.980659 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:55:40.985177 (+ 4518us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:55:40.985185 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:55:40.985197 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:55:40.985224 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:55:40.988168 (+ 2944us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:55:40.989145 (+ 977us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:55:40.989151 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:55:40.989153 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:55:40.989310 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:55:40.989778 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:55:40.989781 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:55:40.989783 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:55:40.990292 (+ 509us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:55:40.990444 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0808 14:55:40.991150 (+ 706us) server_negotiation.cc:299] Negotiation successful
0808 14:55:40.991524 (+ 374us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":5415,"thread_start_us":5177,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.206.253@KRBTEST.COM" created.
I20260808 14:55:40.995740 20211 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.206.253" port: 40325 } has no permanent_uuid. Determining permanent_uuid...
I20260808 14:55:40.996805 20214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:40.996353 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.253:40325 (local address 127.0.0.1:40900)
0808 14:55:40.996544 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0808 14:55:40.996668 (+ 124us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.253:40325: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
W20260808 14:55:40.997056 20158 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.206.253:40325: connect: Connection refused (error 111)
I20260808 14:55:40.998711 20214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:40.998237 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.253:40325 (local address 127.0.0.1:40906)
0808 14:55:40.998430 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0808 14:55:40.998540 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.253:40325: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
W20260808 14:55:40.998930 20211 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.206.253:40325: Network error: Client connection negotiation failed: client connection to 127.26.206.253:40325: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.206.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.253.keytab.
Entry for principal kudu/127.26.206.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.253.keytab.
I20260808 14:55:41.031126 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200577490656-27451-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200577490656-27451-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200577490656-27451-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200577490656-27451-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.206.253:40325
--webserver_interface=127.26.206.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.253.keytab
--principal=kudu/127.26.206.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.206.212:43687
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.206.254:43319,127.26.206.253:40325,127.26.206.252:39275
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 14:55:41.048291 20211 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.206.253" port: 40325 } attempt: 1
I20260808 14:55:41.049602 20214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:41.049115 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.253:40325 (local address 127.0.0.1:40918)
0808 14:55:41.049356 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0808 14:55:41.049474 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.253:40325: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102}
I20260808 14:55:41.050603 20214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:41.050266 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.253:40325 (local address 127.0.0.1:40934)
0808 14:55:41.050404 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0808 14:55:41.050480 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.253:40325: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260808 14:55:41.050786 20211 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.206.253:40325: Network error: Client connection negotiation failed: client connection to 127.26.206.253:40325: connect: Connection refused (error 111)
I20260808 14:55:41.119019 20211 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.206.253" port: 40325 } attempt: 2
I20260808 14:55:41.120199 20214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:41.119713 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.253:40325 (local address 127.0.0.1:40936)
0808 14:55:41.119969 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0808 14:55:41.120066 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.253:40325: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
I20260808 14:55:41.121194 20214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:41.120848 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.253:40325 (local address 127.0.0.1:40944)
0808 14:55:41.121014 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0808 14:55:41.121077 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.253:40325: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260808 14:55:41.121383 20211 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.206.253:40325: Network error: Client connection negotiation failed: client connection to 127.26.206.253:40325: connect: Connection refused (error 111)
I20260808 14:55:41.212641 20211 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.206.253" port: 40325 } attempt: 3
I20260808 14:55:41.213819 20214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:41.213351 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.253:40325 (local address 127.0.0.1:40948)
0808 14:55:41.213539 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0808 14:55:41.213640 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.253:40325: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260808 14:55:41.214881 20214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:41.214537 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.253:40325 (local address 127.0.0.1:40954)
0808 14:55:41.214680 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0808 14:55:41.214752 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.253:40325: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260808 14:55:41.215139 20211 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.206.253:40325: Network error: Client connection negotiation failed: client connection to 127.26.206.253:40325: connect: Connection refused (error 111)
I20260808 14:55:41.358500 20211 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.206.253" port: 40325 } attempt: 4
W20260808 14:55:41.359122 20218 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 14:55:41.359524 20218 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:55:41.359665 20218 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:55:41.359798 20218 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260808 14:55:41.359948 20214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:41.359306 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.253:40325 (local address 127.0.0.1:40962)
0808 14:55:41.359647 (+ 341us) negotiation.cc:107] Waiting for socket to connect
0808 14:55:41.359777 (+ 130us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.253:40325: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":171}
I20260808 14:55:41.360941 20214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:41.360634 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.253:40325 (local address 127.0.0.1:40972)
0808 14:55:41.360755 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0808 14:55:41.360834 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.253:40325: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260808 14:55:41.361191 20211 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.206.253:40325: Network error: Client connection negotiation failed: client connection to 127.26.206.253:40325: connect: Connection refused (error 111)
W20260808 14:55:41.367292 20218 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:55:41.367362 20218 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:55:41.367415 20218 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:55:41.367455 20218 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:55:41.367530 20218 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:55:41.376960 20218 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:43687
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200577490656-27451-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200577490656-27451-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.26.206.254:43319,127.26.206.253:40325,127.26.206.252:39275
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.253.keytab
--principal=kudu/127.26.206.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.206.253:40325
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200577490656-27451-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.26.206.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200577490656-27451-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:55:41.378118 20218 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:55:41.379400 20218 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:55:41.390861 20224 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:55:41.390800 20225 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:55:41.390825 20227 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:55:41.391966 20218 server_base.cc:1034] running on GCE node
I20260808 14:55:41.392712 20218 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:55:41.394054 20218 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:55:41.395339 20218 hybrid_clock.cc:648] HybridClock initialized: now 1786200941395266 us; error 47 us; skew 500 ppm
I20260808 14:55:41.395808 20218 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:55:41 dist-test-slave-6k22 krb5kdc[20124](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200941, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:55:41.398947 20218 init.cc:377] Logged in from keytab as kudu/127.26.206.253@KRBTEST.COM (short username kudu)
I20260808 14:55:41.400415 20218 webserver.cc:460] Webserver started at http://127.26.206.253:37383/ using document root <none> and password file <none>
I20260808 14:55:41.401110 20218 fs_manager.cc:359] Metadata directory not provided
I20260808 14:55:41.401242 20218 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:55:41.401567 20218 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:55:41.404511 20218 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200577490656-27451-0/minicluster-data/master-1/data/instance:
uuid: "38e79806866342c5ad3472b8dcd1fae4"
format_stamp: "Formatted at 2026-08-08 14:55:41 on dist-test-slave-6k22"
server_key: "62beceb85510422cc6bbc2d5c78c5cc7"
server_key_iv: "02e130ca39e0c84ebeafca1a7be7610e"
server_key_version: "encryptionkey@0"
I20260808 14:55:41.405309 20218 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200577490656-27451-0/minicluster-data/master-1/wal/instance:
uuid: "38e79806866342c5ad3472b8dcd1fae4"
format_stamp: "Formatted at 2026-08-08 14:55:41 on dist-test-slave-6k22"
server_key: "62beceb85510422cc6bbc2d5c78c5cc7"
server_key_iv: "02e130ca39e0c84ebeafca1a7be7610e"
server_key_version: "encryptionkey@0"
I20260808 14:55:41.410277 20218 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.003s
I20260808 14:55:41.413720 20234 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:55:41.415084 20218 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 14:55:41.415266 20218 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200577490656-27451-0/minicluster-data/master-1/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200577490656-27451-0/minicluster-data/master-1/wal
uuid: "38e79806866342c5ad3472b8dcd1fae4"
format_stamp: "Formatted at 2026-08-08 14:55:41 on dist-test-slave-6k22"
server_key: "62beceb85510422cc6bbc2d5c78c5cc7"
server_key_iv: "02e130ca39e0c84ebeafca1a7be7610e"
server_key_version: "encryptionkey@0"
I20260808 14:55:41.415481 20218 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200577490656-27451-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200577490656-27451-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200577490656-27451-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:55:41.437984 20218 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:55:41.442293 20218 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:55:41.442580 20218 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:55:41.460727 20218 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.253:40325
I20260808 14:55:41.460753 20290 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.253:40325 every 8 connection(s)
I20260808 14:55:41.461982 20218 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200577490656-27451-0/minicluster-data/master-1/data/info.pb
I20260808 14:55:41.465623 20291 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:55:41.471587 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 20218
I20260808 14:55:41.471815 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200577490656-27451-0/minicluster-data/master-1/wal/instance
I20260808 14:55:41.472404 27451 external_mini_cluster.cc:1428] Setting key 4894e4927f3a6806ec91e8ffeda676ed
I20260808 14:55:41.472419 20291 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.206.254" port: 43319 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 14:55:41 dist-test-slave-6k22 krb5kdc[20124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200941, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.253@KRBTEST.COM for kudu/127.26.206.254@KRBTEST.COM
I20260808 14:55:41.495761 20213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:41.475471 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48680 (local address 127.26.206.254:43319)
0808 14:55:41.475719 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0808 14:55:41.475727 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:55:41.476896 (+ 1169us) server_negotiation.cc:407] Connection header received
0808 14:55:41.479653 (+ 2757us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:55:41.479657 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:55:41.479722 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:55:41.479810 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:55:41.481885 (+ 2075us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:41.482621 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:41.485028 (+ 2407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:41.485796 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:41.485963 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:55:41.489954 (+ 3991us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:55:41.489961 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:55:41.489965 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:55:41.490005 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:55:41.492714 (+ 2709us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:55:41.493489 (+ 775us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:55:41.493495 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:55:41.493499 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:55:41.493624 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:55:41.494046 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:55:41.494051 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:55:41.494055 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:55:41.494335 (+ 280us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:55:41.494491 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0808 14:55:41.495168 (+ 677us) server_negotiation.cc:299] Negotiation successful
0808 14:55:41.495408 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91}
I20260808 14:55:41.496752 20293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:41.475952 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:43319 (local address 127.0.0.1:48680)
0808 14:55:41.476707 (+ 755us) negotiation.cc:107] Waiting for socket to connect
0808 14:55:41.476754 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0808 14:55:41.479354 (+ 2600us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:55:41.480072 (+ 718us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:55:41.480084 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:55:41.480876 (+ 792us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:55:41.481688 (+ 812us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:55:41.481727 (+ 39us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:55:41.482792 (+ 1065us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:55:41.482800 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:55:41.484844 (+ 2044us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:55:41.484861 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:55:41.486073 (+ 1212us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:55:41.486082 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:55:41.486419 (+ 337us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:55:41.487218 (+ 799us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:55:41.487252 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:55:41.489711 (+ 2459us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:55:41.492862 (+ 3151us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:55:41.492871 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:55:41.492886 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:55:41.493350 (+ 464us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:55:41.493735 (+ 385us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:55:41.493740 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:55:41.493744 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:55:41.493925 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:55:41.494465 (+ 540us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:55:41.494473 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:55:41.494816 (+ 343us) client_negotiation.cc:769] Sending connection context
0808 14:55:41.495069 (+ 253us) client_negotiation.cc:240] Negotiation successful
0808 14:55:41.495548 (+ 479us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":486,"thread_start_us":282,"threads_started":1}
I20260808 14:55:41.498541 20291 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.206.253" port: 40325 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.26.206.252@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.206.252@KRBTEST.COM" created.
Aug 08 14:55:41 dist-test-slave-6k22 krb5kdc[20124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200941, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.253@KRBTEST.COM for kudu/127.26.206.253@KRBTEST.COM
I20260808 14:55:41.513872 20293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:41.499231 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.253:40325 (local address 127.0.0.1:40978)
0808 14:55:41.499414 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0808 14:55:41.499434 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 14:55:41.499528 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:55:41.500576 (+ 1048us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:55:41.500580 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:55:41.501049 (+ 469us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:55:41.501168 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:55:41.501176 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:55:41.502500 (+ 1324us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:55:41.502508 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:55:41.503355 (+ 847us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:55:41.503365 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:55:41.504191 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:55:41.504196 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:55:41.504403 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:55:41.504981 (+ 578us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:55:41.504997 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:55:41.508235 (+ 3238us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:55:41.511313 (+ 3078us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:55:41.511317 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:55:41.511321 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:55:41.511722 (+ 401us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:55:41.512075 (+ 353us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:55:41.512081 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:55:41.512084 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:55:41.512221 (+ 137us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:55:41.512819 (+ 598us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:55:41.512826 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:55:41.512961 (+ 135us) client_negotiation.cc:769] Sending connection context
0808 14:55:41.513105 (+ 144us) client_negotiation.cc:240] Negotiation successful
0808 14:55:41.513404 (+ 299us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":61,"mutex_wait_us":3}
I20260808 14:55:41.513955 20295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:41.499509 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40978 (local address 127.26.206.253:40325)
0808 14:55:41.500191 (+ 682us) server_negotiation.cc:206] Beginning negotiation
0808 14:55:41.500197 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:55:41.500221 (+ 24us) server_negotiation.cc:407] Connection header received
0808 14:55:41.500259 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:55:41.500264 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:55:41.500441 (+ 177us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:55:41.500582 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:55:41.501359 (+ 777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:41.502371 (+ 1012us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:41.503489 (+ 1118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:41.504052 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:41.504268 (+ 216us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:55:41.508451 (+ 4183us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:55:41.508462 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:55:41.508474 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:55:41.508505 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:55:41.511160 (+ 2655us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:55:41.511846 (+ 686us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:55:41.511858 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:55:41.511861 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:55:41.511972 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:55:41.512329 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:55:41.512334 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:55:41.512336 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:55:41.512676 (+ 340us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:55:41.512914 (+ 238us) server_negotiation.cc:1035] Waiting for connection context
0808 14:55:41.513269 (+ 355us) server_negotiation.cc:299] Negotiation successful
0808 14:55:41.513511 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":71,"server-negotiator.queue_time_us":550,"thread_start_us":356,"threads_started":1}
I20260808 14:55:41.516680 20291 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.206.252" port: 39275 } has no permanent_uuid. Determining permanent_uuid...
I20260808 14:55:41.517791 20293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:41.517364 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.252:39275 (local address 127.0.0.1:36466)
0808 14:55:41.517534 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0808 14:55:41.517643 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.252:39275: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260808 14:55:41.518080 20237 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.206.252:39275: connect: Connection refused (error 111)
I20260808 14:55:41.519738 20293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:41.519323 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.252:39275 (local address 127.0.0.1:36478)
0808 14:55:41.519495 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0808 14:55:41.519619 (+ 124us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.252:39275: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260808 14:55:41.520013 20291 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.206.252:39275: Network error: Client connection negotiation failed: client connection to 127.26.206.252:39275: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.206.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.252.keytab.
Entry for principal kudu/127.26.206.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.252.keytab.
I20260808 14:55:41.543216 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200577490656-27451-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200577490656-27451-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200577490656-27451-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200577490656-27451-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.206.252:39275
--webserver_interface=127.26.206.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.252.keytab
--principal=kudu/127.26.206.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.206.212:43687
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.206.254:43319,127.26.206.253:40325,127.26.206.252:39275
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 14:55:41.569336 20291 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.206.252" port: 39275 } attempt: 1
I20260808 14:55:41.570685 20293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:41.570094 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.252:39275 (local address 127.0.0.1:36490)
0808 14:55:41.570341 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0808 14:55:41.570471 (+ 130us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.252:39275: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
I20260808 14:55:41.571849 20293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:41.571386 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.252:39275 (local address 127.0.0.1:36492)
0808 14:55:41.571589 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0808 14:55:41.571686 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.252:39275: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260808 14:55:41.572111 20291 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.206.252:39275: Network error: Client connection negotiation failed: client connection to 127.26.206.252:39275: connect: Connection refused (error 111)
I20260808 14:55:41.640370 20291 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.206.252" port: 39275 } attempt: 2
I20260808 14:55:41.641690 20293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:41.641111 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.252:39275 (local address 127.0.0.1:36502)
0808 14:55:41.641351 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0808 14:55:41.641470 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.252:39275: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83}
I20260808 14:55:41.642786 20293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:41.642377 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.252:39275 (local address 127.0.0.1:36514)
0808 14:55:41.642538 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0808 14:55:41.642622 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.252:39275: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260808 14:55:41.643034 20291 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.206.252:39275: Network error: Client connection negotiation failed: client connection to 127.26.206.252:39275: connect: Connection refused (error 111)
I20260808 14:55:41.660460 20211 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.206.253" port: 40325 } attempt: 5
Aug 08 14:55:41 dist-test-slave-6k22 krb5kdc[20124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200940, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.254@KRBTEST.COM for kudu/127.26.206.253@KRBTEST.COM
I20260808 14:55:41.674306 20295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:41.661342 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40992 (local address 127.26.206.253:40325)
0808 14:55:41.661529 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0808 14:55:41.661535 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:55:41.661557 (+ 22us) server_negotiation.cc:407] Connection header received
0808 14:55:41.661653 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:55:41.661658 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:55:41.661743 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:55:41.661867 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:55:41.662647 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:41.663447 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:41.664675 (+ 1228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:41.665214 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:41.665365 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:55:41.668712 (+ 3347us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:55:41.668716 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:55:41.668720 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:55:41.668750 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:55:41.671293 (+ 2543us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:55:41.672223 (+ 930us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:55:41.672227 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:55:41.672229 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:55:41.672430 (+ 201us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:55:41.672953 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:55:41.672957 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:55:41.672958 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:55:41.673222 (+ 264us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:55:41.673338 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0808 14:55:41.673837 (+ 499us) server_negotiation.cc:299] Negotiation successful
0808 14:55:41.674081 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260808 14:55:41.674393 20214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:41.661135 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.253:40325 (local address 127.0.0.1:40992)
0808 14:55:41.661357 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0808 14:55:41.661374 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 14:55:41.661527 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:55:41.661910 (+ 383us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:55:41.661917 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:55:41.662313 (+ 396us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:55:41.662494 (+ 181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:55:41.662502 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:55:41.663625 (+ 1123us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:55:41.663631 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:55:41.664501 (+ 870us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:55:41.664512 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:55:41.665374 (+ 862us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:55:41.665379 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:55:41.665581 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:55:41.666194 (+ 613us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:55:41.666211 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:55:41.668519 (+ 2308us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:55:41.671435 (+ 2916us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:55:41.671441 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:55:41.671446 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:55:41.672108 (+ 662us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:55:41.672578 (+ 470us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:55:41.672585 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:55:41.672590 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:55:41.672815 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:55:41.673355 (+ 540us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:55:41.673362 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:55:41.673538 (+ 176us) client_negotiation.cc:769] Sending connection context
0808 14:55:41.673696 (+ 158us) client_negotiation.cc:240] Negotiation successful
0808 14:55:41.674019 (+ 323us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":72}
I20260808 14:55:41.675467 20211 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.206.252" port: 39275 } has no permanent_uuid. Determining permanent_uuid...
I20260808 14:55:41.676610 20214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:41.676162 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.252:39275 (local address 127.0.0.1:36522)
0808 14:55:41.676365 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0808 14:55:41.676459 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.252:39275: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
I20260808 14:55:41.677520 20214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:41.677240 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.252:39275 (local address 127.0.0.1:36524)
0808 14:55:41.677371 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0808 14:55:41.677429 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.252:39275: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260808 14:55:41.677803 20211 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.206.252:39275: Network error: Client connection negotiation failed: client connection to 127.26.206.252:39275: connect: Connection refused (error 111)
I20260808 14:55:41.729039 20211 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.206.252" port: 39275 } attempt: 1
I20260808 14:55:41.730262 20214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:41.729789 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.252:39275 (local address 127.0.0.1:36536)
0808 14:55:41.729989 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0808 14:55:41.730083 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.252:39275: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":84}
I20260808 14:55:41.731249 20214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:41.730911 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.252:39275 (local address 127.0.0.1:36542)
0808 14:55:41.731068 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0808 14:55:41.731139 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.252:39275: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260808 14:55:41.731480 20211 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.206.252:39275: Network error: Client connection negotiation failed: client connection to 127.26.206.252:39275: connect: Connection refused (error 111)
I20260808 14:55:41.734292 20291 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.206.252" port: 39275 } attempt: 3
I20260808 14:55:41.735468 20293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:41.734893 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.252:39275 (local address 127.0.0.1:36556)
0808 14:55:41.735119 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0808 14:55:41.735239 (+ 120us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.252:39275: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
I20260808 14:55:41.736697 20293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:41.736151 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.252:39275 (local address 127.0.0.1:36568)
0808 14:55:41.736414 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0808 14:55:41.736525 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.252:39275: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":136}
W20260808 14:55:41.736932 20291 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.206.252:39275: Network error: Client connection negotiation failed: client connection to 127.26.206.252:39275: connect: Connection refused (error 111)
I20260808 14:55:41.799746 20211 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.206.252" port: 39275 } attempt: 2
I20260808 14:55:41.801025 20214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:41.800514 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.252:39275 (local address 127.0.0.1:36572)
0808 14:55:41.800762 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0808 14:55:41.800868 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.252:39275: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":80}
I20260808 14:55:41.802021 20214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:41.801681 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.252:39275 (local address 127.0.0.1:36582)
0808 14:55:41.801845 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0808 14:55:41.801922 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.252:39275: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260808 14:55:41.802275 20211 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.206.252:39275: Network error: Client connection negotiation failed: client connection to 127.26.206.252:39275: connect: Connection refused (error 111)
I20260808 14:55:41.880182 20291 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.206.252" port: 39275 } attempt: 4
I20260808 14:55:41.881480 20293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:41.880883 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.252:39275 (local address 127.0.0.1:36584)
0808 14:55:41.881147 (+ 264us) negotiation.cc:107] Waiting for socket to connect
0808 14:55:41.881280 (+ 133us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.252:39275: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
I20260808 14:55:41.882601 20293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:41.882210 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.252:39275 (local address 127.0.0.1:36598)
0808 14:55:41.882369 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0808 14:55:41.882457 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.252:39275: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260808 14:55:41.882819 20291 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.206.252:39275: Network error: Client connection negotiation failed: client connection to 127.26.206.252:39275: connect: Connection refused (error 111)
W20260808 14:55:41.894603 20298 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 14:55:41.894878 20298 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:55:41.894945 20298 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:55:41.895030 20298 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:55:41.902246 20298 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:55:41.902328 20298 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:55:41.902401 20298 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:55:41.902455 20298 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:55:41.902518 20298 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:55:41.908494 20211 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.206.252" port: 39275 } attempt: 3
I20260808 14:55:41.909588 20214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:41.909171 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.252:39275 (local address 127.0.0.1:36604)
0808 14:55:41.909353 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0808 14:55:41.909435 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.252:39275: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
I20260808 14:55:41.910573 20214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:41.910243 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.252:39275 (local address 127.0.0.1:36608)
0808 14:55:41.910409 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0808 14:55:41.910481 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.252:39275: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":92}
W20260808 14:55:41.910831 20211 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.206.252:39275: Network error: Client connection negotiation failed: client connection to 127.26.206.252:39275: connect: Connection refused (error 111)
I20260808 14:55:41.912735 20298 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:43687
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200577490656-27451-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200577490656-27451-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.26.206.254:43319,127.26.206.253:40325,127.26.206.252:39275
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.252.keytab
--principal=kudu/127.26.206.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.206.252:39275
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200577490656-27451-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.26.206.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200577490656-27451-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:55:41.914110 20298 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:55:41.915493 20298 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:55:41.927306 20306 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:55:41.927461 20303 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:55:41.927306 20304 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:55:41.928596 20298 server_base.cc:1034] running on GCE node
I20260808 14:55:41.929323 20298 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:55:41.930577 20298 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:55:41.931785 20298 hybrid_clock.cc:648] HybridClock initialized: now 1786200941931719 us; error 25 us; skew 500 ppm
I20260808 14:55:41.932057 20298 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:55:41 dist-test-slave-6k22 krb5kdc[20124](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200941, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:55:41.935038 20298 init.cc:377] Logged in from keytab as kudu/127.26.206.252@KRBTEST.COM (short username kudu)
I20260808 14:55:41.936372 20298 webserver.cc:460] Webserver started at http://127.26.206.252:40819/ using document root <none> and password file <none>
I20260808 14:55:41.936964 20298 fs_manager.cc:359] Metadata directory not provided
I20260808 14:55:41.937048 20298 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:55:41.937330 20298 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:55:41.940395 20298 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200577490656-27451-0/minicluster-data/master-2/data/instance:
uuid: "8be583a459fe43f69865391ed2efd796"
format_stamp: "Formatted at 2026-08-08 14:55:41 on dist-test-slave-6k22"
server_key: "b97fa7fdcb80eb7c8c615dbc854e2e5e"
server_key_iv: "9f74d58951a23f12c25fc2fd4db7b88a"
server_key_version: "encryptionkey@0"
I20260808 14:55:41.941171 20298 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200577490656-27451-0/minicluster-data/master-2/wal/instance:
uuid: "8be583a459fe43f69865391ed2efd796"
format_stamp: "Formatted at 2026-08-08 14:55:41 on dist-test-slave-6k22"
server_key: "b97fa7fdcb80eb7c8c615dbc854e2e5e"
server_key_iv: "9f74d58951a23f12c25fc2fd4db7b88a"
server_key_version: "encryptionkey@0"
I20260808 14:55:41.946153 20298 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260808 14:55:41.949690 20314 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:55:41.951072 20298 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 14:55:41.951237 20298 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200577490656-27451-0/minicluster-data/master-2/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200577490656-27451-0/minicluster-data/master-2/wal
uuid: "8be583a459fe43f69865391ed2efd796"
format_stamp: "Formatted at 2026-08-08 14:55:41 on dist-test-slave-6k22"
server_key: "b97fa7fdcb80eb7c8c615dbc854e2e5e"
server_key_iv: "9f74d58951a23f12c25fc2fd4db7b88a"
server_key_version: "encryptionkey@0"
I20260808 14:55:41.951450 20298 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200577490656-27451-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200577490656-27451-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200577490656-27451-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:55:41.971310 20298 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:55:41.975090 20298 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:55:41.975366 20298 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:55:41.993942 20298 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.252:39275
I20260808 14:55:41.993971 20370 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.252:39275 every 8 connection(s)
I20260808 14:55:41.995217 20298 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200577490656-27451-0/minicluster-data/master-2/data/info.pb
I20260808 14:55:41.998893 20371 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:55:42.003925 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 20298
I20260808 14:55:42.004133 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200577490656-27451-0/minicluster-data/master-2/wal/instance
I20260808 14:55:42.004565 27451 external_mini_cluster.cc:1428] Setting key 93558dd7e1aac156a64b7796af640474
I20260808 14:55:42.006032 20371 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.206.254" port: 43319 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 14:55:42 dist-test-slave-6k22 krb5kdc[20124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200941, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.252@KRBTEST.COM for kudu/127.26.206.254@KRBTEST.COM
Aug 08 14:55:42 dist-test-slave-6k22 krb5kdc[20124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200940, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.206.252@KRBTEST.COM
I20260808 14:55:42.026609 20376 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:42.008764 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48682 (local address 127.26.206.254:43319)
0808 14:55:42.010012 (+ 1248us) server_negotiation.cc:206] Beginning negotiation
0808 14:55:42.010018 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:55:42.010090 (+ 72us) server_negotiation.cc:407] Connection header received
0808 14:55:42.010359 (+ 269us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:55:42.010365 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:55:42.010445 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:55:42.010560 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:55:42.012283 (+ 1723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:42.013532 (+ 1249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:42.015593 (+ 2061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:42.016210 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:42.016351 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:55:42.020649 (+ 4298us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:55:42.020656 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:55:42.020661 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:55:42.020702 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:55:42.023536 (+ 2834us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:55:42.024284 (+ 748us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:55:42.024291 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:55:42.024298 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:55:42.024432 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:55:42.024857 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:55:42.024865 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:55:42.024869 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:55:42.025150 (+ 281us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:55:42.025322 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0808 14:55:42.025969 (+ 647us) server_negotiation.cc:299] Negotiation successful
0808 14:55:42.026188 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1125,"thread_start_us":1025,"threads_started":1}
I20260808 14:55:42.027820 20374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:42.006430 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36612 (local address 127.26.206.252:39275)
0808 14:55:42.007270 (+ 840us) server_negotiation.cc:206] Beginning negotiation
0808 14:55:42.007281 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 14:55:42.007320 (+ 39us) server_negotiation.cc:407] Connection header received
0808 14:55:42.009656 (+ 2336us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:55:42.009684 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:55:42.010180 (+ 496us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:55:42.010398 (+ 218us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:55:42.012283 (+ 1885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:42.013983 (+ 1700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:42.015735 (+ 1752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:42.016569 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:42.016672 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:55:42.021605 (+ 4933us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:55:42.021617 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:55:42.021633 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:55:42.021679 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:55:42.024555 (+ 2876us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:55:42.025256 (+ 701us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:55:42.025264 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:55:42.025267 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:55:42.025390 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:55:42.025791 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:55:42.025795 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:55:42.025797 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:55:42.026123 (+ 326us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:55:42.026437 (+ 314us) server_negotiation.cc:1035] Waiting for connection context
0808 14:55:42.026751 (+ 314us) server_negotiation.cc:299] Negotiation successful
0808 14:55:42.026992 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":59,"server-negotiator.queue_time_us":622,"spinlock_wait_cycles":11136,"thread_start_us":381,"threads_started":1}
I20260808 14:55:42.027851 20375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:42.008664 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:43319 (local address 127.0.0.1:48682)
0808 14:55:42.009956 (+ 1292us) negotiation.cc:107] Waiting for socket to connect
0808 14:55:42.009999 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 14:55:42.010144 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:55:42.010646 (+ 502us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:55:42.010654 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:55:42.011522 (+ 868us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:55:42.012106 (+ 584us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:55:42.012129 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:55:42.013677 (+ 1548us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:55:42.013681 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:55:42.015425 (+ 1744us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:55:42.015442 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:55:42.016429 (+ 987us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:55:42.016437 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:55:42.016664 (+ 227us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:55:42.017463 (+ 799us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:55:42.017491 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:55:42.020452 (+ 2961us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:55:42.023692 (+ 3240us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:55:42.023703 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:55:42.023713 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:55:42.024165 (+ 452us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:55:42.024547 (+ 382us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:55:42.024552 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:55:42.024555 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:55:42.024743 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:55:42.025304 (+ 561us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:55:42.025316 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:55:42.025620 (+ 304us) client_negotiation.cc:769] Sending connection context
0808 14:55:42.025889 (+ 269us) client_negotiation.cc:240] Negotiation successful
0808 14:55:42.026349 (+ 460us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1008,"mutex_wait_us":1,"spinlock_wait_cycles":17280,"thread_start_us":308,"threads_started":1}
I20260808 14:55:42.029543 20371 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.206.253" port: 40325 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 14:55:42 dist-test-slave-6k22 krb5kdc[20124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200941, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.252@KRBTEST.COM for kudu/127.26.206.253@KRBTEST.COM
Aug 08 14:55:42 dist-test-slave-6k22 krb5kdc[20124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200940, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.206.254@KRBTEST.COM
I20260808 14:55:42.042925 20375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:42.030381 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.253:40325 (local address 127.0.0.1:41004)
0808 14:55:42.030527 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0808 14:55:42.030546 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 14:55:42.030652 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:55:42.031003 (+ 351us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:55:42.031008 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:55:42.031363 (+ 355us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:55:42.031496 (+ 133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:55:42.031504 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:55:42.032474 (+ 970us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:55:42.032480 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:55:42.033347 (+ 867us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:55:42.033358 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:55:42.034072 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:55:42.034077 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:55:42.034256 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:55:42.034759 (+ 503us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:55:42.034777 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:55:42.036905 (+ 2128us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:55:42.040472 (+ 3567us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:55:42.040475 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:55:42.040478 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:55:42.040931 (+ 453us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:55:42.041346 (+ 415us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:55:42.041350 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:55:42.041352 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:55:42.041493 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:55:42.042110 (+ 617us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:55:42.042113 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:55:42.042233 (+ 120us) client_negotiation.cc:769] Sending connection context
0808 14:55:42.042371 (+ 138us) client_negotiation.cc:240] Negotiation successful
0808 14:55:42.042553 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41}
I20260808 14:55:42.043253 20295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:42.030509 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41004 (local address 127.26.206.253:40325)
0808 14:55:42.030690 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0808 14:55:42.030698 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:55:42.030720 (+ 22us) server_negotiation.cc:407] Connection header received
0808 14:55:42.030794 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:55:42.030799 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:55:42.030876 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:55:42.030982 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:55:42.031667 (+ 685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:42.032339 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:42.033486 (+ 1147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:42.033903 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:42.034062 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:55:42.037088 (+ 3026us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:55:42.037092 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:55:42.037095 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:55:42.037125 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:55:42.040330 (+ 3205us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:55:42.041058 (+ 728us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:55:42.041063 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:55:42.041066 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:55:42.041222 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:55:42.041604 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:55:42.041612 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:55:42.041617 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:55:42.041981 (+ 364us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:55:42.042151 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0808 14:55:42.042515 (+ 364us) server_negotiation.cc:299] Negotiation successful
0808 14:55:42.042741 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260808 14:55:42.044183 20371 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.206.252" port: 39275 } has no permanent_uuid. Determining permanent_uuid...
I20260808 14:55:42.045842 20376 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:42.031024 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48692 (local address 127.26.206.254:43319)
0808 14:55:42.031175 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0808 14:55:42.031179 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:55:42.031191 (+ 12us) server_negotiation.cc:407] Connection header received
0808 14:55:42.031226 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:55:42.031228 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:55:42.031297 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:55:42.031400 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:55:42.032518 (+ 1118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:42.033187 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:42.034397 (+ 1210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:42.034948 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:42.035094 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:55:42.039173 (+ 4079us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:55:42.039180 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:55:42.039184 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:55:42.039227 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:55:42.042624 (+ 3397us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:55:42.043413 (+ 789us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:55:42.043421 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:55:42.043427 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:55:42.043615 (+ 188us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:55:42.044069 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:55:42.044073 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:55:42.044077 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:55:42.044393 (+ 316us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:55:42.044623 (+ 230us) server_negotiation.cc:1035] Waiting for connection context
0808 14:55:42.045244 (+ 621us) server_negotiation.cc:299] Negotiation successful
0808 14:55:42.045477 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
Aug 08 14:55:42 dist-test-slave-6k22 krb5kdc[20124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200941, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.252@KRBTEST.COM for kudu/127.26.206.252@KRBTEST.COM
Aug 08 14:55:42 dist-test-slave-6k22 krb5kdc[20124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200940, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.206.253@KRBTEST.COM
I20260808 14:55:42.057641 20374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:42.045022 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36616 (local address 127.26.206.252:39275)
0808 14:55:42.045219 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0808 14:55:42.045225 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:55:42.045520 (+ 295us) server_negotiation.cc:407] Connection header received
0808 14:55:42.045556 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:55:42.045560 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:55:42.045618 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:55:42.045700 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:55:42.046469 (+ 769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:42.047422 (+ 953us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:42.048589 (+ 1167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:42.048978 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:42.049109 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:55:42.051988 (+ 2879us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:55:42.051993 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:55:42.051996 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:55:42.052038 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:55:42.054955 (+ 2917us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:55:42.055671 (+ 716us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:55:42.055678 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:55:42.055681 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:55:42.055797 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:55:42.056153 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:55:42.056158 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:55:42.056161 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:55:42.056410 (+ 249us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:55:42.056580 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0808 14:55:42.057004 (+ 424us) server_negotiation.cc:299] Negotiation successful
0808 14:55:42.057323 (+ 319us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":162,"server-negotiator.queue_time_us":67}
I20260808 14:55:42.057660 20375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:42.045062 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.252:39275 (local address 127.0.0.1:36616)
0808 14:55:42.045308 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0808 14:55:42.045326 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 14:55:42.045431 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:55:42.045724 (+ 293us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:55:42.045728 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:55:42.046169 (+ 441us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:55:42.046314 (+ 145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:55:42.046322 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:55:42.047600 (+ 1278us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:55:42.047605 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:55:42.048438 (+ 833us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:55:42.048447 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:55:42.049116 (+ 669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:55:42.049121 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:55:42.049369 (+ 248us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:55:42.049895 (+ 526us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:55:42.049910 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:55:42.051798 (+ 1888us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:55:42.055074 (+ 3276us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:55:42.055081 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:55:42.055084 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:55:42.055582 (+ 498us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:55:42.055897 (+ 315us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:55:42.055903 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:55:42.055906 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:55:42.056037 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:55:42.056536 (+ 499us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:55:42.056539 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:55:42.056732 (+ 193us) client_negotiation.cc:769] Sending connection context
0808 14:55:42.056895 (+ 163us) client_negotiation.cc:240] Negotiation successful
0808 14:55:42.057185 (+ 290us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"mutex_wait_us":36}
I20260808 14:55:42.061867 20295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:42.047510 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41012 (local address 127.26.206.253:40325)
0808 14:55:42.047901 (+ 391us) server_negotiation.cc:206] Beginning negotiation
0808 14:55:42.047905 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:55:42.047918 (+ 13us) server_negotiation.cc:407] Connection header received
0808 14:55:42.047953 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:55:42.047956 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:55:42.048002 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:55:42.048114 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:55:42.049253 (+ 1139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:42.049947 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:42.051088 (+ 1141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:42.051599 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:42.051740 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:55:42.055980 (+ 4240us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:55:42.055984 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:55:42.055987 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:55:42.056015 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:55:42.059301 (+ 3286us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:55:42.060106 (+ 805us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:55:42.060109 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:55:42.060111 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:55:42.060285 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:55:42.060667 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:55:42.060670 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:55:42.060672 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:55:42.060909 (+ 237us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:55:42.061097 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0808 14:55:42.061439 (+ 342us) server_negotiation.cc:299] Negotiation successful
0808 14:55:42.061597 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":285}
I20260808 14:55:42.063746 20371 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8be583a459fe43f69865391ed2efd796: Bootstrap starting.
I20260808 14:55:42.066659 27451 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:55:42.067552 20371 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8be583a459fe43f69865391ed2efd796: Neither blocks nor log segments found. Creating new log.
I20260808 14:55:42.068854 20371 log.cc:824] T 00000000000000000000000000000000 P 8be583a459fe43f69865391ed2efd796: Log is configured to *not* fsync() on all Append() calls
I20260808 14:55:42.072103 20371 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8be583a459fe43f69865391ed2efd796: No bootstrap required, opened a new log
I20260808 14:55:42.070359 20184 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "b6c06c3978484e78a08a649f1b417044"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48692
I20260808 14:55:42.082798 20371 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8be583a459fe43f69865391ed2efd796 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6c06c3978484e78a08a649f1b417044" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 43319 } } peers { permanent_uuid: "38e79806866342c5ad3472b8dcd1fae4" member_type: VOTER last_known_addr { host: "127.26.206.253" port: 40325 } } peers { permanent_uuid: "8be583a459fe43f69865391ed2efd796" member_type: VOTER last_known_addr { host: "127.26.206.252" port: 39275 } }
I20260808 14:55:42.083168 20371 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8be583a459fe43f69865391ed2efd796 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8be583a459fe43f69865391ed2efd796, State: Initialized, Role: FOLLOWER
I20260808 14:55:42.083685 20371 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8be583a459fe43f69865391ed2efd796 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6c06c3978484e78a08a649f1b417044" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 43319 } } peers { permanent_uuid: "38e79806866342c5ad3472b8dcd1fae4" member_type: VOTER last_known_addr { host: "127.26.206.253" port: 40325 } } peers { permanent_uuid: "8be583a459fe43f69865391ed2efd796" member_type: VOTER last_known_addr { host: "127.26.206.252" port: 39275 } }
I20260808 14:55:42.084532 20378 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8be583a459fe43f69865391ed2efd796 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6c06c3978484e78a08a649f1b417044" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 43319 } } peers { permanent_uuid: "38e79806866342c5ad3472b8dcd1fae4" member_type: VOTER last_known_addr { host: "127.26.206.253" port: 40325 } } peers { permanent_uuid: "8be583a459fe43f69865391ed2efd796" member_type: VOTER last_known_addr { host: "127.26.206.252" port: 39275 } } }
I20260808 14:55:42.084859 20378 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8be583a459fe43f69865391ed2efd796 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 14:55:42.085768 20371 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8be583a459fe43f69865391ed2efd796 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:55:42.088040 20211 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.206.252" port: 39275 } attempt: 4
Aug 08 14:55:42 dist-test-slave-6k22 krb5kdc[20124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200940, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.254@KRBTEST.COM for kudu/127.26.206.252@KRBTEST.COM
W20260808 14:55:42.098374 20390 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 8be583a459fe43f69865391ed2efd796: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 14:55:42.098578 20390 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 14:55:42.105198 20214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:42.088727 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.252:39275 (local address 127.0.0.1:36620)
0808 14:55:42.088913 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0808 14:55:42.088933 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 14:55:42.089039 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:55:42.089465 (+ 426us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:55:42.089468 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:55:42.089848 (+ 380us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:55:42.090023 (+ 175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:55:42.090030 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:55:42.091788 (+ 1758us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:55:42.091793 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:55:42.093086 (+ 1293us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:55:42.093100 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:55:42.093853 (+ 753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:55:42.093861 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:55:42.094132 (+ 271us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:55:42.094844 (+ 712us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:55:42.094874 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:55:42.097929 (+ 3055us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:55:42.102284 (+ 4355us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:55:42.102289 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:55:42.102309 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:55:42.102841 (+ 532us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:55:42.103299 (+ 458us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:55:42.103304 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:55:42.103307 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:55:42.103465 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:55:42.104184 (+ 719us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:55:42.104188 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:55:42.104369 (+ 181us) client_negotiation.cc:769] Sending connection context
0808 14:55:42.104524 (+ 155us) client_negotiation.cc:240] Negotiation successful
0808 14:55:42.104819 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":63}
I20260808 14:55:42.105214 20374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:42.088872 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36620 (local address 127.26.206.252:39275)
0808 14:55:42.089088 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0808 14:55:42.089097 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:55:42.089125 (+ 28us) server_negotiation.cc:407] Connection header received
0808 14:55:42.089208 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:55:42.089216 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:55:42.089329 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:55:42.089455 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:55:42.090180 (+ 725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:42.091527 (+ 1347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:42.093222 (+ 1695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:42.093710 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:42.093823 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:55:42.098157 (+ 4334us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:55:42.098164 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:55:42.098168 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:55:42.098202 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:55:42.102116 (+ 3914us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:55:42.102992 (+ 876us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:55:42.103001 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:55:42.103005 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:55:42.103187 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:55:42.103616 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:55:42.103621 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:55:42.103627 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:55:42.104059 (+ 432us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:55:42.104205 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0808 14:55:42.104642 (+ 437us) server_negotiation.cc:299] Negotiation successful
0808 14:55:42.104868 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260808 14:55:42.094126 20298 master_runner.cc:186] Error getting master registration for 127.26.206.254:43319: OK, instance_id { permanent_uuid: "b6c06c3978484e78a08a649f1b417044" instance_seqno: 1786200940943876 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 14:55:42.106124 20298 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 14:55:42.111269 20211 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b6c06c3978484e78a08a649f1b417044: Bootstrap starting.
I20260808 14:55:42.115281 20211 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b6c06c3978484e78a08a649f1b417044: Neither blocks nor log segments found. Creating new log.
I20260808 14:55:42.116647 20211 log.cc:824] T 00000000000000000000000000000000 P b6c06c3978484e78a08a649f1b417044: Log is configured to *not* fsync() on all Append() calls
I20260808 14:55:42.119999 20211 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b6c06c3978484e78a08a649f1b417044: No bootstrap required, opened a new log
I20260808 14:55:42.127409 20211 raft_consensus.cc:348] T 00000000000000000000000000000000 P b6c06c3978484e78a08a649f1b417044 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6c06c3978484e78a08a649f1b417044" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 43319 } } peers { permanent_uuid: "38e79806866342c5ad3472b8dcd1fae4" member_type: VOTER last_known_addr { host: "127.26.206.253" port: 40325 } } peers { permanent_uuid: "8be583a459fe43f69865391ed2efd796" member_type: VOTER last_known_addr { host: "127.26.206.252" port: 39275 } }
I20260808 14:55:42.127826 20211 raft_consensus.cc:729] T 00000000000000000000000000000000 P b6c06c3978484e78a08a649f1b417044 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6c06c3978484e78a08a649f1b417044, State: Initialized, Role: FOLLOWER
I20260808 14:55:42.128300 20211 consensus_queue.cc:260] T 00000000000000000000000000000000 P b6c06c3978484e78a08a649f1b417044 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6c06c3978484e78a08a649f1b417044" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 43319 } } peers { permanent_uuid: "38e79806866342c5ad3472b8dcd1fae4" member_type: VOTER last_known_addr { host: "127.26.206.253" port: 40325 } } peers { permanent_uuid: "8be583a459fe43f69865391ed2efd796" member_type: VOTER last_known_addr { host: "127.26.206.252" port: 39275 } }
I20260808 14:55:42.129314 20393 sys_catalog.cc:455] T 00000000000000000000000000000000 P b6c06c3978484e78a08a649f1b417044 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6c06c3978484e78a08a649f1b417044" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 43319 } } peers { permanent_uuid: "38e79806866342c5ad3472b8dcd1fae4" member_type: VOTER last_known_addr { host: "127.26.206.253" port: 40325 } } peers { permanent_uuid: "8be583a459fe43f69865391ed2efd796" member_type: VOTER last_known_addr { host: "127.26.206.252" port: 39275 } } }
I20260808 14:55:42.129705 20393 sys_catalog.cc:458] T 00000000000000000000000000000000 P b6c06c3978484e78a08a649f1b417044 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 14:55:42.130584 20211 sys_catalog.cc:564] T 00000000000000000000000000000000 P b6c06c3978484e78a08a649f1b417044 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:55:42.130648 20184 raft_consensus.cc:482] T 00000000000000000000000000000000 P b6c06c3978484e78a08a649f1b417044 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260808 14:55:42.130883 20184 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b6c06c3978484e78a08a649f1b417044 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:55:42.133687 20184 raft_consensus.cc:504] T 00000000000000000000000000000000 P b6c06c3978484e78a08a649f1b417044 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6c06c3978484e78a08a649f1b417044" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 43319 } } peers { permanent_uuid: "38e79806866342c5ad3472b8dcd1fae4" member_type: VOTER last_known_addr { host: "127.26.206.253" port: 40325 } } peers { permanent_uuid: "8be583a459fe43f69865391ed2efd796" member_type: VOTER last_known_addr { host: "127.26.206.252" port: 39275 } }
I20260808 14:55:42.135057 20184 leader_election.cc:288] T 00000000000000000000000000000000 P b6c06c3978484e78a08a649f1b417044 [CANDIDATE]: Term 1 election: Requested vote from peers 38e79806866342c5ad3472b8dcd1fae4 (127.26.206.253:40325), 8be583a459fe43f69865391ed2efd796 (127.26.206.252:39275)
I20260808 14:55:42.136373 20344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b6c06c3978484e78a08a649f1b417044" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "8be583a459fe43f69865391ed2efd796"
I20260808 14:55:42.136843 20344 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8be583a459fe43f69865391ed2efd796 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:55:42.139247 20344 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 8be583a459fe43f69865391ed2efd796 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6c06c3978484e78a08a649f1b417044 in term 1.
I20260808 14:55:42.139886 20157 leader_election.cc:302] T 00000000000000000000000000000000 P b6c06c3978484e78a08a649f1b417044 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8be583a459fe43f69865391ed2efd796, b6c06c3978484e78a08a649f1b417044; no voters:
I20260808 14:55:42.141371 20393 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b6c06c3978484e78a08a649f1b417044 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:55:42.142159 20393 raft_consensus.cc:686] T 00000000000000000000000000000000 P b6c06c3978484e78a08a649f1b417044 [term 1 LEADER]: Becoming Leader. State: Replica: b6c06c3978484e78a08a649f1b417044, State: Running, Role: LEADER
I20260808 14:55:42.142676 20393 consensus_queue.cc:237] T 00000000000000000000000000000000 P b6c06c3978484e78a08a649f1b417044 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6c06c3978484e78a08a649f1b417044" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 43319 } } peers { permanent_uuid: "38e79806866342c5ad3472b8dcd1fae4" member_type: VOTER last_known_addr { host: "127.26.206.253" port: 40325 } } peers { permanent_uuid: "8be583a459fe43f69865391ed2efd796" member_type: VOTER last_known_addr { host: "127.26.206.252" port: 39275 } }
I20260808 14:55:42.155737 20402 sys_catalog.cc:455] T 00000000000000000000000000000000 P b6c06c3978484e78a08a649f1b417044 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b6c06c3978484e78a08a649f1b417044. Latest consensus state: current_term: 1 leader_uuid: "b6c06c3978484e78a08a649f1b417044" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6c06c3978484e78a08a649f1b417044" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 43319 } } peers { permanent_uuid: "38e79806866342c5ad3472b8dcd1fae4" member_type: VOTER last_known_addr { host: "127.26.206.253" port: 40325 } } peers { permanent_uuid: "8be583a459fe43f69865391ed2efd796" member_type: VOTER last_known_addr { host: "127.26.206.252" port: 39275 } } }
I20260808 14:55:42.156219 20402 sys_catalog.cc:458] T 00000000000000000000000000000000 P b6c06c3978484e78a08a649f1b417044 [sys.catalog]: This master's current role is: LEADER
I20260808 14:55:42.160496 20411 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:55:42.167150 20411 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:55:42.182237 20291 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.206.252" port: 39275 } attempt: 5
W20260808 14:55:42.185851 20160 tablet.cc:2369] T 00000000000000000000000000000000 P b6c06c3978484e78a08a649f1b417044: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:55:42.182518 20137 master_runner.cc:186] Error getting master registration for 127.26.206.253:40325: OK, instance_id { permanent_uuid: "38e79806866342c5ad3472b8dcd1fae4" instance_seqno: 1786200941455639 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 14:55:42.197569 20137 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 14:55:42.212325 20344 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 8be583a459fe43f69865391ed2efd796 [term 1 FOLLOWER]: Refusing update from remote peer b6c06c3978484e78a08a649f1b417044: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:55:42.213594 20402 consensus_queue.cc:1035] T 00000000000000000000000000000000 P b6c06c3978484e78a08a649f1b417044 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8be583a459fe43f69865391ed2efd796" member_type: VOTER last_known_addr { host: "127.26.206.252" port: 39275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
Aug 08 14:55:42 dist-test-slave-6k22 krb5kdc[20124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200941, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.253@KRBTEST.COM for kudu/127.26.206.252@KRBTEST.COM
W20260808 14:55:42.227442 20320 tablet.cc:2369] T 00000000000000000000000000000000 P 8be583a459fe43f69865391ed2efd796: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:55:42.251959 20378 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8be583a459fe43f69865391ed2efd796 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b6c06c3978484e78a08a649f1b417044. Latest consensus state: current_term: 1 leader_uuid: "b6c06c3978484e78a08a649f1b417044" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6c06c3978484e78a08a649f1b417044" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 43319 } } peers { permanent_uuid: "38e79806866342c5ad3472b8dcd1fae4" member_type: VOTER last_known_addr { host: "127.26.206.253" port: 40325 } } peers { permanent_uuid: "8be583a459fe43f69865391ed2efd796" member_type: VOTER last_known_addr { host: "127.26.206.252" port: 39275 } } }
I20260808 14:55:42.252291 20378 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8be583a459fe43f69865391ed2efd796 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 14:55:42.255226 20378 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8be583a459fe43f69865391ed2efd796 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b6c06c3978484e78a08a649f1b417044" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6c06c3978484e78a08a649f1b417044" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 43319 } } peers { permanent_uuid: "38e79806866342c5ad3472b8dcd1fae4" member_type: VOTER last_known_addr { host: "127.26.206.253" port: 40325 } } peers { permanent_uuid: "8be583a459fe43f69865391ed2efd796" member_type: VOTER last_known_addr { host: "127.26.206.252" port: 39275 } } }
I20260808 14:55:42.255460 20378 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8be583a459fe43f69865391ed2efd796 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 14:55:42.257267 20417 mvcc.cc:205] Tried to move back new op lower bound from 7316279059255640064 to 7316279059020517376. Current Snapshot: MvccSnapshot[applied={T|T < 7316279059255640064}]
I20260808 14:55:42.262809 20393 sys_catalog.cc:455] T 00000000000000000000000000000000 P b6c06c3978484e78a08a649f1b417044 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b6c06c3978484e78a08a649f1b417044" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6c06c3978484e78a08a649f1b417044" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 43319 } } peers { permanent_uuid: "38e79806866342c5ad3472b8dcd1fae4" member_type: VOTER last_known_addr { host: "127.26.206.253" port: 40325 } } peers { permanent_uuid: "8be583a459fe43f69865391ed2efd796" member_type: VOTER last_known_addr { host: "127.26.206.252" port: 39275 } } }
I20260808 14:55:42.263121 20393 sys_catalog.cc:458] T 00000000000000000000000000000000 P b6c06c3978484e78a08a649f1b417044 [sys.catalog]: This master's current role is: LEADER
I20260808 14:55:42.268189 20295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:42.232913 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41028 (local address 127.26.206.253:40325)
0808 14:55:42.233089 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0808 14:55:42.233095 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:55:42.242311 (+ 9216us) server_negotiation.cc:407] Connection header received
0808 14:55:42.242660 (+ 349us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:55:42.242665 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:55:42.242779 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:55:42.242864 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:55:42.246527 (+ 3663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:42.247633 (+ 1106us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:42.250652 (+ 3019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:42.251332 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:42.251449 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:55:42.258739 (+ 7290us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:55:42.258748 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:55:42.258755 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:55:42.258818 (+ 63us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:55:42.262960 (+ 4142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:55:42.264517 (+ 1557us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:55:42.264523 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:55:42.264527 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:55:42.264687 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:55:42.265441 (+ 754us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:55:42.265447 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:55:42.265451 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:55:42.266034 (+ 583us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:55:42.266418 (+ 384us) server_negotiation.cc:1035] Waiting for connection context
0808 14:55:42.267323 (+ 905us) server_negotiation.cc:299] Negotiation successful
0808 14:55:42.267713 (+ 390us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260808 14:55:42.272432 20293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:42.182758 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.252:39275 (local address 127.0.0.1:36650)
0808 14:55:42.183104 (+ 346us) negotiation.cc:107] Waiting for socket to connect
0808 14:55:42.183124 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 14:55:42.183239 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:55:42.195828 (+ 12589us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:55:42.195835 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:55:42.196488 (+ 653us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:55:42.196762 (+ 274us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:55:42.196775 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:55:42.206498 (+ 9723us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:55:42.206508 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:55:42.208426 (+ 1918us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:55:42.208447 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:55:42.221542 (+ 13095us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:55:42.221547 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:55:42.221877 (+ 330us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:55:42.222673 (+ 796us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:55:42.222704 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:55:42.226406 (+ 3702us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:55:42.263634 (+ 37228us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:55:42.263651 (+ 17us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:55:42.263654 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:55:42.264150 (+ 496us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:55:42.270550 (+ 6400us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:55:42.270555 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:55:42.270558 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:55:42.270768 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:55:42.271436 (+ 668us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:55:42.271441 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:55:42.271666 (+ 225us) client_negotiation.cc:769] Sending connection context
0808 14:55:42.271828 (+ 162us) client_negotiation.cc:240] Negotiation successful
0808 14:55:42.272128 (+ 300us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":229}
I20260808 14:55:42.273478 20418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:42.183476 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36650 (local address 127.26.206.252:39275)
0808 14:55:42.195185 (+ 11709us) server_negotiation.cc:206] Beginning negotiation
0808 14:55:42.195198 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 14:55:42.195232 (+ 34us) server_negotiation.cc:407] Connection header received
0808 14:55:42.195327 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:55:42.195334 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:55:42.195450 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:55:42.197036 (+ 1586us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:55:42.197391 (+ 355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:42.199022 (+ 1631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:42.208680 (+ 9658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:42.209675 (+ 995us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:42.222322 (+ 12647us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:55:42.226708 (+ 4386us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:55:42.226717 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:55:42.226725 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:55:42.226772 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:55:42.248382 (+ 21610us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:55:42.266030 (+ 17648us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:55:42.266035 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:55:42.266040 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:55:42.266243 (+ 203us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:55:42.270934 (+ 4691us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:55:42.270940 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:55:42.270944 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:55:42.271305 (+ 361us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:55:42.271449 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0808 14:55:42.272762 (+ 1313us) server_negotiation.cc:299] Negotiation successful
0808 14:55:42.273014 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11526,"thread_start_us":12082,"threads_started":1}
I20260808 14:55:42.274571 20411 catalog_manager.cc:1347] Generated new cluster ID: 6403cd9eeaff4bb4a96b00fd5dcc81bb
I20260808 14:55:42.274672 20411 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:55:42.278967 20291 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 38e79806866342c5ad3472b8dcd1fae4: Bootstrap starting.
I20260808 14:55:42.285097 20291 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 38e79806866342c5ad3472b8dcd1fae4: Neither blocks nor log segments found. Creating new log.
I20260808 14:55:42.287488 20291 log.cc:824] T 00000000000000000000000000000000 P 38e79806866342c5ad3472b8dcd1fae4: Log is configured to *not* fsync() on all Append() calls
I20260808 14:55:42.304600 20374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:42.169085 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36634 (local address 127.26.206.252:39275)
0808 14:55:42.169292 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0808 14:55:42.169298 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:55:42.199966 (+ 30668us) server_negotiation.cc:407] Connection header received
0808 14:55:42.202895 (+ 2929us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:55:42.202903 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:55:42.203025 (+ 122us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:55:42.203104 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:55:42.228482 (+ 25378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:42.229905 (+ 1423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:42.244129 (+ 14224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:42.244949 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:42.245065 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:55:42.285904 (+ 40839us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:55:42.285914 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:55:42.285922 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:55:42.285992 (+ 70us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:55:42.290451 (+ 4459us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:55:42.294560 (+ 4109us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:55:42.294567 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:55:42.294574 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:55:42.294753 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:55:42.297832 (+ 3079us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:55:42.297840 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:55:42.297846 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:55:42.298305 (+ 459us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:55:42.298637 (+ 332us) server_negotiation.cc:1035] Waiting for connection context
0808 14:55:42.303793 (+ 5156us) server_negotiation.cc:299] Negotiation successful
0808 14:55:42.304128 (+ 335us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260808 14:55:42.307945 20419 mvcc.cc:205] Tried to move back new op lower bound from 7316279059255640064 to 7316279059020517376. Current Snapshot: MvccSnapshot[applied={T|T < 7316279059255640064 or (T in {7316279059255640064})}]
I20260808 14:55:42.310587 20291 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 38e79806866342c5ad3472b8dcd1fae4: No bootstrap required, opened a new log
I20260808 14:55:42.318296 20376 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:42.168568 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48700 (local address 127.26.206.254:43319)
0808 14:55:42.168783 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0808 14:55:42.168789 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:55:42.232546 (+ 63757us) server_negotiation.cc:407] Connection header received
0808 14:55:42.236377 (+ 3831us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:55:42.236384 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:55:42.236489 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:55:42.236577 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:55:42.267449 (+ 30872us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:42.268593 (+ 1144us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:42.292242 (+ 23649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:42.293169 (+ 927us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:42.293314 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:55:42.308352 (+ 15038us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:55:42.308359 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:55:42.308363 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:55:42.308404 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:55:42.311961 (+ 3557us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:55:42.312824 (+ 863us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:55:42.312830 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:55:42.312833 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:55:42.313092 (+ 259us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:55:42.313866 (+ 774us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:55:42.313940 (+ 74us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:55:42.313971 (+ 31us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:55:42.314708 (+ 737us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:55:42.316268 (+ 1560us) server_negotiation.cc:1035] Waiting for connection context
0808 14:55:42.316695 (+ 427us) server_negotiation.cc:299] Negotiation successful
0808 14:55:42.317581 (+ 886us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260808 14:55:42.321731 20291 raft_consensus.cc:348] T 00000000000000000000000000000000 P 38e79806866342c5ad3472b8dcd1fae4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6c06c3978484e78a08a649f1b417044" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 43319 } } peers { permanent_uuid: "38e79806866342c5ad3472b8dcd1fae4" member_type: VOTER last_known_addr { host: "127.26.206.253" port: 40325 } } peers { permanent_uuid: "8be583a459fe43f69865391ed2efd796" member_type: VOTER last_known_addr { host: "127.26.206.252" port: 39275 } }
I20260808 14:55:42.322127 20291 raft_consensus.cc:729] T 00000000000000000000000000000000 P 38e79806866342c5ad3472b8dcd1fae4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 38e79806866342c5ad3472b8dcd1fae4, State: Initialized, Role: FOLLOWER
I20260808 14:55:42.322626 20291 consensus_queue.cc:260] T 00000000000000000000000000000000 P 38e79806866342c5ad3472b8dcd1fae4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6c06c3978484e78a08a649f1b417044" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 43319 } } peers { permanent_uuid: "38e79806866342c5ad3472b8dcd1fae4" member_type: VOTER last_known_addr { host: "127.26.206.253" port: 40325 } } peers { permanent_uuid: "8be583a459fe43f69865391ed2efd796" member_type: VOTER last_known_addr { host: "127.26.206.252" port: 39275 } }
I20260808 14:55:42.323941 20426 sys_catalog.cc:455] T 00000000000000000000000000000000 P 38e79806866342c5ad3472b8dcd1fae4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6c06c3978484e78a08a649f1b417044" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 43319 } } peers { permanent_uuid: "38e79806866342c5ad3472b8dcd1fae4" member_type: VOTER last_known_addr { host: "127.26.206.253" port: 40325 } } peers { permanent_uuid: "8be583a459fe43f69865391ed2efd796" member_type: VOTER last_known_addr { host: "127.26.206.252" port: 39275 } } }
I20260808 14:55:42.326668 20426 sys_catalog.cc:458] T 00000000000000000000000000000000 P 38e79806866342c5ad3472b8dcd1fae4 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 14:55:42.337524 20291 sys_catalog.cc:564] T 00000000000000000000000000000000 P 38e79806866342c5ad3472b8dcd1fae4 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:55:42.338285 20264 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 38e79806866342c5ad3472b8dcd1fae4 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:55:42.342002 20264 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 38e79806866342c5ad3472b8dcd1fae4 [term 1 FOLLOWER]: Refusing update from remote peer b6c06c3978484e78a08a649f1b417044: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:55:42.342949 20402 consensus_queue.cc:1035] T 00000000000000000000000000000000 P b6c06c3978484e78a08a649f1b417044 [LEADER]: Connected to new peer: Peer: permanent_uuid: "38e79806866342c5ad3472b8dcd1fae4" member_type: VOTER last_known_addr { host: "127.26.206.253" port: 40325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:55:42.342990 20265 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b6c06c3978484e78a08a649f1b417044" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "38e79806866342c5ad3472b8dcd1fae4"
I20260808 14:55:42.346055 20265 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 38e79806866342c5ad3472b8dcd1fae4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6c06c3978484e78a08a649f1b417044 in term 1.
I20260808 14:55:42.349788 20411 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:55:42.352443 20411 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:55:42.362571 20411 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b6c06c3978484e78a08a649f1b417044: Generated new TSK 0
I20260808 14:55:42.363962 20411 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:55:42.366920 20393 sys_catalog.cc:455] T 00000000000000000000000000000000 P b6c06c3978484e78a08a649f1b417044 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b6c06c3978484e78a08a649f1b417044" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6c06c3978484e78a08a649f1b417044" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 43319 } } peers { permanent_uuid: "38e79806866342c5ad3472b8dcd1fae4" member_type: VOTER last_known_addr { host: "127.26.206.253" port: 40325 } } peers { permanent_uuid: "8be583a459fe43f69865391ed2efd796" member_type: VOTER last_known_addr { host: "127.26.206.252" port: 39275 } } }
I20260808 14:55:42.369279 20393 sys_catalog.cc:458] T 00000000000000000000000000000000 P b6c06c3978484e78a08a649f1b417044 [sys.catalog]: This master's current role is: LEADER
I20260808 14:55:42.367545 20426 sys_catalog.cc:455] T 00000000000000000000000000000000 P 38e79806866342c5ad3472b8dcd1fae4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b6c06c3978484e78a08a649f1b417044. Latest consensus state: current_term: 1 leader_uuid: "b6c06c3978484e78a08a649f1b417044" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6c06c3978484e78a08a649f1b417044" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 43319 } } peers { permanent_uuid: "38e79806866342c5ad3472b8dcd1fae4" member_type: VOTER last_known_addr { host: "127.26.206.253" port: 40325 } } peers { permanent_uuid: "8be583a459fe43f69865391ed2efd796" member_type: VOTER last_known_addr { host: "127.26.206.252" port: 39275 } } }
I20260808 14:55:42.372965 20426 sys_catalog.cc:458] T 00000000000000000000000000000000 P 38e79806866342c5ad3472b8dcd1fae4 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 14:55:42.383741 20434 sys_catalog.cc:455] T 00000000000000000000000000000000 P 38e79806866342c5ad3472b8dcd1fae4 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b6c06c3978484e78a08a649f1b417044" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6c06c3978484e78a08a649f1b417044" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 43319 } } peers { permanent_uuid: "38e79806866342c5ad3472b8dcd1fae4" member_type: VOTER last_known_addr { host: "127.26.206.253" port: 40325 } } peers { permanent_uuid: "8be583a459fe43f69865391ed2efd796" member_type: VOTER last_known_addr { host: "127.26.206.252" port: 39275 } } }
I20260808 14:55:42.384155 20434 sys_catalog.cc:458] T 00000000000000000000000000000000 P 38e79806866342c5ad3472b8dcd1fae4 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 14:55:42.419302 20443 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
W20260808 14:55:42.499634 20374 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:55:42.496871 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36652 (local address 127.26.206.252:39275)
0808 14:55:42.497091 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0808 14:55:42.497100 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:55:42.497572 (+ 472us) server_negotiation.cc:407] Connection header received
0808 14:55:42.497908 (+ 336us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:55:42.497915 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:55:42.498007 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:55:42.498085 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:55:42.499304 (+ 1219us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36652: BlockingRecv error: recv got EOF from 127.0.0.1:36652 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
W20260808 14:55:42.502113 20376 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:55:42.497630 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48714 (local address 127.26.206.254:43319)
0808 14:55:42.497873 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0808 14:55:42.497880 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:55:42.500457 (+ 2577us) server_negotiation.cc:407] Connection header received
0808 14:55:42.500712 (+ 255us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:55:42.500719 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:55:42.500812 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:55:42.500896 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:55:42.501882 (+ 986us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48714: BlockingRecv error: recv got EOF from 127.0.0.1:48714 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
W20260808 14:55:42.505331 20295 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:55:42.503450 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41034 (local address 127.26.206.253:40325)
0808 14:55:42.503707 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0808 14:55:42.503713 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:55:42.503831 (+ 118us) server_negotiation.cc:407] Connection header received
0808 14:55:42.503988 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:55:42.503993 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:55:42.504091 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:55:42.504216 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:55:42.505126 (+ 910us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41034: BlockingRecv error: recv got EOF from 127.0.0.1:41034 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
W20260808 14:55:42.511698 20295 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:55:42.509617 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41046 (local address 127.26.206.253:40325)
0808 14:55:42.509767 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0808 14:55:42.509772 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:55:42.510237 (+ 465us) server_negotiation.cc:407] Connection header received
0808 14:55:42.510452 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:55:42.510458 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:55:42.510596 (+ 138us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:55:42.510699 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:55:42.511393 (+ 694us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41046: BlockingRecv error: recv got EOF from 127.0.0.1:41046 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
W20260808 14:55:42.517812 20295 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:55:42.515898 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41054 (local address 127.26.206.253:40325)
0808 14:55:42.516043 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0808 14:55:42.516049 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:55:42.516572 (+ 523us) server_negotiation.cc:407] Connection header received
0808 14:55:42.516727 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:55:42.516732 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:55:42.516816 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:55:42.516914 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:55:42.517613 (+ 699us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41054: BlockingRecv error: recv got EOF from 127.0.0.1:41054 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
W20260808 14:55:42.531527 20295 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:55:42.529367 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41064 (local address 127.26.206.253:40325)
0808 14:55:42.529534 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0808 14:55:42.529540 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:55:42.530038 (+ 498us) server_negotiation.cc:407] Connection header received
0808 14:55:42.530206 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:55:42.530212 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:55:42.530354 (+ 142us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:55:42.530466 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:55:42.531269 (+ 803us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41064: BlockingRecv error: recv got EOF from 127.0.0.1:41064 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
W20260808 14:55:42.540405 20295 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:55:42.538421 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41078 (local address 127.26.206.253:40325)
0808 14:55:42.538571 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0808 14:55:42.538577 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:55:42.539092 (+ 515us) server_negotiation.cc:407] Connection header received
0808 14:55:42.539255 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:55:42.539261 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:55:42.539337 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:55:42.539433 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:55:42.540221 (+ 788us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41078: BlockingRecv error: recv got EOF from 127.0.0.1:41078 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
W20260808 14:55:42.553848 20295 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:55:42.551635 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41092 (local address 127.26.206.253:40325)
0808 14:55:42.551813 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0808 14:55:42.551819 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:55:42.552345 (+ 526us) server_negotiation.cc:407] Connection header received
0808 14:55:42.552555 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:55:42.552562 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:55:42.552650 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:55:42.552774 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:55:42.553592 (+ 818us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41092: BlockingRecv error: recv got EOF from 127.0.0.1:41092 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
W20260808 14:55:42.580309 20295 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:55:42.577827 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41106 (local address 127.26.206.253:40325)
0808 14:55:42.578027 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0808 14:55:42.578033 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:55:42.578627 (+ 594us) server_negotiation.cc:407] Connection header received
0808 14:55:42.578857 (+ 230us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:55:42.578864 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:55:42.578963 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:55:42.579081 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:55:42.580061 (+ 980us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41106: BlockingRecv error: recv got EOF from 127.0.0.1:41106 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
W20260808 14:55:42.619825 20295 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:55:42.617143 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41114 (local address 127.26.206.253:40325)
0808 14:55:42.617338 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0808 14:55:42.617344 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:55:42.617902 (+ 558us) server_negotiation.cc:407] Connection header received
0808 14:55:42.618318 (+ 416us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:55:42.618325 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:55:42.618488 (+ 163us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:55:42.618614 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:55:42.619530 (+ 916us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41114: BlockingRecv error: recv got EOF from 127.0.0.1:41114 (error 108)
Metrics: {"server-negotiator.queue_time_us":77}
W20260808 14:55:42.689872 20295 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:55:42.687718 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41124 (local address 127.26.206.253:40325)
0808 14:55:42.687938 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0808 14:55:42.687946 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:55:42.688351 (+ 405us) server_negotiation.cc:407] Connection header received
0808 14:55:42.688582 (+ 231us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:55:42.688586 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:55:42.688702 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:55:42.688855 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:55:42.689646 (+ 791us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41124: BlockingRecv error: recv got EOF from 127.0.0.1:41124 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
W20260808 14:55:42.824543 20295 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:55:42.822693 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41128 (local address 127.26.206.253:40325)
0808 14:55:42.822861 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0808 14:55:42.822866 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:55:42.823323 (+ 457us) server_negotiation.cc:407] Connection header received
0808 14:55:42.823472 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:55:42.823476 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:55:42.823549 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:55:42.823702 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:55:42.824347 (+ 645us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41128: BlockingRecv error: recv got EOF from 127.0.0.1:41128 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
W20260808 14:55:43.087299 20295 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:55:43.085598 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41134 (local address 127.26.206.253:40325)
0808 14:55:43.085771 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0808 14:55:43.085777 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:55:43.086039 (+ 262us) server_negotiation.cc:407] Connection header received
0808 14:55:43.086200 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:55:43.086203 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:55:43.086276 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:55:43.086378 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:55:43.087112 (+ 734us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41134: BlockingRecv error: recv got EOF from 127.0.0.1:41134 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
I20260808 14:55:43.100584 20390 catalog_manager.cc:1259] Loaded cluster ID: 6403cd9eeaff4bb4a96b00fd5dcc81bb
I20260808 14:55:43.100677 20390 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 8be583a459fe43f69865391ed2efd796: loading cluster ID for follower catalog manager: success
I20260808 14:55:43.103046 20390 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 8be583a459fe43f69865391ed2efd796: acquiring CA information for follower catalog manager: success
I20260808 14:55:43.104882 20390 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 8be583a459fe43f69865391ed2efd796: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 14:55:43.424149 20443 catalog_manager.cc:1259] Loaded cluster ID: 6403cd9eeaff4bb4a96b00fd5dcc81bb
I20260808 14:55:43.424266 20443 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 38e79806866342c5ad3472b8dcd1fae4: loading cluster ID for follower catalog manager: success
I20260808 14:55:43.426777 20443 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 38e79806866342c5ad3472b8dcd1fae4: acquiring CA information for follower catalog manager: success
I20260808 14:55:43.428611 20443 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 38e79806866342c5ad3472b8dcd1fae4: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 14:55:43.621933 20514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:43.614729 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41138 (local address 127.26.206.253:40325)
0808 14:55:43.615615 (+ 886us) server_negotiation.cc:206] Beginning negotiation
0808 14:55:43.615627 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 14:55:43.615646 (+ 19us) server_negotiation.cc:407] Connection header received
0808 14:55:43.615714 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:55:43.615717 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:55:43.615850 (+ 133us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:55:43.615961 (+ 111us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:55:43.616477 (+ 516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:43.617353 (+ 876us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:43.619448 (+ 2095us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:43.619983 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:43.620080 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:55:43.620681 (+ 601us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:55:43.621195 (+ 514us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:55:43.621299 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0808 14:55:43.621469 (+ 170us) server_negotiation.cc:299] Negotiation successful
0808 14:55:43.621532 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":724,"thread_start_us":559,"threads_started":1}
I20260808 14:55:43.652029 20520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:43.628986 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36660 (local address 127.26.206.252:39275)
0808 14:55:43.644657 (+ 15671us) server_negotiation.cc:206] Beginning negotiation
0808 14:55:43.644662 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:55:43.644683 (+ 21us) server_negotiation.cc:407] Connection header received
0808 14:55:43.644789 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:55:43.644793 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:55:43.644947 (+ 154us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:55:43.645169 (+ 222us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:55:43.645799 (+ 630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:43.647131 (+ 1332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:43.649344 (+ 2213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:43.649782 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:43.649922 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:55:43.650499 (+ 577us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:55:43.651246 (+ 747us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:55:43.651402 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0808 14:55:43.651581 (+ 179us) server_negotiation.cc:299] Negotiation successful
0808 14:55:43.651681 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15542,"thread_start_us":16308,"threads_started":1}
I20260808 14:55:43.678061 20520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:43.669657 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36668 (local address 127.26.206.252:39275)
0808 14:55:43.669890 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0808 14:55:43.669898 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:55:43.671148 (+ 1250us) server_negotiation.cc:407] Connection header received
0808 14:55:43.671430 (+ 282us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:55:43.671435 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:55:43.671532 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:55:43.671634 (+ 102us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:55:43.672469 (+ 835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:43.673549 (+ 1080us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:43.675786 (+ 2237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:43.676424 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:43.676537 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:55:43.677221 (+ 684us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:55:43.677357 (+ 136us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:55:43.677431 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 14:55:43.677677 (+ 246us) server_negotiation.cc:299] Negotiation successful
0808 14:55:43.677775 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260808 14:55:43.681501 20526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:43.668857 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48718 (local address 127.26.206.254:43319)
0808 14:55:43.669441 (+ 584us) server_negotiation.cc:206] Beginning negotiation
0808 14:55:43.669451 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 14:55:43.670581 (+ 1130us) server_negotiation.cc:407] Connection header received
0808 14:55:43.670962 (+ 381us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:55:43.670972 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:55:43.671262 (+ 290us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:55:43.671435 (+ 173us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:55:43.672849 (+ 1414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:43.674355 (+ 1506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:43.676917 (+ 2562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:43.677677 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:43.677811 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:55:43.678799 (+ 988us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:55:43.679300 (+ 501us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:55:43.679390 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0808 14:55:43.681028 (+ 1638us) server_negotiation.cc:299] Negotiation successful
0808 14:55:43.681129 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":410,"thread_start_us":267,"threads_started":1}
I20260808 14:55:43.686684 20514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:43.670866 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41146 (local address 127.26.206.253:40325)
0808 14:55:43.671842 (+ 976us) server_negotiation.cc:206] Beginning negotiation
0808 14:55:43.671851 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:55:43.679123 (+ 7272us) server_negotiation.cc:407] Connection header received
0808 14:55:43.679417 (+ 294us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:55:43.679424 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:55:43.679513 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:55:43.679637 (+ 124us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:55:43.680321 (+ 684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:43.681471 (+ 1150us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:43.684185 (+ 2714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:43.684823 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:43.684940 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:55:43.685849 (+ 909us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:55:43.685977 (+ 128us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:55:43.686044 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0808 14:55:43.686289 (+ 245us) server_negotiation.cc:299] Negotiation successful
0808 14:55:43.686367 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":773}
I20260808 14:55:43.687469 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 20137
I20260808 14:55:43.689057 20206 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:55:43.828369 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 20137
I20260808 14:55:43.853407 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 20218
I20260808 14:55:43.854592 20286 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:55:43.960883 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 20218
I20260808 14:55:43.983835 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 20298
I20260808 14:55:43.984983 20365 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:55:44.092080 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 20298
2026-08-08T14:55:44Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (5073 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200577490656-27451-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:55:44 dist-test-slave-6k22 krb5kdc[20535](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:55:44 dist-test-slave-6k22 krb5kdc[20535](info): set up 2 sockets
Aug 08 14:55:44 dist-test-slave-6k22 krb5kdc[20535](info): commencing operation
krb5kdc: starting...
W20260808 14:55:45.273223 27451 mini_kdc.cc:121] Time spent starting KDC: real 1.137s user 0.000s sys 0.044s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200577490656-27451-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200577490656-27451-0/krb5kdc/test-user.keytab.
Aug 08 14:55:45 dist-test-slave-6k22 krb5kdc[20535](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200945, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:55:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:55:45Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.206.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.206.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.206.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.254.keytab.
Entry for principal kudu/127.26.206.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.254.keytab.
I20260808 14:55:45.587142 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200577490656-27451-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200577490656-27451-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200577490656-27451-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.206.254:45503
--webserver_interface=127.26.206.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.254.keytab
--principal=kudu/127.26.206.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.206.212:46673
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.206.254:45503,127.26.206.253:46435,127.26.206.252:36975
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:55:45.922451 20549 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 14:55:45.922811 20549 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:55:45.922935 20549 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:55:45.923065 20549 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:55:45.929924 20549 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:55:45.930044 20549 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:55:45.930181 20549 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:55:45.930260 20549 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:55:45.930401 20549 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:55:45.940052 20549 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:46673
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200577490656-27451-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200577490656-27451-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.206.254:45503,127.26.206.253:46435,127.26.206.252:36975
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.254.keytab
--principal=kudu/127.26.206.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.206.254:45503
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.206.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200577490656-27451-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:55:45.941303 20549 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:55:45.942615 20549 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:55:45.954236 20554 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:55:45.954265 20557 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:55:45.954516 20555 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:55:45.955229 20549 server_base.cc:1034] running on GCE node
I20260808 14:55:45.956020 20549 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:55:45.957288 20549 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:55:45.958583 20549 hybrid_clock.cc:648] HybridClock initialized: now 1786200945958491 us; error 36 us; skew 500 ppm
I20260808 14:55:45.958913 20549 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:55:45 dist-test-slave-6k22 krb5kdc[20535](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200945, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:55:45.961889 20549 init.cc:377] Logged in from keytab as kudu/127.26.206.254@KRBTEST.COM (short username kudu)
I20260808 14:55:45.963313 20549 webserver.cc:460] Webserver started at http://127.26.206.254:43521/ using document root <none> and password file <none>
I20260808 14:55:45.964075 20549 fs_manager.cc:359] Metadata directory not provided
I20260808 14:55:45.964210 20549 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:55:45.964537 20549 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:55:45.967463 20549 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200577490656-27451-0/minicluster-data/master-0/data/instance:
uuid: "c3ee99a4f5204366b13d405cb0a126b1"
format_stamp: "Formatted at 2026-08-08 14:55:45 on dist-test-slave-6k22"
server_key: "67e85dbbd413444bc7b00aef280e8eba"
server_key_iv: "a69a033654e0ce9d523ebafd866b06b9"
server_key_version: "encryptionkey@0"
I20260808 14:55:45.968341 20549 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200577490656-27451-0/minicluster-data/master-0/wal/instance:
uuid: "c3ee99a4f5204366b13d405cb0a126b1"
format_stamp: "Formatted at 2026-08-08 14:55:45 on dist-test-slave-6k22"
server_key: "67e85dbbd413444bc7b00aef280e8eba"
server_key_iv: "a69a033654e0ce9d523ebafd866b06b9"
server_key_version: "encryptionkey@0"
I20260808 14:55:45.973326 20549 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260808 14:55:45.976821 20565 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:55:45.978101 20549 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260808 14:55:45.978312 20549 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200577490656-27451-0/minicluster-data/master-0/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200577490656-27451-0/minicluster-data/master-0/wal
uuid: "c3ee99a4f5204366b13d405cb0a126b1"
format_stamp: "Formatted at 2026-08-08 14:55:45 on dist-test-slave-6k22"
server_key: "67e85dbbd413444bc7b00aef280e8eba"
server_key_iv: "a69a033654e0ce9d523ebafd866b06b9"
server_key_version: "encryptionkey@0"
I20260808 14:55:45.978544 20549 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200577490656-27451-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200577490656-27451-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200577490656-27451-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:55:46.000536 20549 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:55:46.004302 20549 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:55:46.004565 20549 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:55:46.022890 20549 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.254:45503
I20260808 14:55:46.022928 20621 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.254:45503 every 8 connection(s)
I20260808 14:55:46.024243 20549 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200577490656-27451-0/minicluster-data/master-0/data/info.pb
I20260808 14:55:46.027688 20622 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:55:46.028578 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 20549
I20260808 14:55:46.028785 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200577490656-27451-0/minicluster-data/master-0/wal/instance
I20260808 14:55:46.029265 27451 external_mini_cluster.cc:1428] Setting key 4dc27791fe396e61ed9a20c50224a490
I20260808 14:55:46.034080 20622 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.206.254" port: 45503 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 14:55:46 dist-test-slave-6k22 krb5kdc[20535](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200945, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.254@KRBTEST.COM for kudu/127.26.206.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.26.206.253@KRBTEST.COM; defaulting to no policy
I20260808 14:55:46.065546 20625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:46.037309 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52722 (local address 127.26.206.254:45503)
0808 14:55:46.046175 (+ 8866us) server_negotiation.cc:206] Beginning negotiation
0808 14:55:46.046186 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 14:55:46.046341 (+ 155us) server_negotiation.cc:407] Connection header received
0808 14:55:46.048364 (+ 2023us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:55:46.048370 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:55:46.048594 (+ 224us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:55:46.048811 (+ 217us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:55:46.050077 (+ 1266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:46.051263 (+ 1186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:46.052696 (+ 1433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:46.053231 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:46.053424 (+ 193us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:55:46.057104 (+ 3680us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:55:46.057117 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:55:46.057133 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:55:46.057184 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:55:46.061345 (+ 4161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:55:46.062108 (+ 763us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:55:46.062119 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:55:46.062125 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:55:46.062358 (+ 233us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:55:46.062750 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:55:46.062758 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:55:46.062762 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:55:46.063462 (+ 700us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:55:46.063711 (+ 249us) server_negotiation.cc:1035] Waiting for connection context
0808 14:55:46.064307 (+ 596us) server_negotiation.cc:299] Negotiation successful
0808 14:55:46.064587 (+ 280us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":8677,"spinlock_wait_cycles":19712,"thread_start_us":8325,"threads_started":1}
I20260808 14:55:46.065594 20624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:46.037310 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:45503 (local address 127.0.0.1:52722)
0808 14:55:46.046160 (+ 8850us) negotiation.cc:107] Waiting for socket to connect
0808 14:55:46.046215 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0808 14:55:46.047995 (+ 1780us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:55:46.048825 (+ 830us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:55:46.048831 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:55:46.049548 (+ 717us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:55:46.049869 (+ 321us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:55:46.049885 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:55:46.051414 (+ 1529us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:55:46.051421 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:55:46.052522 (+ 1101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:55:46.052534 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:55:46.053458 (+ 924us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:55:46.053465 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:55:46.053655 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:55:46.054336 (+ 681us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:55:46.054356 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:55:46.056858 (+ 2502us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:55:46.061511 (+ 4653us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:55:46.061521 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:55:46.061528 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:55:46.061949 (+ 421us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:55:46.062475 (+ 526us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:55:46.062478 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:55:46.062480 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:55:46.062623 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:55:46.063675 (+ 1052us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:55:46.063681 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:55:46.063871 (+ 190us) client_negotiation.cc:769] Sending connection context
0808 14:55:46.064096 (+ 225us) client_negotiation.cc:240] Negotiation successful
0808 14:55:46.064436 (+ 340us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8580,"thread_start_us":8246,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.206.253@KRBTEST.COM" created.
I20260808 14:55:46.068575 20622 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.206.253" port: 46435 } has no permanent_uuid. Determining permanent_uuid...
I20260808 14:55:46.069648 20624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:46.069272 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.253:46435 (local address 127.0.0.1:55502)
0808 14:55:46.069443 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0808 14:55:46.069546 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.253:46435: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260808 14:55:46.069867 20567 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.206.253:46435: connect: Connection refused (error 111)
I20260808 14:55:46.071403 20624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:46.071066 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.253:46435 (local address 127.0.0.1:55514)
0808 14:55:46.071204 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0808 14:55:46.071291 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.253:46435: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260808 14:55:46.071637 20622 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.206.253:46435: Network error: Client connection negotiation failed: client connection to 127.26.206.253:46435: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.206.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.253.keytab.
Entry for principal kudu/127.26.206.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.253.keytab.
I20260808 14:55:46.103063 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200577490656-27451-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200577490656-27451-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200577490656-27451-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200577490656-27451-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.206.253:46435
--webserver_interface=127.26.206.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.253.keytab
--principal=kudu/127.26.206.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.206.212:46673
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.206.254:45503,127.26.206.253:46435,127.26.206.252:36975
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 14:55:46.120934 20622 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.206.253" port: 46435 } attempt: 1
I20260808 14:55:46.122118 20624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:46.121636 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.253:46435 (local address 127.0.0.1:55530)
0808 14:55:46.121842 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0808 14:55:46.121963 (+ 121us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.253:46435: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
I20260808 14:55:46.123142 20624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:46.122805 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.253:46435 (local address 127.0.0.1:55532)
0808 14:55:46.122953 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0808 14:55:46.123022 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.253:46435: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260808 14:55:46.123345 20622 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.206.253:46435: Network error: Client connection negotiation failed: client connection to 127.26.206.253:46435: connect: Connection refused (error 111)
I20260808 14:55:46.191689 20622 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.206.253" port: 46435 } attempt: 2
I20260808 14:55:46.192840 20624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:46.192339 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.253:46435 (local address 127.0.0.1:55540)
0808 14:55:46.192592 (+ 253us) negotiation.cc:107] Waiting for socket to connect
0808 14:55:46.192688 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.253:46435: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
I20260808 14:55:46.193856 20624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:46.193508 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.253:46435 (local address 127.0.0.1:55552)
0808 14:55:46.193649 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0808 14:55:46.193735 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.253:46435: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260808 14:55:46.194047 20622 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.206.253:46435: Network error: Client connection negotiation failed: client connection to 127.26.206.253:46435: connect: Connection refused (error 111)
I20260808 14:55:46.285313 20622 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.206.253" port: 46435 } attempt: 3
I20260808 14:55:46.286517 20624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:46.286087 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.253:46435 (local address 127.0.0.1:55556)
0808 14:55:46.286282 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0808 14:55:46.286380 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.253:46435: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
I20260808 14:55:46.287513 20624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:46.287164 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.253:46435 (local address 127.0.0.1:55566)
0808 14:55:46.287312 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0808 14:55:46.287390 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.253:46435: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260808 14:55:46.287753 20622 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.206.253:46435: Network error: Client connection negotiation failed: client connection to 127.26.206.253:46435: connect: Connection refused (error 111)
I20260808 14:55:46.431056 20622 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.206.253" port: 46435 } attempt: 4
I20260808 14:55:46.432382 20624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:46.431796 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.253:46435 (local address 127.0.0.1:55580)
0808 14:55:46.432165 (+ 369us) negotiation.cc:107] Waiting for socket to connect
0808 14:55:46.432251 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.253:46435: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":212}
I20260808 14:55:46.433403 20624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:46.433060 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.253:46435 (local address 127.0.0.1:55594)
0808 14:55:46.433219 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0808 14:55:46.433285 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.253:46435: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260808 14:55:46.433594 20622 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.206.253:46435: Network error: Client connection negotiation failed: client connection to 127.26.206.253:46435: connect: Connection refused (error 111)
W20260808 14:55:46.442215 20629 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 14:55:46.442552 20629 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:55:46.442674 20629 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:55:46.442816 20629 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:55:46.450033 20629 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:55:46.450161 20629 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:55:46.450263 20629 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:55:46.450357 20629 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:55:46.450444 20629 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:55:46.459748 20629 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:46673
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200577490656-27451-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200577490656-27451-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.26.206.254:45503,127.26.206.253:46435,127.26.206.252:36975
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.253.keytab
--principal=kudu/127.26.206.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.206.253:46435
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200577490656-27451-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.26.206.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200577490656-27451-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:55:46.460963 20629 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:55:46.462224 20629 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:55:46.477064 20634 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:55:46.477082 20637 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:55:46.477002 20635 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:55:46.477720 20629 server_base.cc:1034] running on GCE node
I20260808 14:55:46.478626 20629 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:55:46.480042 20629 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:55:46.481293 20629 hybrid_clock.cc:648] HybridClock initialized: now 1786200946481237 us; error 46 us; skew 500 ppm
I20260808 14:55:46.481645 20629 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:55:46 dist-test-slave-6k22 krb5kdc[20535](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200946, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:55:46.484998 20629 init.cc:377] Logged in from keytab as kudu/127.26.206.253@KRBTEST.COM (short username kudu)
I20260808 14:55:46.486322 20629 webserver.cc:460] Webserver started at http://127.26.206.253:35005/ using document root <none> and password file <none>
I20260808 14:55:46.486971 20629 fs_manager.cc:359] Metadata directory not provided
I20260808 14:55:46.487056 20629 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:55:46.487315 20629 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:55:46.490255 20629 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200577490656-27451-0/minicluster-data/master-1/data/instance:
uuid: "e6e2e7131cef47b296707576b5a37325"
format_stamp: "Formatted at 2026-08-08 14:55:46 on dist-test-slave-6k22"
server_key: "cc235c26865a86623d6df14485b9f25c"
server_key_iv: "84e33b5f01ae3c0bc262e5f139302ee5"
server_key_version: "encryptionkey@0"
I20260808 14:55:46.490988 20629 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200577490656-27451-0/minicluster-data/master-1/wal/instance:
uuid: "e6e2e7131cef47b296707576b5a37325"
format_stamp: "Formatted at 2026-08-08 14:55:46 on dist-test-slave-6k22"
server_key: "cc235c26865a86623d6df14485b9f25c"
server_key_iv: "84e33b5f01ae3c0bc262e5f139302ee5"
server_key_version: "encryptionkey@0"
I20260808 14:55:46.495951 20629 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.008s sys 0.000s
I20260808 14:55:46.499228 20645 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:55:46.500560 20629 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 14:55:46.500747 20629 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200577490656-27451-0/minicluster-data/master-1/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200577490656-27451-0/minicluster-data/master-1/wal
uuid: "e6e2e7131cef47b296707576b5a37325"
format_stamp: "Formatted at 2026-08-08 14:55:46 on dist-test-slave-6k22"
server_key: "cc235c26865a86623d6df14485b9f25c"
server_key_iv: "84e33b5f01ae3c0bc262e5f139302ee5"
server_key_version: "encryptionkey@0"
I20260808 14:55:46.500969 20629 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200577490656-27451-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200577490656-27451-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200577490656-27451-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:55:46.514849 20629 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:55:46.518554 20629 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:55:46.518774 20629 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:55:46.536886 20629 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.253:46435
I20260808 14:55:46.536933 20702 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.253:46435 every 8 connection(s)
I20260808 14:55:46.538210 20629 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200577490656-27451-0/minicluster-data/master-1/data/info.pb
I20260808 14:55:46.541787 20704 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:55:46.545487 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 20629
I20260808 14:55:46.545694 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200577490656-27451-0/minicluster-data/master-1/wal/instance
I20260808 14:55:46.546130 27451 external_mini_cluster.cc:1428] Setting key e609760cac70ac481747db6eaf93d876
I20260808 14:55:46.548121 20704 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.206.254" port: 45503 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 14:55:46 dist-test-slave-6k22 krb5kdc[20535](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200946, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.253@KRBTEST.COM for kudu/127.26.206.254@KRBTEST.COM
I20260808 14:55:46.568907 20625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:46.550604 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52732 (local address 127.26.206.254:45503)
0808 14:55:46.550788 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0808 14:55:46.550792 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:55:46.552074 (+ 1282us) server_negotiation.cc:407] Connection header received
0808 14:55:46.553919 (+ 1845us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:55:46.553925 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:55:46.554032 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:55:46.554144 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:55:46.555541 (+ 1397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:46.556251 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:46.557688 (+ 1437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:46.558104 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:46.558238 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:55:46.561822 (+ 3584us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:55:46.561831 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:55:46.561838 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:55:46.561881 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:55:46.565582 (+ 3701us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:55:46.566342 (+ 760us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:55:46.566350 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:55:46.566356 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:55:46.566510 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:55:46.566883 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:55:46.566891 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:55:46.566897 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:55:46.567336 (+ 439us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:55:46.567487 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0808 14:55:46.568187 (+ 700us) server_negotiation.cc:299] Negotiation successful
0808 14:55:46.568454 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260808 14:55:46.569464 20706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:46.551145 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:45503 (local address 127.0.0.1:52732)
0808 14:55:46.551912 (+ 767us) negotiation.cc:107] Waiting for socket to connect
0808 14:55:46.551948 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0808 14:55:46.553639 (+ 1691us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:55:46.554379 (+ 740us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:55:46.554386 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:55:46.554877 (+ 491us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:55:46.555377 (+ 500us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:55:46.555392 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:55:46.556428 (+ 1036us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:55:46.556432 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:55:46.557543 (+ 1111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:55:46.557555 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:55:46.558323 (+ 768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:55:46.558331 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:55:46.558593 (+ 262us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:55:46.559270 (+ 677us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:55:46.559299 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:55:46.561606 (+ 2307us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:55:46.565797 (+ 4191us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:55:46.565802 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:55:46.565813 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:55:46.566210 (+ 397us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:55:46.566615 (+ 405us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:55:46.566618 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:55:46.566620 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:55:46.566774 (+ 154us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:55:46.567452 (+ 678us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:55:46.567457 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:55:46.567831 (+ 374us) client_negotiation.cc:769] Sending connection context
0808 14:55:46.568053 (+ 222us) client_negotiation.cc:240] Negotiation successful
0808 14:55:46.568396 (+ 343us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":546,"thread_start_us":355,"threads_started":1}
I20260808 14:55:46.571246 20704 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.206.253" port: 46435 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 14:55:46 dist-test-slave-6k22 krb5kdc[20535](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200946, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.253@KRBTEST.COM for kudu/127.26.206.253@KRBTEST.COM
WARNING: no policy specified for kudu/127.26.206.252@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.206.252@KRBTEST.COM" created.
I20260808 14:55:46.587167 20706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:46.572149 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.253:46435 (local address 127.0.0.1:55610)
0808 14:55:46.572350 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0808 14:55:46.572372 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 14:55:46.572479 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:55:46.573387 (+ 908us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:55:46.573394 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:55:46.573911 (+ 517us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:55:46.574144 (+ 233us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:55:46.574159 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:55:46.575631 (+ 1472us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:55:46.575639 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:55:46.577175 (+ 1536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:55:46.577193 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:55:46.578004 (+ 811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:55:46.578016 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:55:46.578247 (+ 231us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:55:46.578889 (+ 642us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:55:46.578916 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:55:46.581413 (+ 2497us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:55:46.584950 (+ 3537us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:55:46.584954 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:55:46.584956 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:55:46.585278 (+ 322us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:55:46.585679 (+ 401us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:55:46.585683 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:55:46.585685 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:55:46.585820 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:55:46.586519 (+ 699us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:55:46.586522 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:55:46.586628 (+ 106us) client_negotiation.cc:769] Sending connection context
0808 14:55:46.586730 (+ 102us) client_negotiation.cc:240] Negotiation successful
0808 14:55:46.586919 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":61}
I20260808 14:55:46.587657 20708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:46.572357 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55610 (local address 127.26.206.253:46435)
0808 14:55:46.572994 (+ 637us) server_negotiation.cc:206] Beginning negotiation
0808 14:55:46.572999 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:55:46.573023 (+ 24us) server_negotiation.cc:407] Connection header received
0808 14:55:46.573061 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:55:46.573066 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:55:46.573220 (+ 154us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:55:46.573330 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:55:46.574312 (+ 982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:46.575467 (+ 1155us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:46.577321 (+ 1854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:46.577843 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:46.577938 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:55:46.581631 (+ 3693us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:55:46.581641 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:55:46.581653 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:55:46.581686 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:55:46.584816 (+ 3130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:55:46.585408 (+ 592us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:55:46.585419 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:55:46.585425 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:55:46.585571 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:55:46.585923 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:55:46.585930 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:55:46.585936 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:55:46.586400 (+ 464us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:55:46.586607 (+ 207us) server_negotiation.cc:1035] Waiting for connection context
0808 14:55:46.586916 (+ 309us) server_negotiation.cc:299] Negotiation successful
0808 14:55:46.587188 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":498,"thread_start_us":364,"threads_started":1}
I20260808 14:55:46.590016 20704 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.206.252" port: 36975 } has no permanent_uuid. Determining permanent_uuid...
I20260808 14:55:46.591048 20706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:46.590653 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.252:36975 (local address 127.0.0.1:35452)
0808 14:55:46.590812 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0808 14:55:46.590908 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.252:36975: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260808 14:55:46.591284 20648 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.206.252:36975: connect: Connection refused (error 111)
I20260808 14:55:46.592846 20706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:46.592525 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.252:36975 (local address 127.0.0.1:35462)
0808 14:55:46.592660 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0808 14:55:46.592743 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.252:36975: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260808 14:55:46.593075 20704 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.206.252:36975: Network error: Client connection negotiation failed: client connection to 127.26.206.252:36975: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.206.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.252.keytab.
Entry for principal kudu/127.26.206.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.252.keytab.
I20260808 14:55:46.624550 27451 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskBCPck2/build/asan/bin/kudu
/tmp/dist-test-taskBCPck2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200577490656-27451-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200577490656-27451-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200577490656-27451-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200577490656-27451-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.206.252:36975
--webserver_interface=127.26.206.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.252.keytab
--principal=kudu/127.26.206.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.206.212:46673
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.206.254:45503,127.26.206.253:46435,127.26.206.252:36975
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200577490656-27451-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200577490656-27451-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200577490656-27451-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 14:55:46.642409 20704 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.206.252" port: 36975 } attempt: 1
I20260808 14:55:46.643687 20706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:46.643177 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.252:36975 (local address 127.0.0.1:35464)
0808 14:55:46.643370 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0808 14:55:46.643474 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.252:36975: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
I20260808 14:55:46.644727 20706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:46.644369 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.252:36975 (local address 127.0.0.1:35470)
0808 14:55:46.644544 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0808 14:55:46.644621 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.252:36975: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260808 14:55:46.644934 20704 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.206.252:36975: Network error: Client connection negotiation failed: client connection to 127.26.206.252:36975: connect: Connection refused (error 111)
I20260808 14:55:46.713222 20704 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.206.252" port: 36975 } attempt: 2
I20260808 14:55:46.714335 20706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:46.713884 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.252:36975 (local address 127.0.0.1:35484)
0808 14:55:46.714078 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0808 14:55:46.714176 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.252:36975: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
I20260808 14:55:46.715312 20706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:46.714989 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.252:36975 (local address 127.0.0.1:35488)
0808 14:55:46.715138 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0808 14:55:46.715199 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.252:36975: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260808 14:55:46.715518 20704 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.206.252:36975: Network error: Client connection negotiation failed: client connection to 127.26.206.252:36975: connect: Connection refused (error 111)
I20260808 14:55:46.732851 20622 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.206.253" port: 46435 } attempt: 5
Aug 08 14:55:46 dist-test-slave-6k22 krb5kdc[20535](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200945, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.254@KRBTEST.COM for kudu/127.26.206.253@KRBTEST.COM
I20260808 14:55:46.746797 20708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:46.733724 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55618 (local address 127.26.206.253:46435)
0808 14:55:46.733916 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0808 14:55:46.733923 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:55:46.733950 (+ 27us) server_negotiation.cc:407] Connection header received
0808 14:55:46.734175 (+ 225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:55:46.734187 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:55:46.734275 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:55:46.734392 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:55:46.735185 (+ 793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:46.735984 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:46.737222 (+ 1238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:46.737658 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:46.737797 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:55:46.741596 (+ 3799us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:55:46.741601 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:55:46.741604 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:55:46.741637 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:55:46.744231 (+ 2594us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:55:46.745093 (+ 862us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:55:46.745097 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:55:46.745099 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:55:46.745209 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:55:46.745601 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:55:46.745604 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:55:46.745606 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:55:46.745869 (+ 263us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:55:46.745973 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0808 14:55:46.746403 (+ 430us) server_negotiation.cc:299] Negotiation successful
0808 14:55:46.746583 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260808 14:55:46.747004 20624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:46.733628 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.253:46435 (local address 127.0.0.1:55618)
0808 14:55:46.733868 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0808 14:55:46.733891 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 14:55:46.734032 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:55:46.734432 (+ 400us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:55:46.734437 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:55:46.734857 (+ 420us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:55:46.735023 (+ 166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:55:46.735032 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:55:46.736124 (+ 1092us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:55:46.736132 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:55:46.737064 (+ 932us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:55:46.737076 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:55:46.737829 (+ 753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:55:46.737834 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:55:46.738029 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:55:46.738734 (+ 705us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:55:46.738751 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:55:46.741396 (+ 2645us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:55:46.744383 (+ 2987us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:55:46.744390 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:55:46.744395 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:55:46.744981 (+ 586us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:55:46.745318 (+ 337us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:55:46.745322 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:55:46.745325 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:55:46.745496 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:55:46.745984 (+ 488us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:55:46.745989 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:55:46.746157 (+ 168us) client_negotiation.cc:769] Sending connection context
0808 14:55:46.746328 (+ 171us) client_negotiation.cc:240] Negotiation successful
0808 14:55:46.746636 (+ 308us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":78}
I20260808 14:55:46.748041 20622 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.206.252" port: 36975 } has no permanent_uuid. Determining permanent_uuid...
I20260808 14:55:46.749075 20624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:46.748648 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.252:36975 (local address 127.0.0.1:35492)
0808 14:55:46.748824 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0808 14:55:46.748915 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.252:36975: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260808 14:55:46.750064 20624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:46.749701 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.252:36975 (local address 127.0.0.1:35502)
0808 14:55:46.749847 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0808 14:55:46.749943 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.252:36975: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260808 14:55:46.750290 20622 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.206.252:36975: Network error: Client connection negotiation failed: client connection to 127.26.206.252:36975: connect: Connection refused (error 111)
I20260808 14:55:46.801550 20622 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.206.252" port: 36975 } attempt: 1
I20260808 14:55:46.802950 20624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:46.802344 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.252:36975 (local address 127.0.0.1:35510)
0808 14:55:46.802599 (+ 255us) negotiation.cc:107] Waiting for socket to connect
0808 14:55:46.802738 (+ 139us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.252:36975: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":82}
I20260808 14:55:46.804112 20624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:46.803686 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.252:36975 (local address 127.0.0.1:35518)
0808 14:55:46.803842 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0808 14:55:46.803941 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.252:36975: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260808 14:55:46.804347 20622 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.206.252:36975: Network error: Client connection negotiation failed: client connection to 127.26.206.252:36975: connect: Connection refused (error 111)
I20260808 14:55:46.806797 20704 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.206.252" port: 36975 } attempt: 3
I20260808 14:55:46.807808 20706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:46.807337 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.252:36975 (local address 127.0.0.1:35530)
0808 14:55:46.807507 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0808 14:55:46.807658 (+ 151us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.252:36975: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
I20260808 14:55:46.808972 20706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:46.808547 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.252:36975 (local address 127.0.0.1:35536)
0808 14:55:46.808760 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0808 14:55:46.808843 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.252:36975: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117}
W20260808 14:55:46.809230 20704 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.206.252:36975: Network error: Client connection negotiation failed: client connection to 127.26.206.252:36975: connect: Connection refused (error 111)
I20260808 14:55:46.872627 20622 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.206.252" port: 36975 } attempt: 2
I20260808 14:55:46.874076 20624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:46.873414 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.252:36975 (local address 127.0.0.1:35548)
0808 14:55:46.873695 (+ 281us) negotiation.cc:107] Waiting for socket to connect
0808 14:55:46.873835 (+ 140us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.252:36975: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":93}
I20260808 14:55:46.875181 20624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:46.874874 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.252:36975 (local address 127.0.0.1:35558)
0808 14:55:46.875014 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0808 14:55:46.875083 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.252:36975: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260808 14:55:46.875546 20622 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.206.252:36975: Network error: Client connection negotiation failed: client connection to 127.26.206.252:36975: connect: Connection refused (error 111)
I20260808 14:55:46.952451 20704 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.206.252" port: 36975 } attempt: 4
I20260808 14:55:46.953568 20706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:46.953080 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.252:36975 (local address 127.0.0.1:35574)
0808 14:55:46.953326 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0808 14:55:46.953412 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.252:36975: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
I20260808 14:55:46.954596 20706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:46.954281 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.252:36975 (local address 127.0.0.1:35584)
0808 14:55:46.954424 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0808 14:55:46.954499 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.252:36975: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260808 14:55:46.954849 20704 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.206.252:36975: Network error: Client connection negotiation failed: client connection to 127.26.206.252:36975: connect: Connection refused (error 111)
W20260808 14:55:46.973510 20711 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 14:55:46.973882 20711 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:55:46.973991 20711 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:55:46.974123 20711 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:55:46.981431 20711 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:55:46.981513 20711 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:55:46.981660 20711 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:55:46.981756 20711 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:55:46.981858 20711 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:55:46.981848 20622 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.206.252" port: 36975 } attempt: 3
I20260808 14:55:46.983047 20624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:46.982483 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.252:36975 (local address 127.0.0.1:35600)
0808 14:55:46.982741 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0808 14:55:46.982839 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.252:36975: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
I20260808 14:55:46.984099 20624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:46.983711 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.252:36975 (local address 127.0.0.1:35604)
0808 14:55:46.983929 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0808 14:55:46.983990 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.206.252:36975: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101}
W20260808 14:55:46.984310 20622 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.206.252:36975: Network error: Client connection negotiation failed: client connection to 127.26.206.252:36975: connect: Connection refused (error 111)
I20260808 14:55:46.992224 20711 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.206.212:46673
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200577490656-27451-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200577490656-27451-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.26.206.254:45503,127.26.206.253:46435,127.26.206.252:36975
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200577490656-27451-0/krb5kdc/kudu_127.26.206.252.keytab
--principal=kudu/127.26.206.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.206.252:36975
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200577490656-27451-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.26.206.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200577490656-27451-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 13:58:48 UTC on ccycloud.quasar-qamcem.root.comops.site
build id 4574928
ASAN enabled
I20260808 14:55:46.993490 20711 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:55:46.994801 20711 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:55:47.006203 20719 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:55:47.006261 20717 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:55:47.006381 20716 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:55:47.007114 20711 server_base.cc:1034] running on GCE node
I20260808 14:55:47.007860 20711 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:55:47.009063 20711 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:55:47.010288 20711 hybrid_clock.cc:648] HybridClock initialized: now 1786200947010226 us; error 27 us; skew 500 ppm
I20260808 14:55:47.010623 20711 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 14:55:47 dist-test-slave-6k22 krb5kdc[20535](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200947, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:55:47.013788 20711 init.cc:377] Logged in from keytab as kudu/127.26.206.252@KRBTEST.COM (short username kudu)
I20260808 14:55:47.015146 20711 webserver.cc:460] Webserver started at http://127.26.206.252:39679/ using document root <none> and password file <none>
I20260808 14:55:47.015874 20711 fs_manager.cc:359] Metadata directory not provided
I20260808 14:55:47.016010 20711 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:55:47.016350 20711 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:55:47.019147 20711 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200577490656-27451-0/minicluster-data/master-2/data/instance:
uuid: "be3a9e59fd2e4908811c0bfcfa1b99ed"
format_stamp: "Formatted at 2026-08-08 14:55:47 on dist-test-slave-6k22"
server_key: "616a4fa2f301a279f66d04174dc8eb93"
server_key_iv: "a359c2ac3befc3085189c0c8ca6291ee"
server_key_version: "encryptionkey@0"
I20260808 14:55:47.019964 20711 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200577490656-27451-0/minicluster-data/master-2/wal/instance:
uuid: "be3a9e59fd2e4908811c0bfcfa1b99ed"
format_stamp: "Formatted at 2026-08-08 14:55:47 on dist-test-slave-6k22"
server_key: "616a4fa2f301a279f66d04174dc8eb93"
server_key_iv: "a359c2ac3befc3085189c0c8ca6291ee"
server_key_version: "encryptionkey@0"
I20260808 14:55:47.025197 20711 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.003s
I20260808 14:55:47.028810 20727 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:55:47.030133 20711 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260808 14:55:47.030313 20711 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200577490656-27451-0/minicluster-data/master-2/data,/tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200577490656-27451-0/minicluster-data/master-2/wal
uuid: "be3a9e59fd2e4908811c0bfcfa1b99ed"
format_stamp: "Formatted at 2026-08-08 14:55:47 on dist-test-slave-6k22"
server_key: "616a4fa2f301a279f66d04174dc8eb93"
server_key_iv: "a359c2ac3befc3085189c0c8ca6291ee"
server_key_version: "encryptionkey@0"
I20260808 14:55:47.030536 20711 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200577490656-27451-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200577490656-27451-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200577490656-27451-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:55:47.042162 20711 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:55:47.046427 20711 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:55:47.046722 20711 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:55:47.064569 20711 rpc_server.cc:307] RPC server started. Bound to: 127.26.206.252:36975
I20260808 14:55:47.064587 20784 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.206.252:36975 every 8 connection(s)
I20260808 14:55:47.065903 20711 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200577490656-27451-0/minicluster-data/master-2/data/info.pb
I20260808 14:55:47.069563 20785 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:55:47.076189 27451 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskBCPck2/build/asan/bin/kudu as pid 20711
I20260808 14:55:47.076380 27451 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskBCPck2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200577490656-27451-0/minicluster-data/master-2/wal/instance
I20260808 14:55:47.075500 20785 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.206.254" port: 45503 } has no permanent_uuid. Determining permanent_uuid...
I20260808 14:55:47.076922 27451 external_mini_cluster.cc:1428] Setting key 4b406588d92b8853dc472e3d67e2c1b9
Aug 08 14:55:47 dist-test-slave-6k22 krb5kdc[20535](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200947, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.252@KRBTEST.COM for kudu/127.26.206.254@KRBTEST.COM
Aug 08 14:55:47 dist-test-slave-6k22 krb5kdc[20535](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200945, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.206.252@KRBTEST.COM
I20260808 14:55:47.097481 20788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:47.078637 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52742 (local address 127.26.206.254:45503)
0808 14:55:47.079304 (+ 667us) server_negotiation.cc:206] Beginning negotiation
0808 14:55:47.079310 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:55:47.079906 (+ 596us) server_negotiation.cc:407] Connection header received
0808 14:55:47.081663 (+ 1757us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:55:47.081667 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:55:47.081728 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:55:47.081869 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:55:47.083293 (+ 1424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:47.084250 (+ 957us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:47.086031 (+ 1781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:47.086692 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:47.086804 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:55:47.090817 (+ 4013us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:55:47.090822 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:55:47.090825 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:55:47.090856 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:55:47.094324 (+ 3468us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:55:47.095115 (+ 791us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:55:47.095122 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:55:47.095126 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:55:47.095293 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:55:47.095734 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:55:47.095740 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:55:47.095744 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:55:47.096003 (+ 259us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:55:47.096193 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0808 14:55:47.096836 (+ 643us) server_negotiation.cc:299] Negotiation successful
0808 14:55:47.097055 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":499,"thread_start_us":356,"threads_started":1}
I20260808 14:55:47.098467 20791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:47.078689 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35608 (local address 127.26.206.252:36975)
0808 14:55:47.079693 (+ 1004us) server_negotiation.cc:206] Beginning negotiation
0808 14:55:47.079711 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0808 14:55:47.079754 (+ 43us) server_negotiation.cc:407] Connection header received
0808 14:55:47.081419 (+ 1665us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:55:47.081445 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:55:47.081725 (+ 280us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:55:47.081997 (+ 272us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:55:47.083712 (+ 1715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:47.085219 (+ 1507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:47.086704 (+ 1485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:47.087466 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:47.087608 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:55:47.092100 (+ 4492us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:55:47.092110 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:55:47.092125 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:55:47.092163 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:55:47.095400 (+ 3237us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:55:47.096060 (+ 660us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:55:47.096068 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:55:47.096071 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:55:47.096228 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:55:47.096608 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:55:47.096613 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:55:47.096616 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:55:47.096914 (+ 298us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:55:47.097233 (+ 319us) server_negotiation.cc:1035] Waiting for connection context
0808 14:55:47.097787 (+ 554us) server_negotiation.cc:299] Negotiation successful
0808 14:55:47.097998 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":815,"spinlock_wait_cycles":43392,"thread_start_us":1093,"threads_started":1}
I20260808 14:55:47.098508 20790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:47.078689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.254:45503 (local address 127.0.0.1:52742)
0808 14:55:47.079738 (+ 1049us) negotiation.cc:107] Waiting for socket to connect
0808 14:55:47.079790 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0808 14:55:47.081419 (+ 1629us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:55:47.081945 (+ 526us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:55:47.081952 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:55:47.082752 (+ 800us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:55:47.083092 (+ 340us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:55:47.083107 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:55:47.084422 (+ 1315us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:55:47.084427 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:55:47.085891 (+ 1464us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:55:47.085901 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:55:47.086915 (+ 1014us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:55:47.086921 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:55:47.087199 (+ 278us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:55:47.087997 (+ 798us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:55:47.088027 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:55:47.090609 (+ 2582us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:55:47.094460 (+ 3851us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:55:47.094469 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:55:47.094477 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:55:47.094993 (+ 516us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:55:47.095404 (+ 411us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:55:47.095407 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:55:47.095409 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:55:47.095621 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:55:47.096140 (+ 519us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:55:47.096165 (+ 25us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:55:47.096473 (+ 308us) client_negotiation.cc:769] Sending connection context
0808 14:55:47.096738 (+ 265us) client_negotiation.cc:240] Negotiation successful
0808 14:55:47.097220 (+ 482us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":733,"thread_start_us":474,"threads_started":1}
I20260808 14:55:47.100163 20785 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.206.253" port: 46435 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 14:55:47 dist-test-slave-6k22 krb5kdc[20535](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200947, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.252@KRBTEST.COM for kudu/127.26.206.253@KRBTEST.COM
Aug 08 14:55:47 dist-test-slave-6k22 krb5kdc[20535](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200945, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.206.254@KRBTEST.COM
I20260808 14:55:47.114030 20790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:47.100898 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.253:46435 (local address 127.0.0.1:55630)
0808 14:55:47.101058 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0808 14:55:47.101076 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 14:55:47.101171 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:55:47.101816 (+ 645us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:55:47.101819 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:55:47.102272 (+ 453us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:55:47.102483 (+ 211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:55:47.102509 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:55:47.103523 (+ 1014us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:55:47.103527 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:55:47.104664 (+ 1137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:55:47.104678 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:55:47.105449 (+ 771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:55:47.105458 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:55:47.105624 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:55:47.106244 (+ 620us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:55:47.106262 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:55:47.108726 (+ 2464us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:55:47.111826 (+ 3100us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:55:47.111832 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:55:47.111836 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:55:47.112187 (+ 351us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:55:47.112591 (+ 404us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:55:47.112596 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:55:47.112599 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:55:47.112738 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:55:47.113267 (+ 529us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:55:47.113272 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:55:47.113403 (+ 131us) client_negotiation.cc:769] Sending connection context
0808 14:55:47.113521 (+ 118us) client_negotiation.cc:240] Negotiation successful
0808 14:55:47.113697 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":53}
I20260808 14:55:47.114221 20708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:47.100904 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55630 (local address 127.26.206.253:46435)
0808 14:55:47.101067 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0808 14:55:47.101072 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:55:47.101161 (+ 89us) server_negotiation.cc:407] Connection header received
0808 14:55:47.101259 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:55:47.101264 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:55:47.101351 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:55:47.101461 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:55:47.102653 (+ 1192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:47.103388 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:47.104811 (+ 1423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:47.105252 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:47.105343 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:55:47.108909 (+ 3566us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:55:47.108914 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:55:47.108917 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:55:47.108948 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:55:47.111696 (+ 2748us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:55:47.112328 (+ 632us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:55:47.112335 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:55:47.112338 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:55:47.112478 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:55:47.112851 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:55:47.112856 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:55:47.112859 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:55:47.113110 (+ 251us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:55:47.113287 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0808 14:55:47.113667 (+ 380us) server_negotiation.cc:299] Negotiation successful
0808 14:55:47.113902 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260808 14:55:47.115119 20785 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.206.252" port: 36975 } has no permanent_uuid. Determining permanent_uuid...
I20260808 14:55:47.116952 20788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:47.101534 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52750 (local address 127.26.206.254:45503)
0808 14:55:47.101692 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0808 14:55:47.101696 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:55:47.101709 (+ 13us) server_negotiation.cc:407] Connection header received
0808 14:55:47.101767 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:55:47.101771 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:55:47.101833 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:55:47.101907 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:55:47.103236 (+ 1329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:47.104020 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:47.105509 (+ 1489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:47.105971 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:47.106105 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:55:47.110482 (+ 4377us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:55:47.110490 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:55:47.110495 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:55:47.110536 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:55:47.113099 (+ 2563us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:55:47.113854 (+ 755us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:55:47.113861 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:55:47.113865 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:55:47.113992 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:55:47.114495 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:55:47.114498 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:55:47.114500 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:55:47.114902 (+ 402us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:55:47.115158 (+ 256us) server_negotiation.cc:1035] Waiting for connection context
0808 14:55:47.116574 (+ 1416us) server_negotiation.cc:299] Negotiation successful
0808 14:55:47.116742 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
Aug 08 14:55:47 dist-test-slave-6k22 krb5kdc[20535](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200947, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.252@KRBTEST.COM for kudu/127.26.206.252@KRBTEST.COM
Aug 08 14:55:47 dist-test-slave-6k22 krb5kdc[20535](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200945, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.206.253@KRBTEST.COM
I20260808 14:55:47.129565 20790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:47.115785 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.252:36975 (local address 127.0.0.1:35618)
0808 14:55:47.115959 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0808 14:55:47.115981 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 14:55:47.116069 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:55:47.116460 (+ 391us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:55:47.116465 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:55:47.116827 (+ 362us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:55:47.116945 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:55:47.116952 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:55:47.118155 (+ 1203us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:55:47.118159 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:55:47.119410 (+ 1251us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:55:47.119421 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:55:47.120418 (+ 997us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:55:47.120422 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:55:47.120664 (+ 242us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:55:47.121181 (+ 517us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:55:47.121201 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:55:47.123446 (+ 2245us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:55:47.127170 (+ 3724us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:55:47.127191 (+ 21us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:55:47.127198 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:55:47.127735 (+ 537us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:55:47.128146 (+ 411us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:55:47.128151 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:55:47.128155 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:55:47.128336 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:55:47.128808 (+ 472us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:55:47.128813 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:55:47.128966 (+ 153us) client_negotiation.cc:769] Sending connection context
0808 14:55:47.129087 (+ 121us) client_negotiation.cc:240] Negotiation successful
0808 14:55:47.129271 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":59}
I20260808 14:55:47.129914 20791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:47.116001 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35618 (local address 127.26.206.252:36975)
0808 14:55:47.116188 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0808 14:55:47.116195 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:55:47.116211 (+ 16us) server_negotiation.cc:407] Connection header received
0808 14:55:47.116257 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:55:47.116261 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:55:47.116323 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:55:47.116417 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:55:47.117176 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:47.118034 (+ 858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:47.119547 (+ 1513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:47.120274 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:47.120419 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:55:47.123664 (+ 3245us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:55:47.123669 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:55:47.123672 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:55:47.123698 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:55:47.127042 (+ 3344us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:55:47.127881 (+ 839us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:55:47.127888 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:55:47.127891 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:55:47.128035 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:55:47.128445 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:55:47.128448 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:55:47.128450 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:55:47.128686 (+ 236us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:55:47.128842 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0808 14:55:47.129215 (+ 373us) server_negotiation.cc:299] Negotiation successful
0808 14:55:47.129472 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":71}
I20260808 14:55:47.134645 20708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:47.118676 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55636 (local address 127.26.206.253:46435)
0808 14:55:47.118862 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0808 14:55:47.118867 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:55:47.118887 (+ 20us) server_negotiation.cc:407] Connection header received
0808 14:55:47.118935 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:55:47.118940 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:55:47.119007 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:55:47.119102 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:55:47.120552 (+ 1450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:47.121607 (+ 1055us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:47.123047 (+ 1440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:47.123680 (+ 633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:47.123763 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:55:47.128916 (+ 5153us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:55:47.128920 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:55:47.128924 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:55:47.128952 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:55:47.132132 (+ 3180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:55:47.132705 (+ 573us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:55:47.132711 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:55:47.132714 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:55:47.132887 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:55:47.133229 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:55:47.133233 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:55:47.133236 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:55:47.133579 (+ 343us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:55:47.133859 (+ 280us) server_negotiation.cc:1035] Waiting for connection context
0808 14:55:47.134094 (+ 235us) server_negotiation.cc:299] Negotiation successful
0808 14:55:47.134302 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260808 14:55:47.135950 20785 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P be3a9e59fd2e4908811c0bfcfa1b99ed: Bootstrap starting.
I20260808 14:55:47.139389 27451 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:55:47.139916 20785 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P be3a9e59fd2e4908811c0bfcfa1b99ed: Neither blocks nor log segments found. Creating new log.
I20260808 14:55:47.141165 20785 log.cc:824] T 00000000000000000000000000000000 P be3a9e59fd2e4908811c0bfcfa1b99ed: Log is configured to *not* fsync() on all Append() calls
I20260808 14:55:47.143862 20785 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P be3a9e59fd2e4908811c0bfcfa1b99ed: No bootstrap required, opened a new log
I20260808 14:55:47.142525 20594 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "c3ee99a4f5204366b13d405cb0a126b1"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52750
I20260808 14:55:47.150691 20785 raft_consensus.cc:348] T 00000000000000000000000000000000 P be3a9e59fd2e4908811c0bfcfa1b99ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3ee99a4f5204366b13d405cb0a126b1" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 45503 } } peers { permanent_uuid: "e6e2e7131cef47b296707576b5a37325" member_type: VOTER last_known_addr { host: "127.26.206.253" port: 46435 } } peers { permanent_uuid: "be3a9e59fd2e4908811c0bfcfa1b99ed" member_type: VOTER last_known_addr { host: "127.26.206.252" port: 36975 } }
I20260808 14:55:47.151007 20785 raft_consensus.cc:729] T 00000000000000000000000000000000 P be3a9e59fd2e4908811c0bfcfa1b99ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be3a9e59fd2e4908811c0bfcfa1b99ed, State: Initialized, Role: FOLLOWER
I20260808 14:55:47.151449 20785 consensus_queue.cc:260] T 00000000000000000000000000000000 P be3a9e59fd2e4908811c0bfcfa1b99ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3ee99a4f5204366b13d405cb0a126b1" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 45503 } } peers { permanent_uuid: "e6e2e7131cef47b296707576b5a37325" member_type: VOTER last_known_addr { host: "127.26.206.253" port: 46435 } } peers { permanent_uuid: "be3a9e59fd2e4908811c0bfcfa1b99ed" member_type: VOTER last_known_addr { host: "127.26.206.252" port: 36975 } }
I20260808 14:55:47.152478 20793 sys_catalog.cc:455] T 00000000000000000000000000000000 P be3a9e59fd2e4908811c0bfcfa1b99ed [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3ee99a4f5204366b13d405cb0a126b1" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 45503 } } peers { permanent_uuid: "e6e2e7131cef47b296707576b5a37325" member_type: VOTER last_known_addr { host: "127.26.206.253" port: 46435 } } peers { permanent_uuid: "be3a9e59fd2e4908811c0bfcfa1b99ed" member_type: VOTER last_known_addr { host: "127.26.206.252" port: 36975 } } }
I20260808 14:55:47.152858 20793 sys_catalog.cc:458] T 00000000000000000000000000000000 P be3a9e59fd2e4908811c0bfcfa1b99ed [sys.catalog]: This master's current role is: FOLLOWER
I20260808 14:55:47.153357 20785 sys_catalog.cc:564] T 00000000000000000000000000000000 P be3a9e59fd2e4908811c0bfcfa1b99ed [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:55:47.161535 20622 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.206.252" port: 36975 } attempt: 4
W20260808 14:55:47.162683 20804 catalog_manager.cc:1558] T 00000000000000000000000000000000 P be3a9e59fd2e4908811c0bfcfa1b99ed: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 14:55:47.162814 20804 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 14:55:47.160472 20711 master_runner.cc:186] Error getting master registration for 127.26.206.254:45503: OK, instance_id { permanent_uuid: "c3ee99a4f5204366b13d405cb0a126b1" instance_seqno: 1786200946017698 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 14:55:47.170529 20711 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
Aug 08 14:55:47 dist-test-slave-6k22 krb5kdc[20535](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200945, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.254@KRBTEST.COM for kudu/127.26.206.252@KRBTEST.COM
I20260808 14:55:47.178645 20624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:47.162147 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.252:36975 (local address 127.0.0.1:35628)
0808 14:55:47.162527 (+ 380us) negotiation.cc:107] Waiting for socket to connect
0808 14:55:47.162547 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 14:55:47.162651 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:55:47.163378 (+ 727us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:55:47.163385 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:55:47.163903 (+ 518us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:55:47.164120 (+ 217us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:55:47.164132 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:55:47.165658 (+ 1526us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:55:47.165665 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:55:47.167188 (+ 1523us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:55:47.167205 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:55:47.168313 (+ 1108us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:55:47.168319 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:55:47.168529 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:55:47.169208 (+ 679us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:55:47.169235 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:55:47.171875 (+ 2640us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:55:47.175960 (+ 4085us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:55:47.175967 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:55:47.175971 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:55:47.176355 (+ 384us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:55:47.176735 (+ 380us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:55:47.176742 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:55:47.176746 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:55:47.176949 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:55:47.177641 (+ 692us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:55:47.177646 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:55:47.177817 (+ 171us) client_negotiation.cc:769] Sending connection context
0808 14:55:47.177966 (+ 149us) client_negotiation.cc:240] Negotiation successful
0808 14:55:47.178237 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":242}
I20260808 14:55:47.178694 20791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:47.162868 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35628 (local address 127.26.206.252:36975)
0808 14:55:47.163053 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0808 14:55:47.163059 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:55:47.163078 (+ 19us) server_negotiation.cc:407] Connection header received
0808 14:55:47.163129 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:55:47.163136 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:55:47.163212 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:55:47.163329 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:55:47.164274 (+ 945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:47.165491 (+ 1217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:47.167353 (+ 1862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:47.168149 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:47.168274 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:55:47.172046 (+ 3772us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:55:47.172053 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:55:47.172058 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:55:47.172095 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:55:47.175805 (+ 3710us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:55:47.176468 (+ 663us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:55:47.176474 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:55:47.176478 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:55:47.176618 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:55:47.177076 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:55:47.177081 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:55:47.177084 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:55:47.177517 (+ 433us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:55:47.177686 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0808 14:55:47.178081 (+ 395us) server_negotiation.cc:299] Negotiation successful
0808 14:55:47.178323 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260808 14:55:47.184715 20622 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c3ee99a4f5204366b13d405cb0a126b1: Bootstrap starting.
I20260808 14:55:47.188726 20622 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c3ee99a4f5204366b13d405cb0a126b1: Neither blocks nor log segments found. Creating new log.
I20260808 14:55:47.190068 20622 log.cc:824] T 00000000000000000000000000000000 P c3ee99a4f5204366b13d405cb0a126b1: Log is configured to *not* fsync() on all Append() calls
I20260808 14:55:47.193410 20622 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c3ee99a4f5204366b13d405cb0a126b1: No bootstrap required, opened a new log
I20260808 14:55:47.201107 20622 raft_consensus.cc:348] T 00000000000000000000000000000000 P c3ee99a4f5204366b13d405cb0a126b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3ee99a4f5204366b13d405cb0a126b1" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 45503 } } peers { permanent_uuid: "e6e2e7131cef47b296707576b5a37325" member_type: VOTER last_known_addr { host: "127.26.206.253" port: 46435 } } peers { permanent_uuid: "be3a9e59fd2e4908811c0bfcfa1b99ed" member_type: VOTER last_known_addr { host: "127.26.206.252" port: 36975 } }
I20260808 14:55:47.201515 20622 raft_consensus.cc:729] T 00000000000000000000000000000000 P c3ee99a4f5204366b13d405cb0a126b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3ee99a4f5204366b13d405cb0a126b1, State: Initialized, Role: FOLLOWER
I20260808 14:55:47.202003 20622 consensus_queue.cc:260] T 00000000000000000000000000000000 P c3ee99a4f5204366b13d405cb0a126b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3ee99a4f5204366b13d405cb0a126b1" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 45503 } } peers { permanent_uuid: "e6e2e7131cef47b296707576b5a37325" member_type: VOTER last_known_addr { host: "127.26.206.253" port: 46435 } } peers { permanent_uuid: "be3a9e59fd2e4908811c0bfcfa1b99ed" member_type: VOTER last_known_addr { host: "127.26.206.252" port: 36975 } }
I20260808 14:55:47.202939 20808 sys_catalog.cc:455] T 00000000000000000000000000000000 P c3ee99a4f5204366b13d405cb0a126b1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3ee99a4f5204366b13d405cb0a126b1" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 45503 } } peers { permanent_uuid: "e6e2e7131cef47b296707576b5a37325" member_type: VOTER last_known_addr { host: "127.26.206.253" port: 46435 } } peers { permanent_uuid: "be3a9e59fd2e4908811c0bfcfa1b99ed" member_type: VOTER last_known_addr { host: "127.26.206.252" port: 36975 } } }
I20260808 14:55:47.203312 20808 sys_catalog.cc:458] T 00000000000000000000000000000000 P c3ee99a4f5204366b13d405cb0a126b1 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 14:55:47.204160 20622 sys_catalog.cc:564] T 00000000000000000000000000000000 P c3ee99a4f5204366b13d405cb0a126b1 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:55:47.204267 20594 raft_consensus.cc:482] T 00000000000000000000000000000000 P c3ee99a4f5204366b13d405cb0a126b1 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260808 14:55:47.204483 20594 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c3ee99a4f5204366b13d405cb0a126b1 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:55:47.207134 20594 raft_consensus.cc:504] T 00000000000000000000000000000000 P c3ee99a4f5204366b13d405cb0a126b1 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3ee99a4f5204366b13d405cb0a126b1" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 45503 } } peers { permanent_uuid: "e6e2e7131cef47b296707576b5a37325" member_type: VOTER last_known_addr { host: "127.26.206.253" port: 46435 } } peers { permanent_uuid: "be3a9e59fd2e4908811c0bfcfa1b99ed" member_type: VOTER last_known_addr { host: "127.26.206.252" port: 36975 } }
I20260808 14:55:47.208436 20594 leader_election.cc:288] T 00000000000000000000000000000000 P c3ee99a4f5204366b13d405cb0a126b1 [CANDIDATE]: Term 1 election: Requested vote from peers e6e2e7131cef47b296707576b5a37325 (127.26.206.253:46435), be3a9e59fd2e4908811c0bfcfa1b99ed (127.26.206.252:36975)
I20260808 14:55:47.209560 20758 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c3ee99a4f5204366b13d405cb0a126b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "be3a9e59fd2e4908811c0bfcfa1b99ed"
I20260808 14:55:47.209905 20758 raft_consensus.cc:3037] T 00000000000000000000000000000000 P be3a9e59fd2e4908811c0bfcfa1b99ed [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:55:47.212613 20758 raft_consensus.cc:2454] T 00000000000000000000000000000000 P be3a9e59fd2e4908811c0bfcfa1b99ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3ee99a4f5204366b13d405cb0a126b1 in term 1.
I20260808 14:55:47.213210 20568 leader_election.cc:302] T 00000000000000000000000000000000 P c3ee99a4f5204366b13d405cb0a126b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be3a9e59fd2e4908811c0bfcfa1b99ed, c3ee99a4f5204366b13d405cb0a126b1; no voters:
I20260808 14:55:47.213752 20808 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c3ee99a4f5204366b13d405cb0a126b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:55:47.225129 20808 raft_consensus.cc:686] T 00000000000000000000000000000000 P c3ee99a4f5204366b13d405cb0a126b1 [term 1 LEADER]: Becoming Leader. State: Replica: c3ee99a4f5204366b13d405cb0a126b1, State: Running, Role: LEADER
I20260808 14:55:47.225999 20808 consensus_queue.cc:237] T 00000000000000000000000000000000 P c3ee99a4f5204366b13d405cb0a126b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3ee99a4f5204366b13d405cb0a126b1" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 45503 } } peers { permanent_uuid: "e6e2e7131cef47b296707576b5a37325" member_type: VOTER last_known_addr { host: "127.26.206.253" port: 46435 } } peers { permanent_uuid: "be3a9e59fd2e4908811c0bfcfa1b99ed" member_type: VOTER last_known_addr { host: "127.26.206.252" port: 36975 } }
I20260808 14:55:47.229945 20814 sys_catalog.cc:455] T 00000000000000000000000000000000 P c3ee99a4f5204366b13d405cb0a126b1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c3ee99a4f5204366b13d405cb0a126b1. Latest consensus state: current_term: 1 leader_uuid: "c3ee99a4f5204366b13d405cb0a126b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3ee99a4f5204366b13d405cb0a126b1" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 45503 } } peers { permanent_uuid: "e6e2e7131cef47b296707576b5a37325" member_type: VOTER last_known_addr { host: "127.26.206.253" port: 46435 } } peers { permanent_uuid: "be3a9e59fd2e4908811c0bfcfa1b99ed" member_type: VOTER last_known_addr { host: "127.26.206.252" port: 36975 } } }
I20260808 14:55:47.230365 20814 sys_catalog.cc:458] T 00000000000000000000000000000000 P c3ee99a4f5204366b13d405cb0a126b1 [sys.catalog]: This master's current role is: LEADER
I20260808 14:55:47.235934 20820 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:55:47.250716 20820 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:55:47.254088 20704 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.206.252" port: 36975 } attempt: 5
W20260808 14:55:47.257141 20571 tablet.cc:2369] T 00000000000000000000000000000000 P c3ee99a4f5204366b13d405cb0a126b1: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 08 14:55:47 dist-test-slave-6k22 krb5kdc[20535](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200946, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.206.253@KRBTEST.COM for kudu/127.26.206.252@KRBTEST.COM
I20260808 14:55:47.273561 20758 raft_consensus.cc:1261] T 00000000000000000000000000000000 P be3a9e59fd2e4908811c0bfcfa1b99ed [term 1 FOLLOWER]: Refusing update from remote peer c3ee99a4f5204366b13d405cb0a126b1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:55:47.274600 20814 consensus_queue.cc:1035] T 00000000000000000000000000000000 P c3ee99a4f5204366b13d405cb0a126b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3a9e59fd2e4908811c0bfcfa1b99ed" member_type: VOTER last_known_addr { host: "127.26.206.252" port: 36975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:55:47.278966 20791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:47.255753 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35634 (local address 127.26.206.252:36975)
0808 14:55:47.255988 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0808 14:55:47.255995 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:55:47.256025 (+ 30us) server_negotiation.cc:407] Connection header received
0808 14:55:47.256278 (+ 253us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:55:47.256288 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:55:47.256411 (+ 123us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:55:47.256512 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:55:47.258062 (+ 1550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:47.259492 (+ 1430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:47.261755 (+ 2263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:47.262640 (+ 885us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:47.262790 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:55:47.267993 (+ 5203us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:55:47.268002 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:55:47.268009 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:55:47.268060 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:55:47.273077 (+ 5017us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:55:47.274263 (+ 1186us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:55:47.274274 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:55:47.274280 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:55:47.274469 (+ 189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:55:47.275210 (+ 741us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:55:47.275218 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:55:47.275223 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:55:47.275704 (+ 481us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:55:47.275901 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0808 14:55:47.278064 (+ 2163us) server_negotiation.cc:299] Negotiation successful
0808 14:55:47.278385 (+ 321us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260808 14:55:47.286876 20706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:47.254892 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.206.252:36975 (local address 127.0.0.1:35634)
0808 14:55:47.255396 (+ 504us) negotiation.cc:107] Waiting for socket to connect
0808 14:55:47.255421 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0808 14:55:47.256060 (+ 639us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:55:47.256787 (+ 727us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:55:47.256795 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:55:47.257450 (+ 655us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:55:47.257720 (+ 270us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:55:47.257736 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:55:47.259747 (+ 2011us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:55:47.259755 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:55:47.261546 (+ 1791us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:55:47.261565 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:55:47.263049 (+ 1484us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:55:47.263058 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:55:47.263376 (+ 318us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:55:47.264159 (+ 783us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:55:47.264190 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:55:47.267716 (+ 3526us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:55:47.273262 (+ 5546us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:55:47.273268 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:55:47.273275 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:55:47.274086 (+ 811us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:55:47.274635 (+ 549us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:55:47.274643 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:55:47.274649 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:55:47.275042 (+ 393us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:55:47.275967 (+ 925us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:55:47.275972 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:55:47.276237 (+ 265us) client_negotiation.cc:769] Sending connection context
0808 14:55:47.277009 (+ 772us) client_negotiation.cc:240] Negotiation successful
0808 14:55:47.277408 (+ 399us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":352}
W20260808 14:55:47.298755 20733 tablet.cc:2369] T 00000000000000000000000000000000 P be3a9e59fd2e4908811c0bfcfa1b99ed: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:55:47.300704 20793 sys_catalog.cc:455] T 00000000000000000000000000000000 P be3a9e59fd2e4908811c0bfcfa1b99ed [sys.catalog]: SysCatalogTable state changed. Reason: New leader c3ee99a4f5204366b13d405cb0a126b1. Latest consensus state: current_term: 1 leader_uuid: "c3ee99a4f5204366b13d405cb0a126b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3ee99a4f5204366b13d405cb0a126b1" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 45503 } } peers { permanent_uuid: "e6e2e7131cef47b296707576b5a37325" member_type: VOTER last_known_addr { host: "127.26.206.253" port: 46435 } } peers { permanent_uuid: "be3a9e59fd2e4908811c0bfcfa1b99ed" member_type: VOTER last_known_addr { host: "127.26.206.252" port: 36975 } } }
I20260808 14:55:47.301013 20793 sys_catalog.cc:458] T 00000000000000000000000000000000 P be3a9e59fd2e4908811c0bfcfa1b99ed [sys.catalog]: This master's current role is: FOLLOWER
I20260808 14:55:47.306025 20826 mvcc.cc:205] Tried to move back new op lower bound from 7316279079985328128 to 7316279079842770944. Current Snapshot: MvccSnapshot[applied={T|T < 7316279079985328128}]
I20260808 14:55:47.309319 20704 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e6e2e7131cef47b296707576b5a37325: Bootstrap starting.
I20260808 14:55:47.309926 20793 sys_catalog.cc:455] T 00000000000000000000000000000000 P be3a9e59fd2e4908811c0bfcfa1b99ed [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c3ee99a4f5204366b13d405cb0a126b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3ee99a4f5204366b13d405cb0a126b1" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 45503 } } peers { permanent_uuid: "e6e2e7131cef47b296707576b5a37325" member_type: VOTER last_known_addr { host: "127.26.206.253" port: 46435 } } peers { permanent_uuid: "be3a9e59fd2e4908811c0bfcfa1b99ed" member_type: VOTER last_known_addr { host: "127.26.206.252" port: 36975 } } }
I20260808 14:55:47.310201 20793 sys_catalog.cc:458] T 00000000000000000000000000000000 P be3a9e59fd2e4908811c0bfcfa1b99ed [sys.catalog]: This master's current role is: FOLLOWER
I20260808 14:55:47.314620 20704 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e6e2e7131cef47b296707576b5a37325: Neither blocks nor log segments found. Creating new log.
I20260808 14:55:47.318137 20704 log.cc:824] T 00000000000000000000000000000000 P e6e2e7131cef47b296707576b5a37325: Log is configured to *not* fsync() on all Append() calls
I20260808 14:55:47.325186 20814 sys_catalog.cc:455] T 00000000000000000000000000000000 P c3ee99a4f5204366b13d405cb0a126b1 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c3ee99a4f5204366b13d405cb0a126b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3ee99a4f5204366b13d405cb0a126b1" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 45503 } } peers { permanent_uuid: "e6e2e7131cef47b296707576b5a37325" member_type: VOTER last_known_addr { host: "127.26.206.253" port: 46435 } } peers { permanent_uuid: "be3a9e59fd2e4908811c0bfcfa1b99ed" member_type: VOTER last_known_addr { host: "127.26.206.252" port: 36975 } } }
I20260808 14:55:47.325484 20814 sys_catalog.cc:458] T 00000000000000000000000000000000 P c3ee99a4f5204366b13d405cb0a126b1 [sys.catalog]: This master's current role is: LEADER
I20260808 14:55:47.326339 20820 catalog_manager.cc:1347] Generated new cluster ID: b1dba50f14064e64a05ea037abc76f5a
I20260808 14:55:47.326435 20820 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:55:47.335990 20839 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260808 14:55:47.338335 20704 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e6e2e7131cef47b296707576b5a37325: No bootstrap required, opened a new log
I20260808 14:55:47.357373 20820 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:55:47.343092 20549 master_runner.cc:186] Error getting master registration for 127.26.206.253:46435: OK, instance_id { permanent_uuid: "e6e2e7131cef47b296707576b5a37325" instance_seqno: 1786200946531858 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 14:55:47.359143 20820 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:55:47.359545 20549 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 14:55:47.361294 20704 raft_consensus.cc:348] T 00000000000000000000000000000000 P e6e2e7131cef47b296707576b5a37325 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3ee99a4f5204366b13d405cb0a126b1" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 45503 } } peers { permanent_uuid: "e6e2e7131cef47b296707576b5a37325" member_type: VOTER last_known_addr { host: "127.26.206.253" port: 46435 } } peers { permanent_uuid: "be3a9e59fd2e4908811c0bfcfa1b99ed" member_type: VOTER last_known_addr { host: "127.26.206.252" port: 36975 } }
I20260808 14:55:47.361701 20704 raft_consensus.cc:729] T 00000000000000000000000000000000 P e6e2e7131cef47b296707576b5a37325 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6e2e7131cef47b296707576b5a37325, State: Initialized, Role: FOLLOWER
I20260808 14:55:47.362253 20704 consensus_queue.cc:260] T 00000000000000000000000000000000 P e6e2e7131cef47b296707576b5a37325 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3ee99a4f5204366b13d405cb0a126b1" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 45503 } } peers { permanent_uuid: "e6e2e7131cef47b296707576b5a37325" member_type: VOTER last_known_addr { host: "127.26.206.253" port: 46435 } } peers { permanent_uuid: "be3a9e59fd2e4908811c0bfcfa1b99ed" member_type: VOTER last_known_addr { host: "127.26.206.252" port: 36975 } }
I20260808 14:55:47.363605 20840 sys_catalog.cc:455] T 00000000000000000000000000000000 P e6e2e7131cef47b296707576b5a37325 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3ee99a4f5204366b13d405cb0a126b1" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 45503 } } peers { permanent_uuid: "e6e2e7131cef47b296707576b5a37325" member_type: VOTER last_known_addr { host: "127.26.206.253" port: 46435 } } peers { permanent_uuid: "be3a9e59fd2e4908811c0bfcfa1b99ed" member_type: VOTER last_known_addr { host: "127.26.206.252" port: 36975 } } }
I20260808 14:55:47.364439 20840 sys_catalog.cc:458] T 00000000000000000000000000000000 P e6e2e7131cef47b296707576b5a37325 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 14:55:47.377797 20708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:47.288934 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55648 (local address 127.26.206.253:46435)
0808 14:55:47.289189 (+ 255us) server_negotiation.cc:206] Beginning negotiation
0808 14:55:47.289197 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:55:47.321633 (+ 32436us) server_negotiation.cc:407] Connection header received
0808 14:55:47.323415 (+ 1782us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:55:47.323420 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:55:47.323514 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:55:47.323613 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:55:47.328680 (+ 5067us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:47.330139 (+ 1459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:47.333288 (+ 3149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:47.334014 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:47.334150 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:55:47.367736 (+ 33586us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:55:47.367744 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:55:47.367748 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:55:47.367800 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:55:47.371694 (+ 3894us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:55:47.374998 (+ 3304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:55:47.375006 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:55:47.375010 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:55:47.375174 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:55:47.375678 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:55:47.375683 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:55:47.375686 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:55:47.376162 (+ 476us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:55:47.376438 (+ 276us) server_negotiation.cc:1035] Waiting for connection context
0808 14:55:47.377055 (+ 617us) server_negotiation.cc:299] Negotiation successful
0808 14:55:47.377404 (+ 349us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94}
I20260808 14:55:47.384655 20788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:47.281086 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52758 (local address 127.26.206.254:45503)
0808 14:55:47.281235 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0808 14:55:47.281240 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:55:47.320730 (+ 39490us) server_negotiation.cc:407] Connection header received
0808 14:55:47.320958 (+ 228us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:55:47.320963 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:55:47.321046 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:55:47.321148 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:55:47.350215 (+ 29067us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:47.351419 (+ 1204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:47.364073 (+ 12654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:47.364792 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:47.364900 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:55:47.371042 (+ 6142us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:55:47.371050 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:55:47.371057 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:55:47.371103 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:55:47.375353 (+ 4250us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:55:47.377273 (+ 1920us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:55:47.377280 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:55:47.377286 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:55:47.377602 (+ 316us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:55:47.378550 (+ 948us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:55:47.378555 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:55:47.378558 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:55:47.380936 (+ 2378us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:55:47.381665 (+ 729us) server_negotiation.cc:1035] Waiting for connection context
0808 14:55:47.383063 (+ 1398us) server_negotiation.cc:299] Negotiation successful
0808 14:55:47.383746 (+ 683us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260808 14:55:47.384859 20820 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c3ee99a4f5204366b13d405cb0a126b1: Generated new TSK 0
I20260808 14:55:47.385995 20820 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:55:47.386741 20791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:47.322632 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35638 (local address 127.26.206.252:36975)
0808 14:55:47.322805 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0808 14:55:47.322810 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:55:47.334160 (+ 11350us) server_negotiation.cc:407] Connection header received
0808 14:55:47.347699 (+ 13539us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:55:47.347705 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:55:47.347825 (+ 120us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:55:47.347912 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:55:47.353352 (+ 5440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:47.354532 (+ 1180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:47.365779 (+ 11247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:47.366544 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:47.366656 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:55:47.378944 (+ 12288us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:55:47.378950 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:55:47.378954 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:55:47.378999 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:55:47.383062 (+ 4063us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:55:47.383906 (+ 844us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:55:47.383912 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:55:47.383915 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:55:47.384061 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:55:47.384547 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:55:47.384552 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:55:47.384556 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:55:47.385213 (+ 657us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:55:47.385477 (+ 264us) server_negotiation.cc:1035] Waiting for connection context
0808 14:55:47.386068 (+ 591us) server_negotiation.cc:299] Negotiation successful
0808 14:55:47.386344 (+ 276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260808 14:55:47.390762 20704 sys_catalog.cc:564] T 00000000000000000000000000000000 P e6e2e7131cef47b296707576b5a37325 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:55:47.391173 20674 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e6e2e7131cef47b296707576b5a37325 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:55:47.395776 20675 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c3ee99a4f5204366b13d405cb0a126b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "e6e2e7131cef47b296707576b5a37325"
I20260808 14:55:47.405967 20674 raft_consensus.cc:1261] T 00000000000000000000000000000000 P e6e2e7131cef47b296707576b5a37325 [term 1 FOLLOWER]: Refusing update from remote peer c3ee99a4f5204366b13d405cb0a126b1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:55:47.410728 20675 raft_consensus.cc:2454] T 00000000000000000000000000000000 P e6e2e7131cef47b296707576b5a37325 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3ee99a4f5204366b13d405cb0a126b1 in term 1.
I20260808 14:55:47.411976 20808 consensus_queue.cc:1035] T 00000000000000000000000000000000 P c3ee99a4f5204366b13d405cb0a126b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6e2e7131cef47b296707576b5a37325" member_type: VOTER last_known_addr { host: "127.26.206.253" port: 46435 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:55:47.457253 20840 sys_catalog.cc:455] T 00000000000000000000000000000000 P e6e2e7131cef47b296707576b5a37325 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c3ee99a4f5204366b13d405cb0a126b1. Latest consensus state: current_term: 1 leader_uuid: "c3ee99a4f5204366b13d405cb0a126b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3ee99a4f5204366b13d405cb0a126b1" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 45503 } } peers { permanent_uuid: "e6e2e7131cef47b296707576b5a37325" member_type: VOTER last_known_addr { host: "127.26.206.253" port: 46435 } } peers { permanent_uuid: "be3a9e59fd2e4908811c0bfcfa1b99ed" member_type: VOTER last_known_addr { host: "127.26.206.252" port: 36975 } } }
I20260808 14:55:47.457600 20840 sys_catalog.cc:458] T 00000000000000000000000000000000 P e6e2e7131cef47b296707576b5a37325 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 14:55:47.457885 20847 sys_catalog.cc:455] T 00000000000000000000000000000000 P e6e2e7131cef47b296707576b5a37325 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c3ee99a4f5204366b13d405cb0a126b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3ee99a4f5204366b13d405cb0a126b1" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 45503 } } peers { permanent_uuid: "e6e2e7131cef47b296707576b5a37325" member_type: VOTER last_known_addr { host: "127.26.206.253" port: 46435 } } peers { permanent_uuid: "be3a9e59fd2e4908811c0bfcfa1b99ed" member_type: VOTER last_known_addr { host: "127.26.206.252" port: 36975 } } }
I20260808 14:55:47.458215 20847 sys_catalog.cc:458] T 00000000000000000000000000000000 P e6e2e7131cef47b296707576b5a37325 [sys.catalog]: This master's current role is: FOLLOWER
W20260808 14:55:47.535776 27451 mini_kdc.cc:348] Time spent kdestroy: real 0.120s user 0.000s sys 0.034s
I20260808 14:55:47.558183 20859 catalog_manager.cc:1259] Loaded cluster ID: b1dba50f14064e64a05ea037abc76f5a
I20260808 14:55:47.558323 20859 catalog_manager.cc:1552] T 00000000000000000000000000000000 P e6e2e7131cef47b296707576b5a37325: loading cluster ID for follower catalog manager: success
I20260808 14:55:47.563138 20859 catalog_manager.cc:1574] T 00000000000000000000000000000000 P e6e2e7131cef47b296707576b5a37325: acquiring CA information for follower catalog manager: success
I20260808 14:55:47.566301 20859 catalog_manager.cc:1602] T 00000000000000000000000000000000 P e6e2e7131cef47b296707576b5a37325: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260808 14:55:47.607388 20708 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:55:47.594547 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55650 (local address 127.26.206.253:46435)
0808 14:55:47.594921 (+ 374us) server_negotiation.cc:206] Beginning negotiation
0808 14:55:47.594927 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:55:47.604983 (+ 10056us) server_negotiation.cc:407] Connection header received
0808 14:55:47.605512 (+ 529us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:55:47.605522 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:55:47.605628 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:55:47.605723 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:55:47.607159 (+ 1436us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55650: BlockingRecv error: recv got EOF from 127.0.0.1:55650 (error 108)
Metrics: {"server-negotiator.queue_time_us":233}
W20260808 14:55:47.609822 20791 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:55:47.605235 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35654 (local address 127.26.206.252:36975)
0808 14:55:47.605410 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0808 14:55:47.605415 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:55:47.608320 (+ 2905us) server_negotiation.cc:407] Connection header received
0808 14:55:47.608544 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:55:47.608550 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:55:47.608630 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:55:47.608696 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:55:47.609574 (+ 878us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35654: BlockingRecv error: recv got EOF from 127.0.0.1:35654 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
W20260808 14:55:47.611179 20788 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:55:47.594341 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52766 (local address 127.26.206.254:45503)
0808 14:55:47.594740 (+ 399us) server_negotiation.cc:206] Beginning negotiation
0808 14:55:47.594746 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:55:47.602167 (+ 7421us) server_negotiation.cc:407] Connection header received
0808 14:55:47.602388 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:55:47.602396 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:55:47.602505 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:55:47.602601 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:55:47.610962 (+ 8361us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52766: BlockingRecv error: recv got EOF from 127.0.0.1:52766 (error 108)
Metrics: {"server-negotiator.queue_time_us":268}
I20260808 14:55:47.667017 20708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:47.647950 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55662 (local address 127.26.206.253:46435)
0808 14:55:47.648138 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0808 14:55:47.648146 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:55:47.659117 (+ 10971us) server_negotiation.cc:407] Connection header received
0808 14:55:47.659667 (+ 550us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:55:47.659676 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:55:47.659893 (+ 217us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:55:47.660034 (+ 141us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:55:47.660740 (+ 706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:47.661916 (+ 1176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:47.663992 (+ 2076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:47.664698 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:47.664816 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:55:47.665550 (+ 734us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:55:47.666215 (+ 665us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:55:47.666335 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0808 14:55:47.666590 (+ 255us) server_negotiation.cc:299] Negotiation successful
0808 14:55:47.666682 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
W20260808 14:55:47.709343 20791 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:55:47.699487 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35664 (local address 127.26.206.252:36975)
0808 14:55:47.699729 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0808 14:55:47.699736 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:55:47.707151 (+ 7415us) server_negotiation.cc:407] Connection header received
0808 14:55:47.707685 (+ 534us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:55:47.707691 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:55:47.707883 (+ 192us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:55:47.707965 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:55:47.709069 (+ 1104us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35664: BlockingRecv error: recv got EOF from 127.0.0.1:35664 (error 108)
Metrics: {"server-negotiator.queue_time_us":77}
I20260808 14:55:47.758859 20708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:47.740958 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55664 (local address 127.26.206.253:46435)
0808 14:55:47.741167 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0808 14:55:47.741175 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:55:47.751824 (+ 10649us) server_negotiation.cc:407] Connection header received
0808 14:55:47.752320 (+ 496us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:55:47.752328 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:55:47.752456 (+ 128us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:55:47.752538 (+ 82us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:55:47.753267 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:47.754405 (+ 1138us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:47.756457 (+ 2052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:47.757166 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:47.757275 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:55:47.757920 (+ 645us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:55:47.758079 (+ 159us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:55:47.758143 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0808 14:55:47.758417 (+ 274us) server_negotiation.cc:299] Negotiation successful
0808 14:55:47.758504 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
W20260808 14:55:47.786082 20791 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:55:47.782781 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35668 (local address 127.26.206.252:36975)
0808 14:55:47.782988 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0808 14:55:47.782995 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:55:47.784209 (+ 1214us) server_negotiation.cc:407] Connection header received
0808 14:55:47.784545 (+ 336us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:55:47.784552 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:55:47.784659 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:55:47.784797 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:55:47.785814 (+ 1017us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35668: BlockingRecv error: recv got EOF from 127.0.0.1:35668 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
I20260808 14:55:47.799520 20708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:47.791883 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55670 (local address 127.26.206.253:46435)
0808 14:55:47.792058 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0808 14:55:47.792064 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:55:47.792609 (+ 545us) server_negotiation.cc:407] Connection header received
0808 14:55:47.792871 (+ 262us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:55:47.792877 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:55:47.792974 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:55:47.793087 (+ 113us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:55:47.793629 (+ 542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:47.794929 (+ 1300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:47.797123 (+ 2194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:47.797837 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:47.797974 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:55:47.798511 (+ 537us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:55:47.798685 (+ 174us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:55:47.798789 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0808 14:55:47.798991 (+ 202us) server_negotiation.cc:299] Negotiation successful
0808 14:55:47.799092 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
W20260808 14:55:47.814559 20791 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:55:47.812138 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35684 (local address 127.26.206.252:36975)
0808 14:55:47.812349 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0808 14:55:47.812356 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:55:47.813022 (+ 666us) server_negotiation.cc:407] Connection header received
0808 14:55:47.813183 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:55:47.813189 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:55:47.813300 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:55:47.813426 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:55:47.814298 (+ 872us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35684: BlockingRecv error: recv got EOF from 127.0.0.1:35684 (error 108)
Metrics: {"server-negotiator.queue_time_us":78}
I20260808 14:55:47.832427 20708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:47.824985 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55686 (local address 127.26.206.253:46435)
0808 14:55:47.825223 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0808 14:55:47.825234 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 14:55:47.825790 (+ 556us) server_negotiation.cc:407] Connection header received
0808 14:55:47.825973 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:55:47.825981 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:55:47.826082 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:55:47.826228 (+ 146us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:55:47.826767 (+ 539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:47.828158 (+ 1391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:47.830155 (+ 1997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:47.830935 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:47.831101 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:55:47.831591 (+ 490us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:55:47.831748 (+ 157us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:55:47.831860 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0808 14:55:47.832029 (+ 169us) server_negotiation.cc:299] Negotiation successful
0808 14:55:47.832123 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":117}
W20260808 14:55:47.842567 20791 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:55:47.839875 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35686 (local address 127.26.206.252:36975)
0808 14:55:47.840188 (+ 313us) server_negotiation.cc:206] Beginning negotiation
0808 14:55:47.840195 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:55:47.840762 (+ 567us) server_negotiation.cc:407] Connection header received
0808 14:55:47.841056 (+ 294us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:55:47.841063 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:55:47.841161 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:55:47.841248 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:55:47.842309 (+ 1061us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35686: BlockingRecv error: recv got EOF from 127.0.0.1:35686 (error 108)
Metrics: {"server-negotiator.queue_time_us":177}
I20260808 14:55:47.863065 20708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:47.855810 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55692 (local address 127.26.206.253:46435)
0808 14:55:47.856041 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0808 14:55:47.856048 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:55:47.856609 (+ 561us) server_negotiation.cc:407] Connection header received
0808 14:55:47.856832 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:55:47.856838 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:55:47.856923 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:55:47.857030 (+ 107us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:55:47.857553 (+ 523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:47.858667 (+ 1114us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:47.860869 (+ 2202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:47.861527 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:47.861658 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:55:47.862227 (+ 569us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:55:47.862359 (+ 132us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:55:47.862476 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0808 14:55:47.862646 (+ 170us) server_negotiation.cc:299] Negotiation successful
0808 14:55:47.862726 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
W20260808 14:55:47.882124 20791 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:55:47.877570 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35694 (local address 127.26.206.252:36975)
0808 14:55:47.877752 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0808 14:55:47.877759 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:55:47.880148 (+ 2389us) server_negotiation.cc:407] Connection header received
0808 14:55:47.880367 (+ 219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:55:47.880375 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:55:47.880492 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:55:47.880677 (+ 185us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:55:47.881870 (+ 1193us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35694: BlockingRecv error: recv got EOF from 127.0.0.1:35694 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
I20260808 14:55:47.912830 20708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:47.905561 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55694 (local address 127.26.206.253:46435)
0808 14:55:47.905751 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0808 14:55:47.905763 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 14:55:47.906298 (+ 535us) server_negotiation.cc:407] Connection header received
0808 14:55:47.906496 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:55:47.906503 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:55:47.906600 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:55:47.906721 (+ 121us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:55:47.907191 (+ 470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:47.908515 (+ 1324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:47.910511 (+ 1996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:47.911260 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:47.911395 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:55:47.911976 (+ 581us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:55:47.912122 (+ 146us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:55:47.912231 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0808 14:55:47.912414 (+ 183us) server_negotiation.cc:299] Negotiation successful
0808 14:55:47.912509 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
W20260808 14:55:47.931453 20791 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:55:47.920393 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35704 (local address 127.26.206.252:36975)
0808 14:55:47.920570 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0808 14:55:47.920575 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:55:47.929516 (+ 8941us) server_negotiation.cc:407] Connection header received
0808 14:55:47.929966 (+ 450us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:55:47.929971 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:55:47.930087 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:55:47.930163 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:55:47.931218 (+ 1055us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35704: BlockingRecv error: recv got EOF from 127.0.0.1:35704 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
I20260808 14:55:47.934913 20808 sys_catalog.cc:455] T 00000000000000000000000000000000 P c3ee99a4f5204366b13d405cb0a126b1 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c3ee99a4f5204366b13d405cb0a126b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3ee99a4f5204366b13d405cb0a126b1" member_type: VOTER last_known_addr { host: "127.26.206.254" port: 45503 } } peers { permanent_uuid: "e6e2e7131cef47b296707576b5a37325" member_type: VOTER last_known_addr { host: "127.26.206.253" port: 46435 } } peers { permanent_uuid: "be3a9e59fd2e4908811c0bfcfa1b99ed" member_type: VOTER last_known_addr { host: "127.26.206.252" port: 36975 } } }
I20260808 14:55:47.935596 20808 sys_catalog.cc:458] T 00000000000000000000000000000000 P c3ee99a4f5204366b13d405cb0a126b1 [sys.catalog]: This master's current role is: LEADER
I20260808 14:55:47.974272 20708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:47.968074 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55706 (local address 127.26.206.253:46435)
0808 14:55:47.968307 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0808 14:55:47.968315 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:55:47.968727 (+ 412us) server_negotiation.cc:407] Connection header received
0808 14:55:47.968890 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:55:47.968898 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:55:47.969035 (+ 137us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:55:47.969186 (+ 151us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:55:47.969563 (+ 377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:47.970731 (+ 1168us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:47.972154 (+ 1423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:47.972933 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:47.973089 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:55:47.973422 (+ 333us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:55:47.973567 (+ 145us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:55:47.973690 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0808 14:55:47.973785 (+ 95us) server_negotiation.cc:299] Negotiation successful
0808 14:55:47.973873 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
W20260808 14:55:47.982868 20791 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:55:47.980833 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35716 (local address 127.26.206.252:36975)
0808 14:55:47.981068 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0808 14:55:47.981074 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:55:47.981473 (+ 399us) server_negotiation.cc:407] Connection header received
0808 14:55:47.981660 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:55:47.981664 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:55:47.981733 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:55:47.981844 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:55:47.982606 (+ 762us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35716: BlockingRecv error: recv got EOF from 127.0.0.1:35716 (error 108)
Metrics: {"server-negotiator.queue_time_us":76}
I20260808 14:55:48.057747 20708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:48.051219 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55716 (local address 127.26.206.253:46435)
0808 14:55:48.051425 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0808 14:55:48.051431 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:55:48.051886 (+ 455us) server_negotiation.cc:407] Connection header received
0808 14:55:48.052072 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:55:48.052079 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:55:48.052187 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:55:48.052333 (+ 146us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:55:48.052725 (+ 392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:48.053991 (+ 1266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:48.055523 (+ 1532us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:48.056392 (+ 869us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:48.056546 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:55:48.056926 (+ 380us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:55:48.057086 (+ 160us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:55:48.057196 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0808 14:55:48.057300 (+ 104us) server_negotiation.cc:299] Negotiation successful
0808 14:55:48.057401 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
W20260808 14:55:48.067080 20791 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:55:48.064643 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35728 (local address 127.26.206.252:36975)
0808 14:55:48.064851 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0808 14:55:48.064857 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:55:48.065475 (+ 618us) server_negotiation.cc:407] Connection header received
0808 14:55:48.065696 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:55:48.065701 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:55:48.065818 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:55:48.065919 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:55:48.066890 (+ 971us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35728: BlockingRecv error: recv got EOF from 127.0.0.1:35728 (error 108)
Metrics: {"server-negotiator.queue_time_us":85}
I20260808 14:55:48.164808 20804 catalog_manager.cc:1259] Loaded cluster ID: b1dba50f14064e64a05ea037abc76f5a
I20260808 14:55:48.164911 20804 catalog_manager.cc:1552] T 00000000000000000000000000000000 P be3a9e59fd2e4908811c0bfcfa1b99ed: loading cluster ID for follower catalog manager: success
I20260808 14:55:48.167354 20804 catalog_manager.cc:1574] T 00000000000000000000000000000000 P be3a9e59fd2e4908811c0bfcfa1b99ed: acquiring CA information for follower catalog manager: success
I20260808 14:55:48.169035 20804 catalog_manager.cc:1602] T 00000000000000000000000000000000 P be3a9e59fd2e4908811c0bfcfa1b99ed: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 14:55:48.203745 20708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:48.198987 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55718 (local address 127.26.206.253:46435)
0808 14:55:48.199235 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0808 14:55:48.199241 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:55:48.199592 (+ 351us) server_negotiation.cc:407] Connection header received
0808 14:55:48.199794 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:55:48.199798 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:55:48.199875 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:55:48.199956 (+ 81us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:55:48.200342 (+ 386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:48.201045 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:48.202272 (+ 1227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:48.202659 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:48.202748 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:55:48.203079 (+ 331us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:55:48.203187 (+ 108us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:55:48.203251 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0808 14:55:48.203383 (+ 132us) server_negotiation.cc:299] Negotiation successful
0808 14:55:48.203440 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260808 14:55:48.214172 20791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:48.209048 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35738 (local address 127.26.206.252:36975)
0808 14:55:48.209272 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0808 14:55:48.209289 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 14:55:48.209491 (+ 202us) server_negotiation.cc:407] Connection header received
0808 14:55:48.209625 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:55:48.209628 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:55:48.209774 (+ 146us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:55:48.209869 (+ 95us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:55:48.210191 (+ 322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:48.210884 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:48.212160 (+ 1276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:48.212568 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:48.212659 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:55:48.213103 (+ 444us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:55:48.213603 (+ 500us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:55:48.213707 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0808 14:55:48.213791 (+ 84us) server_negotiation.cc:299] Negotiation successful
0808 14:55:48.213850 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260808 14:55:48.228118 20708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:48.219815 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55728 (local address 127.26.206.253:46435)
0808 14:55:48.220045 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0808 14:55:48.220054 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:55:48.221120 (+ 1066us) server_negotiation.cc:407] Connection header received
0808 14:55:48.221388 (+ 268us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:55:48.221396 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:55:48.221479 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:55:48.221543 (+ 64us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:55:48.222525 (+ 982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:48.223672 (+ 1147us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:48.225776 (+ 2104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:48.226266 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:48.226441 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:55:48.227369 (+ 928us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:55:48.227464 (+ 95us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:55:48.227564 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0808 14:55:48.227751 (+ 187us) server_negotiation.cc:299] Negotiation successful
0808 14:55:48.227833 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260808 14:55:48.228451 20791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:48.221190 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35752 (local address 127.26.206.252:36975)
0808 14:55:48.221361 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0808 14:55:48.221366 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:55:48.222857 (+ 1491us) server_negotiation.cc:407] Connection header received
0808 14:55:48.223021 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:55:48.223044 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:55:48.223134 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:55:48.223249 (+ 115us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:55:48.223808 (+ 559us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:48.224585 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:48.226484 (+ 1899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:48.227075 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:48.227204 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:55:48.227731 (+ 527us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:55:48.227841 (+ 110us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:55:48.227924 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0808 14:55:48.228096 (+ 172us) server_negotiation.cc:299] Negotiation successful
0808 14:55:48.228184 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260808 14:55:48.228724 20982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:55:48.219734 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52778 (local address 127.26.206.254:45503)
0808 14:55:48.220487 (+ 753us) server_negotiation.cc:206] Beginning negotiation
0808 14:55:48.220493 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:55:48.220969 (+ 476us) server_negotiation.cc:407] Connection header received
0808 14:55:48.221198 (+ 229us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:55:48.221203 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:55:48.221418 (+ 215us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:55:48.221585 (+ 167us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:55:48.223152 (+ 1567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:48.224253 (+ 1101us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:48.226076 (+ 1823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:55:48.226650 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:55:48.226734 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:55:48.227473 (+ 739us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:55:48.228157 (+ 684us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:55:48.228284 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0808 14:55:48.228369 (+ 85us) server_negotiation.cc:299] Negotiation successful
0808 14:55:48.228450 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":593,"thread_start_us":435,"threads_started":1}
I20260808 14:55:48.233294 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 20549
I20260808 14:55:48.234269 20617 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:55:48.344794 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 20549
I20260808 14:55:48.369721 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 20629
I20260808 14:55:48.370838 20698 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:55:48.481004 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 20629
I20260808 14:55:48.504789 27451 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskBCPck2/build/asan/bin/kudu pid 20711
I20260808 14:55:48.505957 20780 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 14:55:48.612907 27451 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskBCPck2/build/asan/bin/kudu with pid 20711
2026-08-08T14:55:48Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (4520 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (9594 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (371048 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST